Data Engineer (offline)

Data driven decision-making is integral to mobile advertising, marketing and operations at our company. Your work will directly impact millions of end-users in the future. This is your chance to leave your legacy and be part of a highly successful and growth company!

Responsibilities:
— Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
— Create and maintain optimal data pipeline architecture;
— Assemble large, complex data sets that meet functional / non-functional business requirements;
— Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc;
— Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs;
— Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.

Requirements:
— 3+ years of experience in a Data Engineer role;
— Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases;
— Experience with AWS cloud services: EC2, EMR, RDS, Redshift;
— Experience with big data tools: Hadoop, Spark, Kafka, etc;
— Experience with relational SQL and NoSQL databases, including Postgres and Cassandra;
— Experience with object-oriented/object function scripting languages: PHP, Python, Java, C++, Scala, etc;
— Experience building and optimizing ‘big data’ data pipelines, architectures and data sets;
— Strong analytic skills related to working with unstructured datasets.

Will be a plus:
— Build processes supporting data transformation, data structures, metadata, dependency and workload management;
— Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores;
— Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc;
— Experience with stream-processing systems: Storm, Spark-Streaming, etc.

We offer:
— Flexible hours, ability to work from home if necessary;
— Working directly with the customer;
— Cozy office in the city center or remote work;
— Excellent compensation package.