Big Data Engineer (Python) Offline

Our client is a global technology company that offers data and solutions to establish a safer, more effective advertising ecosystem. Partners with advertisers and publishers to protect their investments, capture consumer attention, and drive business impact. Founded in 2009 and headquartered in New York with global operations in 13 countries. Company growth and innovation have been recognized in the Inc. 5000, Crain’s Fast 50, Forbes America’s Most Promising Companies, and I-COM’s Smart Data Marketing Technology Company.

Requirements:

* 2+ years of experience designing and building data-intensive applications;

* Experience with Python;

* Experience developing data pipelines in AWS Cloud;

* Expertise in using Big Data frameworks (e.g., Hadoop, Spark) and MPP databases (e.g., RedShift, Vertica, Snowflake) for complex data assembly and transformation;

* Understanding of algorithms and data structures;

* Understanding of full software development life cycle, agile development, and continuous integration;

* English Intermediate+.

Tasks: Design and implementation of ETL pipelines (processing on Spark, orchestration in Airflow), collaboration with DS team (moving models to production, wiring of all the components together, performance optimizations).

Current team size: Scrum team is mostly located in NYC. We also have 6 data engineers in separate project teams inside Grid Dynamics and we are sharing experience and best practices.