Senior Data Engineer (offline)

As a Senior Data Engineer you will design, implement, and maintain big data pipelines, responsible for aggregating tens of billions of daily transactions. You will be part of a growing team to develop and mature our capability in video ad verification, analytics and anti-ad fraud software products.

What you will do:

Design and implementation of ETL pipelines (processing on spark, orchestration in Airflow), collaboration with DS team (moving models to production, wiring of all the components together,performance optimisations)

Requirements:
- 4+ years of recent hands-on in object-oriented language (Java, Scala, Python)
- 4+ years of experience designing and building data pipelines and data-intensive applications
- Experience using Big Data frameworks (e.g., Hadoop, Spark, MapReduce) and MPP databases (e.g., RedShift, Snowflake) for complex data assembly and transformation
- Strong knowledge of collections, multi-threading, JVM memory model, etc.
In-depth understanding of algorithms, performance, scalability, and reliability in a Big Data setting
- Good knowledge of SQL
- Experience in full software development, Agile, and continuous integration / deployment
- Excellent interpersonal and communication skills

Nice to have:
- In-depth understanding of algorithms, scalability and various tradeoffs in a Big Data setting
- Knowledge of database technology, SQL, schema design and query optimization techniques
- Experience of designing for performance, scalability, and reliability
- Digital advertising or web technology experience, especially video advertising

We offer:
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits program
- Social package — medical insurance and etc
- Corporate social events
- Professional development opportunities
- Opportunity for long business trips to the US and possibility for relocation

About Grid Dynamics

Grid Dynamics is a world-class expert company with highly scalable distributed solutions and CI/CD. We help one of the biggest financial companies on the East Coast to solve the challenging problems that affect the entire development organizations, like building enterprise web services with millisecond response time, or improving development processes by introducing Agile, test automation, TDD, and CI/CD processes.

Company website:
https://www.griddynamics.com