Data Engineer

Kyivstar Big Data team is looking for talented Data Engineer- specialist in the field of developing software solutions, with practical skills in working with Cloud stack (AWS preferred), Open Source tools of the Hadoop ecosystem, understanding of ETL processes and specialties of implementing data pipelines, which include machine learning.

Necessary skills:

• 2+ years of experience in software development
• Strong knowledge of Python
• Strong knowledge of SQL
• Strong knowledge of CI/CD principles
• Experience in process design and developing ETL processes for ML pipelines
• Experience with programming in Python or Scala for Apache Spark
• Experience in test-driven development and integration testing

 Would be a plus:

• Experience with Spark ML and Python ML libraries
• Experience with Apache NiFi, Airflow
• Experience with Cloud Technologies
• Experience with Docker and Kubernetes
• Familiarity with Hortonworks or Cloudera distributions
• Experience with performance testing and tuning

Responsibilities

• Develop ETL processes for ML pipelines
• Creation of automated tooling and models deployment
• Automate processes of model quality monitoring
• Develop automatic model refresh procedures to avoid “staleness”
• Optimize pipelines and review Python/Spark code

We offer:

Working with huge amounts of data at the largest operator in Ukraine

Hands on experience with Big Data technologies and tools

Great diversity of tasks and projects to utilize your knowledge and skills; flexibility in tools and approaches

Opportunity to grow within the team of talented data engineers