Kyivstar Big Data team is looking for talented Data Engineer- specialist in the field of developing software solutions, with practical skills in working with Cloud stack (AWS preferred), Open Source tools of the Hadoop ecosystem, understanding of ETL processes and specialties of implementing data pipelines, which include machine learning.
Necessary skills:
- 2+ years of experience in software development
- Strong knowledge of Python
- Strong knowledge of SQL
- Strong knowledge of CI/CD principles
- Experience in process design and developing ETL processes for ML pipelines
- Experience with programming in Python or Scala for Apache Spark
- Experience in test-driven development and integration testing
Would be a plus:
- Experience with Spark ML and Python ML libraries
- Experience with Apache NiFi, Airflow
- Experience with Cloud Technologies
- Experience with Docker and Kubernetes
- Familiarity with Hortonworks or Cloudera distributions
- Experience with performance testing and tuning
Responsibilities
- Develop ETL processes for ML pipelines
- Creation of automated tooling and models deployment
- Automate processes of model quality monitoring
- Develop automatic model refresh procedures to avoid “staleness”
- Optimize pipelines and review Python/Spark code
We offer:
Working with huge amounts of data at the largest operator in Ukraine
Hands on experience with Big Data technologies and tools
Great diversity of tasks and projects to utilize your knowledge and skills; flexibility in tools and approaches
Opportunity to grow within the team of talented data engineers
![djinni analytics](/static/images/chart-preview.png)
Similar jobs
Ukraine
Senior ETL Developer at Luxoft
Ukraine
Data Analyst at Transparency International Ukraine
Countries of Europe or Ukraine
All jobs Kyivstar