Middle Data Engineer for Ciklum Digital (offline)

😎Client is a Tech company – Technology is the driver, e-commerce is the outcome. It was established in 2010 to provide a seamless e-commerce experience to customers and SMEs. In ten years, the project became the largest e-commerce company in Turkey, as well as one of the leading global platforms. Our Client is the 1st Turkish company to achieve the decacorn status and the most valuable private internet company in the EMEA region.

🤖Technology Stack: Kafka, Spark, Flink, Airflow, Sql, Hive, Git, SBT, Kubernetes, Docker, Spring Boot, Alibaba Cloud, Amazon Web Services, Jupyter, Zeppelin, Cassandra, Akka

🤖Languages: Scala, Java, SQL

🤓Responsibilities
- Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading across multiple data storages
- Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed
- Interacts with engineering teams and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability
- Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions
- Building infrastructure to support real time or offline data pipelines for processing terabytes of data
- Design and scale data ingestion systems with high availability and reliability
- Creating and managing data jobs with various data platforms
- Data enrichment and manipulation on streaming data
- Developing and designing R&D Projects
- Provide architectural support by building PoC & Prototypes