Data Engineer (4 months project) EU based

Description of the assignment and tasks 

  • Designing and building data pipelines consuming from our Enterprise Data Platform and providing data for insights, profiling, and advanced analytics.

What are the tech stack and required skills ?

  • Highly skilled data engineer with basic understanding of data science, machine learning and Al needs from the data perspective.
  • Strong computer science background and coding skills.
  • Java, Python & SQL must have.
  • Event streaming: Confluent Kafka, Kafka streams, KSQL.
  • Logging & Monitoring: Elastic, Kibana, Grafana, Logstash, FluentD.
  • Cloud: Azure, Databricks (must have), GCP.
  • Containerization & Orchestration: Docker and Kubernetes.
  • Version control: Azure DevOps, GIT.
  • Database technologies: Mostly MongoDB Atlas (and some PostgreSQL)