Mid-Senior Data Engineer

We are looking for a Senior Data Engineer to join our team on a enterprise-level client project! You will work on an analytics platform tailored for professional services organizations seeking to enhance their operational efficiency and strategic decision-making. The solution integrates seamlessly with various business systems to collect and consolidate data, providing a unified view of key performance metrics.

Responsibilities:

• Implement and optimize streaming and ETL data pipelines, including self-service solutions using Spark and REST services;
• Manage releases and infrastructure deployments for data pipelines and backend systems;
• Conduct code reviews, developed unit tests, and fixed bugs to ensure code quality and reliability;
• Enhance system performance through Spark optimization and backend improvements;
• Participate in planning and estimation, developed new features, and integrated data through REST services.

Requirements:
 

• 3+ years of experience as Data Engineer or in a similar role;
• Proficiency in Python, and PySpark;
• Proficiency in ETL pipelines, its design implementation and maintenance;
• Hands-on experience with DataBricks and MPP databases;
• Experiences on building data pipelines on Airflow;
• Great numerical and analytical skills.

Nice to have:

• Experience with cloud providers (Azure);
• Experience with event-streaming platforms;
• Experience with Clickhouse;
• FastAPI development experience. 

Allowed locations:

Poland, Croatia, Portugal.