Lead Data Engineer (AWS)

We are looking for an experienced Lead Data Engineer to manage a team responsible for building and maintaining data pipelines using AWS and Pentaho Data Integration (PDI). The role involves designing, implementing, and optimizing ETL processes in a distributed cloud environment.

Key responsibilities:

• Lead a team of data engineers: task planning, deadline tracking, code review
• Design and evolve data flow architecture within the AWS ecosystem (S3, Glue, Redshift, Lambda, etc.)
• Develop and support ETL processes using Pentaho Data Integration
• Set up CI/CD pipelines for data workflows
• Optimize performance, monitor and debug ETL processes
• Collaborate closely with analytics, data science, and DevOps teams
• Implement best practices for Data Governance and Data Quality

Requirements:

• 5+ years of experience in data engineering
• Strong hands-on knowledge of AWS services: S3, Glue, Redshift, Lambda, CloudWatch, IAM
• Proven experience with Pentaho Data Integration (Kettle): building complex transformations and jobs
• Proficiency in SQL (preferably Redshift or PostgreSQL)
• Experience with Git and CI/CD tools (e.g., Jenkins, GitLab CI)
• Understanding of DWH, Data Lake, ETL/ELT concepts
• Solid Python skills
• Team leadership and project management experience

Nice to have:

• Experience with other ETL tools (e.g., Apache NiFi, Talend, Airflow)
• Experience migrating on-premises solutions to the cloud (especially AWS)