Databricks Migration Tech Lead

Domain: Banking
Location: Remote / EU-based preferred
Start Date: January 2026

We are looking for a Databricks Migration Tech Lead to drive a large-scale migration of ETL pipelines from Cloudera to Databricks for a leading banking client. The ideal candidate combines strong technical expertise with excellent leadership and communication skills to coordinate a hybrid team of 6–8 data engineers and ensure seamless delivery.

Key Responsibilities

• Lead and coordinate the migration of complex ETL pipelines from Cloudera to Databricks.
• Analyze existing data flows, dependencies, and performance bottlenecks.
• Design and implement the target architecture on Databricks (Delta Lake, SQL, Unity Catalog, MLflow).
• Provide technical guidance and hands-on support to the engineering team.
• Collaborate with business and technical stakeholders to align priorities and resolve blockers.
• Ensure quality, scalability, and timely delivery of all migration milestones.

Technical Requirements

• Strong practical experience with Databricks (Delta Lake, Databricks SQL, Unity Catalog, MLflow, Workspace management).
• Solid understanding of ETL/ELT processes, data pipeline design, and orchestration.
• Previous experience with Cloudera, Spark, and data platform migration from Hadoop-based to cloud-native environments.
• Good knowledge of Azure Data services (Data Factory, Synapse, DevOps CI/CD).
• Proficiency in Python and PySpark.
• Experience with Git, CI/CD, and automated deployment pipelines.
• Nice to have: prior experience as a Tech Lead or Data Migration Architect.

Soft Skills

• Strong communication and stakeholder management abilities.
• Capable of bridging business needs and technical execution.
• Structured, proactive, and delivery-oriented mindset.
• Fluent English