Data Engineer (Azure Databricks)

We’re looking for a Data Engineer with strong hands-on experience in PySpark and Databricks to join an Insurance domain project. You’ll work on building scalable data processing pipelines and end-to-end data & analytics solutions using Azure, PySpark, Databricks, and Palantir Foundry.

Responsibilities:

• Design and develop data objects and data processing jobs in Azure Data Platform.
• Design and implement E2E analytics solutions using Palantir Foundry Platform, including: various types of data sources and data connections, scalable data transformation pipelines in PySpark.
• Optimize and automate data processing jobs and transformation pipelines through reviewing of logs and query plan, partitioning and code simplification.
• Ensure data quality, security (access concept) and governance across the whole flow of data & analytics solution.
• Collaborate with cross-functional teams and stakeholders to understand and translate. business requirements into technical specifications and actionable plans, ensuring successful delivery.

• Troubleshoot and resolve functional and technical data issues for stakeholders, actively contributing to shared goals and supporting peers in solving technical and analytical challenges.

   

Requirements:

• 4+ years of professional experience in data engineering roles.
• Strong hands-on experience with data transformation jobs/pipelines and complex data & analytics solution.
• Expertise in Python/PySpark and experience with distributed computing frameworks like Spark.
• Proficiency/advanced in SQL.
• Proficiency with Git.
• Experience with cloud platforms (Azure), specifically Azure Databricks, and Palantir Foundry is a significant advantage.
• Proven ability to work across business and technical teams, supporting requirement definition and solution design.
• Agile mindset and practical experience with Scrum or other agile frameworks, Azure DevOps is a plus.
• Strong team player with excellent communication skills, proactive mindset, and a collaborative approach.
• English at B2 or higher.

• Bonus: knowledge of REST API or Power BI.

   

Our Benefits:

• Professional growth: Individual development plan, mentorship, reimbursement for professional certifications and English lessons, access to professional courses in Corporate Learning Management System.
• Community: Tech community and knowledge-sharing events, English speaking club, corporate library and book club, volunteering and charity initiatives.
• Wellbeing: Medical insurance, regular medical check-ups, sport reimbursement, paid vacation and sick leave, mental health support and events.
• Work environment: Fully-equipped offices, top-notch equipment, flexible work format, activities both in-office and online, Y-bucks and access to the Yalantis store.