Senior Data Engineer

Our client is a global jewelry manufacturer that is transforming the retail experience with cutting-edge technology. The mission is to provide an exceptional shopping experience to our customers by leveraging data-driven insights and innovative solutions. We are looking for a talented Data Engineer to join our dynamic team and help us shape the future of retail, where you will play a critical role in developing and maintaining robust data pipelines in both Azure Synapse and Databricks.

Joining our team, you will contribute to building a solid foundation for the data infrastructure, supporting our marketing analytics organization's goal of becoming more data-driven and customer-centric. You will collaborate closely with cross-functional teams, helping to drive impactful data product deliveries and optimizing our analytical framework for scalable insights globally.

Responsibilities

• Develop and maintain data products and pipelines in Databricks, Azure Data Factory and Azure
  Synapse Analytics
• Communicate with stakeholders and users of our data products by understanding their problems and supporting them in their needs
• Optimize data pipelines for performance and scalability, automating repetitive tasks to improve
  efficiency and reduce the time from data ingestion to actionable insights
• Implement and maintain data quality processes, including data validation, cleansing, and error
  handling, to ensure high data integrity across all systems
• Improve existing data integration processes to provide better reliability and robustness
• Partner with product managers, analysts, and business stakeholders to understand data
  requirements, provide data engineering support, and ensure data is accessible and usable for
  analysis and reporting
• Stay up-to-date with the latest trends and best practices in data engineering, bringing innovative
  ideas and solutions to improve our data infrastructure and capabilities

Skills Required

• 4+ years of experience as a Data Engineer, ETL Developer, or similar role
• Experience with Azure Synapse Analytics
• Strong knowledge of SQL and Spark SQ
• Understanding of dimensional data modelling concepts
• Understanding of streaming data ingestion processes
• Ability to develop & manage Apache Spark data processing applications using PySpark on Databricks
• Experience with version control (e.g., Git), DevOps, and CI/CD
• Experience with Python
• Experience with Microsoft data platform, Microsoft Azure stack, and Databricks
• Experience in Marketing, Retail, and Ecom will be a plus.

Soft Skills:
• Strong problem-solving skills and the ability to work independently as well as part of a team.
• Excellent communication skills, with the ability to translate technical concepts into business-friendly language.
• Detail-oriented with a commitment to delivering high-quality, reliable data solutions.