Freelance Senior Data Engineer

We are seeking a skilled Freelance Senior Data Engineer (part time) to take a central role in a new external API development project for a leading mental health digital product aimed at the UK and US markets.

Requirements:

• 5+ years of experience in Data Engineering.
• Strong proficiency in  Python, PySpark and SQL
• Hands-on experience with Microsoft Power BI
• Ability to thrive in a dynamic environment with a strong sense of ownership and responsibility
• Solid understanding of Azure services
• Hands-on experience with Azure Synapse Analytics and Azure Data Factory
• Experience with data orchestration tools like Airflow or Dagster
• Familiarity with Data Quality and Observability best practices.
• Analytical mindset and problem-solving skills for tackling complex technical challenges.
• Bachelor's in Mathematics, Computer Science or other relevant quantitative fields
  
   

Nice-to-Have Skills:

• Experience with DevOps practices, CI/CD, and Infrastructure as Code (Terraform is preferable)
• Solid understanding of Kubernetes and containerisation
  
  Responsibilities:
• Design and develop a scalable data platform to efficiently process and analyze large volumes of data using Azure cloud provider data processing services
• Enhance existing LLM-related Python services
• Work closely with DevOps team and handle some infrastructure related tasks if necessary
• Create Power BI dashboards for internal employees and customers