Data Engineer (Azure)

Project description:
The goal of the project is to onboard the commercial data into EDF and deliver the reporting platform through PowerBI on top of Golden Layer built by GD (Medallion architecture).

Client description:
It is a global food and beverage leader with a product portfolio including 22 brands that generate more than $1 billion each in annual retail sales.

We're looking for a Data Engineer to:
Design and implement scalable data pipelines using Azure Data Factory and Databricks (PySpark).
Develop the Gold layer (semantic layer) for accurate business reporting.
Utilize Azure DevOps for CI/CD and implement observability to ensure data integrity.

Required Technology Stack:
Cloud: Azure
Processing: Databricks, PySpark
Storage: ADLS, Delta Lake
Orchestration: Azure Data Factory (ADF)
DevOps: Azure DevOps
Reporting: Power BI
Concepts: Medallion Architecture, Observability