Data Engineer

Implementation of a data ingestion, transformation, and storage pipeline for Pharmacy Analytics & Rebate Management aimed at eliminating manual data processing. The project involves building an ETL pipeline to automate data processing from SharePoint ingestion to analytics model, with Power BI dashboards and GPG-encrypted file handling. The candidate will work within the Microsoft Azure ecosystem, focusing on data governance (Microsoft Purview), security (Microsoft Defender), and HIPAA compliance.

Requirements:

• Microsoft Azure ecosystem experience;
• Experience with Microsoft Fabric (Lakehouses, data pipelines, OneLake storage);
• Knowledge of ETL/ELT pipeline design and implementation;
• Python and SQL proficiency;
• Experience with data ingestion from SharePoint and encrypted file handling (GPG);
• Familiarity with Microsoft Purview for data governance;
• Understanding of HIPAA compliance and data security requirements;
• Experience with CI/CD (Azure DevOps, Terraform/Bicep);
• Power BI knowledge is a plus.
   

Responsibilities:

• Design, develop, and maintain ETL pipelines;
• Configure connectors and data ingestion flows from SharePoint (pipe-delimited encrypted files) and vendor Excel/CSV sources;
• Implement data loading processes across Bronze, Silver, and Gold layers;
• Perform data transformations, data quality setup, error handling, and historization (SCD Type 2);
• Set up and maintain CI/CD pipelines (Terraform/Bicep for Fabric resources, Git integration, Azure DevOps);
• Implement data governance and security measures (row/column-level security, Purview integration);
• Develop a semantic model (DirectLake mode), configure reports, and migration/development;
• Create technical documentation and Run Books;
• Participate in knowledge transfer.
   

What we offer:

• Annual paid leave 18 working days
• Annual paid sick leave
• Opportunity to participate in various events (educational programs, seminars, training sessions)
• English courses
• Healthcare program
• IT Cluster membership
• Competitive compensation