Senior Data Engineer with Azure Offline

Description

Our customer is a manufacturing company who has numerous warehouses around the globe. The goal of the project is to provide customer with extensive analytical tools. It requires us to build custom APIs that will integrate with customer’s SAP, query data from there, apply specific transformations, and build reports in PowerBI based on that processsed data to help customer to:

• Understand current production needs
• Be able to collect as much data as needed to understand new production requests
• Compare production needs with materials availability
• Identify existing bottle-necks from processes perspective
• Help to build forecasts

Requirements

Must-Haves:

• 5+ years of experience w/ Python-based ETL processing and other data engineering tasks
• Practical skills in developing from scratch APIs for data extraction from 3rd party systems
• Proficiency w/ Azure Cloud and Azure Data Factory (or similar tools for orchestrating and automating data pipelines execution)
• Solid expertise in SQL and relational DBs
• Experience in database design and optimization
• Experience with NoSQL DBs (MongoDB, Cosmos, etc.) for handling unstructured and semi-structured data
• Contributing to release management following the best CI/CD practices

• Nice to have: Experience w/ SAP S/4HANA is a major benefit

   

Job responsibilities

• Responsible for design, optimization and maintenance of data integration pipelines
• Build API-based integrations for data extraction
• Implement data transformation conditions according to business requirements
• Data ingestion
• Contribute to requirements analysis, design, decomposition
• Proactively contribute to code quality improvement through design optimization, unit testing, etc.