Data Engineer (offline)

You will design, configure, develop, deploy and support data and analytic application solutions being developed using wide range of Azure Cloud technology services.

About our client
Our client is a global mining company with a world-class portfolio of products that are used by a billion of consumers every day. Our client relies on data and cutting-edge data science to enhance their operations. They also use advanced machine learning and artificial intelligence to optimize their processes.

Mission
Develop highly configurable data solution for end-to-end batch, near real time or streaming data, covering the full software development lifecycle
Effectively test and adopt testing frameworks to embed and codify tests
Ensure code quality and performs code reviews of fellow developers
Take technical ownership for the implementation of the data engineering solution at an allocated product
Clearly communicate and explain concepts to senior stakeholders and key teams during sprint reviews and other programme meetings
Have a clear understanding of agile best practices and proactively collaborate and support the team if needed during the whole sprint cycle
Document technical implementation details and artefacts created as part of the process
Collaborate with operations team to ensure operational readiness and support detect resolution
Requirements
Bachelor’s Degree in Computer Science, Software Engineering or Engineering
Experience in developing quality Python / PySpark based pipelines, and implement software development best practices to ensure high-quality standards are met
Skilled in serving data for application and analytics through a variety of technologies such as Delta Lake, SQL DB, Cosmos DB, and Azure Time Series Insights
Experience with building batch or stream pipelines leverage IoT Stack, Event Hub, Databricks, Azure Data Factory and other Azure Cloud stream technologies
Hands-on experience in performing performance engineering to scale ETL/ELT processes and improve data consumption response times
Experience with automation tests executable via pipeline, and version controlled with test frameworks integration
Azure Cloud certifications and industry experience will be a plus
Nice to have
Skills in developing metadata-driven frameworks for reusable data engineering solution
DevOps knowledge to build release artifacts, and operate, monitor, troubleshoot via CI / CD process implementation
Experience with high level system design and data warehousing
Experience of large-volume time-series data systems like OSISoft PI
Experience with process control standards ISA 88 and ISA 95
Experience with mining industry value chain processes

About Nortal

Nortal is a multinational strategic change and technology company carrying out high-impact, mission-critical projects for governments and leading businesses, some of which top the Fortune 500 list, in Europe, North America, and the Middle East.

Company website:
https://nortal.com.ua/

DOU company page:
https://jobs.dou.ua/companies/nortal/