Data Quality Automation Engineer for Azure Big Data Project (offline)

You will join a highly motivated team and will be working on a modern solution for our existing client. We are looking for technology experts who want to make an impact on new business by applying best practices and taking ownership.

About the Project:
● We are looking for a data quality automation engineer for a challenging E2E Big Data project and it is being developed in Azure PaaS technology.
● Project is about the delivery of data processing platform, Azure Data Lake gen2, Azure Databricks.

Responsibilities:
● Perform data warehouse, dimensional data mart and enterprise report validation and verification
● Develop and deploy data quality scripts for data consistency, uniqueness, completeness, timeliness, accuracy and validity.
● Communicate the data quality results and collaborating closely with other teams involved in the development process
● Analyze, troubleshoot, and document problems/observations, and working with the project teams to identify the root causes and resolutions
● Contribute to the CI/CD process establishment.

Requirements:
You can name examples of use in different contexts. Are guided by best-practices and specifications of such skills:
General:
● Ability to work collaboratively as part of Agile project delivery team
● Experience of working fully Agile and participating in Agile ceremonies
● Experience in data management, data integration and data quality verification
● Experience with Business Intelligence configuration management tools/processes
● Experience in data profiling
● Familiar with Data Warehouse design and implementation
● Obligatory excellent SQL knowledge
● Obligatory excellent Python knowledge
● Familiar with CI/CD principles and best practices in data processing
● Good Microsoft Azure Data Factory, Azure Databricks, Azure Data Lake gen2, Datawarehouse and Power-BI expertise
● Experience with common file formats (XML, JSON, CSV)
● Experience in creating automation framework and writing an automation test scripts is must.
● Experience on embedding test scripts in CI/CD pipeline is must.


Personal skills (soft skills):
● Curious mind and willingness to work with client in consultative manner to find areas to improve;
● Intermediate +++ English;
● Good analytical skills;
● Good team player, motivated to develop and solve complex tasks;
● Self-motivated, self-disciplined and result-oriented;
● Strong attention to details and accuracy.

What's in it for you?
● Close cooperation with client;
● Constant flow of new projects;
● Dynamic and challenging tasks;
● Ability to influence project technologies;
● Projects from scratch;
● Team of professionals: learn from colleagues and gain recognition of your skills;
● European management style;
● Continuous self-improvement.

Join Ciklum and “Cross the Borders” together with us!