Senior Data Engineer

About the role and product:
We are looking for an experienced Data Engineer to join the Data &AI team delivering enterprise-grade data platform capabilities. The role centres on building Python-based ETL pipelines across a Medallion architecture, developing and operationalising data quality rules using both Python and the Informatica platform (IDQ, EDC, Axon), and ensuring robust governance integration. 

Responsibilities:
- Design, build, and maintain Python-based ETL pipelines across Bronze, Silver, and Gold layers following the Medallion architecture pattern.
- Develop and operationalise data quality (DQ) rules in Python, covering validity, completeness, consistency, uniqueness, accuracy, and timeliness dimensions.
- Build and maintain DQ rules using Informatica IDQ 10.5 on-premises, including mapplet design, profile configuration, and scorecard setup.
- Support data cataloguing and lineage activities using Informatica EDC, including schema scanning, data classification, and lineage mapping.
- Configure and maintain Informatica Axon for governance workflows, business glossary management, policy enforcement, and surfacing DQ scores to stakeholders.
- Develop cross-system DQ checks including referential integrity, reconciliation, and entity deduplication as scheduled Python jobs.
- Integrate DQ outputs into Power BI dashboards, contributing to the DQ Index Aggregation layer that unifies IDQ scorecard and Python-based scores.
- Support the IDQ–Axon integration, including Axon Agent configuration and DQ metric propagation into Axon dashboards.
- Contribute to the Python DQ framework package, maintaining modular, testable, and well-documented code with comprehensive unit test coverage.
- Support Talend-based ingestion processes at the Bronze layer, ensuring schema conformance and completeness checks.
- Participate in root-cause analysis of DQ failures using the programme’s three-tier classification taxonomy.

Requirements:
- Strong Python development skills, including experience with data processing libraries (pandas, PySpark) and testing frameworks (pytest).
- Hands-on experience with Informatica IDQ 10.5 on-premises: Developer Tool, mapplet design, profiles, scorecards, and expression-based DQ rules.
- Working knowledge of Informatica EDC for schema scanning, data lineage, and data classification.
- Experience with Informatica Axon for governance, business glossary management, HITL steward workflows, and DQ score surfacing.
- Solid understanding of the Medallion architecture (Bronze / Silver / Gold) and data lake design patterns.
- Working knowledge of SQL and relational databases for data validation and reconciliation.
- Experience building production-grade Python ETL pipelines with appropriate logging, error handling, and modular design.
- Experience with CI/CD practices for data pipelines and version control (Git).

Nice to have:
- Familiarity with Talend for data ingestion workflows.
- Exposure to AI/ML techniques for data quality: anomaly detection, entity resolution, DQ score aggregation.
- Experience generating or consuming Informatica IMX-format XML programmatically.
- Knowledge of Power BI for building or maintaining DQ score dashboards.
- Understanding of data governance frameworks, stewardship models, and regulatory reporting requirements.
- Experience with the Informatica IDQ–Axon integration bridge (Axon Agent setup and configuration).

The client offers:
- 24 working days of annual leave.

- 10 sick days.

- All official Ukrainian public holidays are days off.

- All necessary equipment for work is provided by the company.

- Medical insurance after the probationary period (3 months).

- Monthly budget to cover English classes, sports, and psychological support.

- All accounting and payroll administration are handled by the company; salary is paid net in UAH