Test Automation Engineer (Python)

We are looking for a Test Automation Engineer to join a long-term data-focused project. The role is centered on validating complex data pipelines, ensuring data quality, and automating testing for cloud-based analytics solutions built on Databricks and Azure.

Details

Start Date: ASAP

Duration: 12 months+

Location: Fully remote

Candidate Location: European Union

Language: English

Key Responsibilities

Develop and maintain automated test scripts in Databricks using Python, PySpark, and SQL

Validate JSON messages (AMQP) for structure, completeness, and accuracy

Implement data quality checks including schema validation, range checks, and anomaly detection

Validate end-to-end data flow from SCADA systems through AMQP into Databricks

Verify data transformation logic and ensure compliance with business rules

Store and document test results using Azure services (Data Lake, Blob Storage, Azure SQL)

Create dashboards and reports using Grafana or Databricks notebooks

Integrate automated tests into CI/CD pipelines using Azure DevOps

Collaborate closely with Data Engineers, SCADA specialists, and Cloud teams

Document test cases, testing procedures, and results

Requirements (Must-Have)

Strong hands-on experience with Databricks

Advanced skills in Python, PySpark

Proficiency in handling and validating JSON messages

Solid knowledge of Azure services (Data Lake, Blob Storage, Functions)

Proven experience with automated testing in cloud environments

Familiarity with CI/CD pipelines, preferably Azure DevOps

Nice to Have

Understanding of SCADA systems and renewable energy data flows

Experience working with AMQP protocols

Knowledge of telemetry / SCADA industry standards (e.g., OPC)

Experience with SQL