Urgent Hiring. Senior Data Quality. Occasional trips to Germany

🚨 We are looking for 2 Senior Data Quality Testers to support a data integration project involving renewable energy assets and a Databricks-based analytics platform.
 

📍 Location: Remote from Europe
✈️ Travel: Occasional trips to Germany required
🕒 Start: ASAP
📆 Duration: 6 months (extension possible)
🌍 Language: English
 

🔎 Project Overview

The client is integrating a second-layer SCADA system for renewable assets into a Databricks environment.
The role focuses on ensuring data integrity, quality, and reliability by implementing automated data and integration tests across the full data pipeline.
 

🛠 Responsibilities

• Design, develop, and execute automated data and integration tests in Databricks using Python, PySpark, and SQL
• Perform end-to-end pipeline testing from SCADA → AMQP → Databricks
• Validate data transformations and compliance with defined business rules
• Capture, store, and prepare test results using Azure services (Data Lake, Blob Storage, SQL)
• Integrate automated tests into CI/CD pipelines via Azure DevOps
• Collaborate closely with Data Engineers, SCADA specialists, DevOps, and Cloud teams

• Ensure full documentation of test cases, procedures, and results for traceability and auditability

   

✅ Must-have Skills

• Strong experience with Python
• Hands-on expertise in PySpark and SQL
• Solid experience with Databricks
• Experience using Azure services for data storage and test result preparation
• Practical knowledge of Azure DevOps (CI/CD, test integration)
   

➕ Nice to have

• Experience with SCADA systems or industrial/energy data
   

📩 Immediate availability is a strong plus