Data Engineer with German
About the Project
We are looking for an experienced Data Engineer (Azure Databricks / PySpark) to join a long-term project for an Austrian client operating in the logistics industry.
The project focuses on developing and enhancing a modern cloud-based data platform, enabling seamless data integration, improving data quality, and supporting data-driven business decisions.
You will work within an Azure-based Lakehouse environment, building reliable data pipelines, integrating multiple data sources, and supporting analytical solutions powered by Databricks and Power BI.
This is an excellent opportunity to contribute to a large-scale data ecosystem, work with modern cloud technologies, and participate in a stable, long-term international project.
Responsibilities
- Design, develop, and maintain data integrations and pipelines using Azure Databricks, PySpark, and Python.
- Implement data integrations according to predefined interface specifications and architectural guidelines.
- Perform data profiling, implement data quality rules, and ensure data consistency and reliability.
- Develop, activate, monitor, and optimize data flows from source systems into data products.
- Support the development and integration of Power BI semantic models, datasets, reports, and dashboards.
- Collaborate with data architects, analysts, and business stakeholders to deliver scalable data solutions.
- Contribute to the development and continuous improvement of the Lakehouse architecture.
- Optimize data processing performance, reliability, and maintainability.
- Participate in Agile development processes, including planning, implementation, testing, and deployment.
- Support CI/CD and infrastructure automation practices within the Azure ecosystem.
Requirements
- Proven commercial experience in Data Engineering.
- Hands-on experience with Azure Databricks and PySpark.
- Strong programming skills in Python and SQL.
- Experience designing and implementing ETL/ELT pipelines and data integrations.
- Good understanding of modern data platform architectures, particularly Lakehouse.
- Experience with data profiling, data validation, and data quality management.
- Familiarity with Power BI, including data modeling, semantic models, and/or DAX.
- Experience working with cloud-based data platforms, preferably Microsoft Azure.
- Understanding of Git-based development workflows and Agile methodologies.
- Good communication skills and the ability to work in an international team.
- English and/or German language proficiency (B1–B2 or higher, depending on project requirements).
Nice to Have
- Experience with Azure Synapse Analytics.
- Knowledge of the DQX Framework or similar data quality frameworks.
- Experience with Terraform and Infrastructure as Code (IaC).
- Familiarity with Azure DevOps, GitHub, and CI/CD pipelines.
- Understanding of Data Mesh principles and API-based integrations.
- Experience optimizing Power BI data models, reports, and DAX queries.
- Previous experience in logistics, transportation, or supply chain projects.
What We Offer
- Long-term cooperation on an international project with expected annual extensions.
- Fully remote working format.
- Opportunity to work with modern Azure Data Engineering technologies.
- Collaboration with an international team and an Austrian client.
- Involvement in developing and improving a modern enterprise data platform.
- Full-time engagement with a flexible start date.