Software Engineer / AI Data Platform Engineer (Python, Databricks, PySpark)

We are looking for an experienced Software Engineer / AI & Data Platform Engineer (m/f/x) to join an international project focused on developing modern software applications, AI solutions and scalable data platforms for cutting-edge battery research.

This is not a pure Data Engineering role. We are looking for a strong Software Engineer with solid Data Engineering experience, excellent Python skills and a genuine passion for AI, cloud-native development and modern software engineering.

Responsibilities

- Develop modern software applications in Python.

- Build and maintain scalable batch and streaming data pipelines using Databricks, PySpark and SQL.

- Work with the Azure Data Stack, including Azure Data Factory, ADLS Gen2 and Event Hubs.

- Develop AI-powered solutions using LLMs, RAG, AI Agents and MCP.

- Contribute to reliable, secure and observable cloud-native applications and data platforms.

- Apply modern software engineering and DevOps practices.

- Work closely with an international team.

Requirements

- Several years of experience as a Software Engineer.

- Strong experience developing production-ready applications in Python.

- Hands-on experience with Databricks, PySpark and SQL.

- Experience building batch and streaming data pipelines using the Medallion Architecture (Bronze / Silver / Gold).

- Experience with Azure Data Factory, ADLS Gen2 and Event Hubs.

- Experience with AWS-based data platforms is also welcome.

- Practical experience developing AI-powered solutions using LLMs, RAG, AI Agents or MCP.

- Good understanding of classical Machine Learning concepts.

- Experience building reliable, secure and observable cloud-native applications and data platforms.

- Experience working with modern software engineering and DevOps practices.

- Proactive, self-driven mindset with excellent problem-solving skills and the ability to work independently in an international environment.

Nice to Have

- FastAPI

- Uvicorn

- Databricks Apps

- Databricks Asset Bundles

- MQTT

- Azure Event Hubs or other event-driven architectures

- Experience in scientific, industrial or manufacturing environments, ideally within R&D.

Tech Stack

• Python
• Databricks
• PySpark
• SQL
• Azure Data Factory
• Azure Data Lake Storage Gen2 (ADLS Gen2)
• Azure Event Hubs
• Azure
• AWS
• LLM
• RAG
• AI Agents
• MCP
• Machine Learning
• FastAPI
• Uvicorn
• GitLab CI/CD

• MQTT

   

Project Details

- Start: ASAP

- Duration: Initial 2 months (extension very likely)

- Location: 100% remote after an initial 1-week onsite onboarding in the Greater Frankfurt area

- Workload: Full-time

- Language: English (German preferred)

Important

- Ability to work onsite in the Greater Frankfurt area during the initial one-week onboarding is required.

- Candidates with 5+ years of professional experience are preferred.