IT Craft

IT Craft is looking for an experienced AI Backend Engineer to join the development of an AI-powered product focused on delivering personalized user experiences. The engineer will take end-to-end ownership of the AI backend, including architecture, implementation, production setup, monitoring, and continuous improvement.

Key Responsibilities:

• Design and evolve production AI architecture covering agent orchestration, routing, tool calling, RAG, memory and structured outputs;
• Select and integrate LLM, speech (STT/TTS) and vision models from different providers, balancing quality, latency, cost and EU data residency;
• Define the data architecture for conversational, nutrition and wearable data to support personalization and a digital twin;
• Translate product requirements into technical solutions and document key architecture decisions together with product owners;
• Develop and extend the Python-based AI backend, including voice pipelines with real-time latency requirements;
• Set up cloud infrastructure, containers, vector stores and model gateways using infrastructure-as-code in collaboration with the DevOps/CI-CD engineer;
• Build integrations for wearable APIs, food databases and image-recognition services;
• Implement user memory and personalization, including adaptation to communication style;
• Set up LLM observability for tracing, token and cost tracking, latency, error rates and alerting;
• Build automated evaluation and regression processes for prompts and agents, including offline evaluations, LLM-as-a-judge and human review;
• Implement guardrails and safety mechanisms for health-related conversations, including escalation logic and hallucination controls;
• Monitor model and prompt performance in production and continuously improve models, prompts and agent behavior;
• Ensure GDPR-compliant handling of sensitive health data (special category data), including EU hosting, encryption, access control, data minimization and deletion;
• Keep the architecture prepared for EU AI Act requirements and the wellness/medical-device boundary (MDR);
• Build the data foundation for personalization, experimentation and future predictive models.

Required Skills:

• 6+ years of experience in software or ML engineering, with at least 2 years of hands-on experience building and running LLM-based systems in production;
• Strong proficiency in Python, with solid SQL and data modeling skills;
• Hands-on experience designing and implementing agentic systems using orchestration frameworks such as LangGraph or similar, including tool calling, structured outputs, RAG, and long-term memory;
• Experience working with multiple LLM providers and model gateways, as well as prompt engineering and context engineering at scale;
• Practical LLMOps experience covering evaluation frameworks, observability, and optimization of cost and latency;
• Experience with Docker, Kubernetes or managed container services, infrastructure-as-code, and CI/CD;
• Good understanding of security and data protection requirements when working with sensitive personal data;
• Ability to independently own architecture decisions and collaborate effectively with product and engineering teams;
• Strong written and spoken English (Upper-Intermediate+ / Advanced).

Nice to have:

• Experience with real-time voice AI, including streaming STT/TTS, speech-to-speech models, and latency optimization;
• Experience working with health, fitness, or wearable data, including time-series data and APIs such as HealthKit / Health Connect;
• Experience with personalization, recommendation systems, A/B testing, and statistics;
• Experience with vision models for food recognition;
• Experience in regulated environments such as GDPR Art. 9, EU AI Act, MDR or ISO 27001.

IT Craft offers:

• Competitive compensation according to the qualifications.
• Flexible working hours, remote work;
• Opportunity for career growth;
• Reward for sport activities;
• In-house English training;
• A friendly team of open-minded people.

Please send your CV!

By submitting your application, you consent to the processing of your personal data in accordance with IT Craft's Privacy Policy, available at https://itechcraft.com/datenschutz/.

IT Craft is looking for an experienced AI Developer with hands-on expertise in LLM evaluation and automated testing to join our team. In this role, you will take ownership of designing and implementing an evaluation framework for a deployed AI assistant running on AWS Bedrock, with infrastructure support from the internal DevOps team.

Key Responsibilities:

• Design and implement automated end-to-end and regression testing infrastructure for an LLM-based assistant;
• Build an evaluation harness that runs a structured set of prompt scenarios against the deployed service;
• Implement automated checks for response correctness, tool usage, and guardrail behavior;
• Generate clear pass/fail results based on agreed evaluation baselines;
• Collaborate with the internal DevOps team to integrate evaluation runs into CI/CD processes and identify quality and behavior regressions before and after deployments;
• Analyze evaluation results and continuously improve test coverage and reliability;

• Plan and organize the implementation independently, define follow-up tasks, and coordinate with internal specialists through regular synchronization meetings.

   

Required Skills:

• Hands-on experience with LLM evaluation tools such as Promptfoo, Langfuse, Arize, or comparable solutions;
• Practical experience designing or implementing automated evaluation and regression testing for LLM-based applications;
• Understanding of approaches used to evaluate non-deterministic LLM responses, tool calls, and guardrail behavior;
• Solid experience with AWS and CI/CD;
• Ability to design a solution from scratch and deliver it independently;
• Familiarity with Kotlin and Spring would be a plus;
• Strong written and spoken English (Upper-Intermediate+ / Advanced).
   

IT Craft offers:

• Competitive compensation according to the qualifications;
• Flexible working hours, remote work;
• Opportunity for career growth;
• Compensation for technical courses, educational resources, and sport;
• In-house English training;

• A friendly team of open-minded people.

   

Please send your CV.
By submitting your application, you consent to the processing of your personal data in accordance with IT Craft's Privacy Policy, available at https://itechcraft.com/datenschutz/