Senior/Lead Automated QA Engineer (Python, ML Testing)

About the Role:
Join our AI team to lead automated quality assurance for ML and large language models (LLMs). You'll develop and run tests, evaluate model performance using BLEU, BERTScore, GPT-based metrics, and collaborate closely with ML engineers.

Requirements:

• 5+ years in QA, ML evaluation, or ML testing roles
• Strong Python skills and experience with Jupyter, cloud tools
• Familiarity with LLM evaluation techniques (BLEU, BERTScore, GPT eval)
• Experience with LangSmith, TruLens, PromptLayer or similar — a plus
• Good analytical skills and attention to detail
• Experience with AI alignment, red-teaming, RLHF is a bonus
• Located in Europe
• Available for part-time, flexible schedule (~20 hrs/week)

What We Offer:

• Cutting-edge AI project with growth potential
• Flexible remote work and schedule
• Competitive hourly rate (negotiable)
• Support for training in ML QA and LLM evaluation
• Friendly, professional team environment

Interested? Send your CV and brief cover.