Senior/Lead AQA (Python, ML Testing)

Requirements:
- Bachelor’s Degree in Computer Science or related field; equivalent experience
- 5+ years in QA, Evaluation, or ML testing roles
- Familiar with LLM evaluation techniques (BLEU, BERTScore, GPT-based eval, human annotation) 
- Experience with tools like LangSmith, TruLens, PromptLayer, or similar
- Strong analytical skills and attention to detail
- Comfortable working in Python, Jupyter, and cloud-native environments

Nice to Have:
- Prior experience with AI alignment, red-teaming, or RLHF evaluations
- Knowledge of prompt engineering, NLP, or human feedback systems
- Familiarity with crowdsourcing platforms (Scale, Surge, Mechanical Turk)

Published 24 June
35 views
·
9 applications
89% read
·
56% responded
Last responded 2 weeks ago
To apply for this and other jobs on Djinni login or signup.