Senior/Lead AQA (Python, ML Testing)
Requirements:
- Bachelor’s Degree in Computer Science or related field; equivalent experience
- 5+ years in QA, Evaluation, or ML testing roles
- Familiar with LLM evaluation techniques (BLEU, BERTScore, GPT-based eval, human annotation)
- Experience with tools like LangSmith, TruLens, PromptLayer, or similar
- Strong analytical skills and attention to detail
- Comfortable working in Python, Jupyter, and cloud-native environments
Nice to Have:
- Prior experience with AI alignment, red-teaming, or RLHF evaluations
- Knowledge of prompt engineering, NLP, or human feedback systems
- Familiarity with crowdsourcing platforms (Scale, Surge, Mechanical Turk)
Published 24 June
35 views
·
9 applications
89% read
·
56% responded
Last responded 2 weeks ago
📊
$3000-4500
Average salary range of similar jobs in
analytics →
Similar jobs
Ukraine
Ukraine
Ukraine