QA Lead with AI/LLM Expertise

Company: Lynx Capital Partners - US-based fintech specializing in high-frequency trading systems
Location: Remote 
Type: Full-time

About the Role

We're building a dedicated AI division while maintaining our core trading platform. We need a QA Lead who can manage quality across BOTH traditional systems and AI/LLM products. This role requires deep understanding of testing AI systems.

What You'll Do

• Design and implement comprehensive test strategies for AI-powered tools and systems
• Create test frameworks to verify accuracy, reliability, and performance of LLM integrations
• Develop automation tools to test APIs, frameworks, and infrastructure components
• Collaborate with developers to ensure quality across the entire AI product lifecycle

• Help establish QA standards and best practices for emerging AI technologies

   

What We MUST Have

• 4+ years QA leadership experience
• Actual hands-on experience testing AI/LLM systems (not just using AI tools)
• Understanding of prompt testing, embedding quality, hallucination detection
• Experience with evaluation frameworks and LLM-specific metrics
• Ability to test both deterministic and non-deterministic systems
• Strong coding skills for evaluation scripts (Python preferred for AI tooling)