QA Lead — Agentic AI Platform project

We are looking for a QA Lead to define and execute the quality strategy for an agentic AI engine that automates the software development lifecycle — from specifications and design to code and testing.

This role focuses on ensuring the reliability, correctness, and safety of multi-agent workflows operating in environments where requirements cannot always be fully predefined.

The position is hands-on, with strong emphasis on automation, evaluation pipelines, and quality ownership.

Who We Are Looking For:

• Strong understanding of the enterprise software development lifecycle (SDLC)
• Ability to work effectively without detailed specifications, especially in early project phases
• Proactive mindset and strong synchronous communication
• Solid background in test automation (Playwright / Selenium / Cypress)

• Experience contributing to or defining test strategies

   

Responsibilities

• Define and own the overall QA strategy, quality standards, and quality gates for the platform
• Build and maintain automated evaluation pipelines covering:
  • functional testing
  • non-functional testing
  • safety and security testing
  • performance validation
• Perform deep validation of outputs generated by agent squads across the SDLC (specs, designs, code, tests)
• Develop and maintain automated test suites and regression systems for:
  • multi-agent workflows
  • REST APIs
• Partner with architects, engineers, and product teams to define:
  • testability requirements
  • acceptance criteria
  • failure modes
• Monitor quality metrics and provide insights, risks, and improvement recommendations

• Support rapid iteration cycles while ensuring agents meet expected accuracy, consistency, and reliability

   

Technical Requirements

• Experience planning, validating, and testing systems where business specifications are not fully predefined
  (e.g. rule engines, decision automation systems)
• Strong skills in building automated tests, test harnesses, and evaluation scripts
• Experience testing REST APIs and integrating QA automation into CI/CD pipelines
• Good automation background with Playwright, Selenium, or Cypress
• Familiarity with agentic frameworks (LangGraph, LangChain, Pydantic) is a plus
• Understanding of AI safety and security testing, including:
  • prompt-injection testing
  • red teaming (considered a plus)

Soft Skills (Nice to Have)

• Strong ownership and adaptability
• Ability to work in fast-paced, iterative environments
• Effective communication and cross-functional collaboration
• Interest in early-stage product development and AI-driven software engineering
• English: Upper-Intermediate / Advanced

Additional Information

• Role focus: QA strategy, automation, and evaluation
• Product type: Agentic AI platform

• Work format: Remote