Senior QA Engineer (AI/LLM)

Senior QA Engineer (AI/LLM)

Full-time / Remote

About Us 

ExpoPlatform is a UK-based company founded in 2013, delivering advanced technology for online, hybrid, and in-person events across 30+ countries. Our platform provides end-to-end solutions for event organizers, including registration, attendee management, event websites, and networking tools.

About the Role
We are looking for a Senior QA Engineer to join our Data Science team. In this role, you will take ownership of defining and executing the quality strategy for AI-driven services, ensuring reliability, scalability, and excellent user experience. You will work closely with ML engineers, product managers, and designers to raise the quality bar for our AI solutions.
To be successful in this role, you should bring at least two out of the following three strengths:

• Strong QA skills with a structured and methodical approach to work,
• Strong English language skills, both written and spoken,

• Hands-on experience testing AI/ML systems, chatbots, or LLM-based tools.

   

Role Responsibilities

• Define and drive QA strategy and best practices for the Data Science team
• Analyze business and technical requirements to ensure testability and completeness
• Design, implement, and execute functional and non-functional testing (web, mobile, agentic services)
• Lead testing of API endpoints, data pipelines, and integrations within DS-managed services
• Validate frontend and backend processes in interactions with DS components
• Assess LLM behavior: validate prompts, agent workflows, conversation logic, and detect inconsistencies, hallucinations, or undesired outputs
• Collaborate with cross-functional stakeholders to improve AI reliability, fairness, and user satisfaction
• Conduct and guide performance, scalability, and latency testing for AI model inference and responses
• Oversee regression and release testing, ensuring high-quality production deployments
• Establish clear defect management, tracking, and reporting processes
• Contribute to product planning, backlog refinement, and architectural discussions with a QA perspective
• Stay current on advancements in LLM capabilities, benchmarking practices, and AI quality metrics
   

Required Experience

• 5+ years of experience in functional and non-functional testing, with at least 2 years in a senior role
• Experience testing AI/ML systems, chatbots, or LLM-based tools
• Familiarity with prompt engineering, model evaluation, and validation techniques
• In-depth understanding of QA methodologies, test strategies, and processes
• Solid experience with API testing and related tools
• Familiarity with web technologies (HTML, XML, SQL) and data validation
• Hands-on experience with QA management and collaboration tools (e.g., Jira, Confluence, TestRail)
• English (C1) with excellent communication and documentation skills
   

Nice to Have

• Additional languages: French, German, or Spanish
• Experience with test automation frameworks (e.g., Pytest, Selenium, Playwright)
• Programming/scripting skills (Python, JavaScript, or similar)
• Familiarity with cloud environments (AWS) and CI/CD pipelines

What We Offer

• Career growth with an international team.
• Competitive salary and financial stability.
• Flexible working hours (Mon-Fri, 8 hours).
• Free English courses and a budget for education