Senior Automation Test Engineer/SDET (Playwright + AI)

N-iX is looking for Senior Automation Test Engineer/SDET (Playwright + AI) to join the team

About the client:

Our client is a  cutting-edge, technology focused company that provides a better way of detecting and managing risks that may impact the outcome of clinical trials. Their solutions, all of which are cloud-based, are driven by a unique set of algorithms that interrogate clinical and operational data in real-time centrally to conveniently illuminate outliers and anomalies in data.

The Role: 

We are looking for a highly skilled AI Tester with strong Playwright expertise who embraces an AI-First approach to quality engineering. In this role, your primary focus will be testing AI-powered features implemented within the application — ensuring their reliability, accuracy, robustness, explainability, and compliance with product expectations. 

While automation remains a critical capability, this role requires a strong understanding of how AI-driven functionality behaves in real-world scenarios, including edge cases, model variability, and prompt-driven outputs. 

You will play a key role in validating AI features end-to-end — from requirement analysis and test design to automated validation, exploratory testing, and model behavior analysis — while continuing to leverage AI tools like GitHub Copilot/Codex to accelerate test development.

Responsibilities:

• Designing and executing comprehensive test strategies specifically for AI-powered features within the application
• Validating AI outputs for accuracy, consistency, edge-case handling, and alignment with business requirements
• Designing prompt-based and scenario-driven tests to evaluate model behavior under varied inputs
• Defining measurable validation criteria for non-deterministic systems( confidence ranges, tolerance thresholds, expected behavior patterns)
• Collaborating with engineering and product teams to improve explainability, observability, and traceability of AI decisions
• Ensuring AI features meet quality, compliance, and audit requirements where applicable
• Leveraging AI coding assistants (e.g., GitHub Copilot, Codex, or similar tools) to accelerate test development and framework enhancement
• Using AI tools to generate high-quality test scenarios from requirements and user stories
• Reviewing, validating, and refining AI-generated test code to ensure accuracy, scalability, and maintainability
• Contributing to AI-driven test design patterns and reusable automation strategies
• Promoting AI-augmented productivity practices within the QA team
• Designing, developing, and maintaining scalable Playwright-based automation frameworks for UI, API, and end-to-end testing
• Integrating automated test suites into CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins, etc.)
• Performing exploratory testing to uncover edge cases, usability gaps, and unexpected system behavior

Required Qualifications:

• 5+ years of commercial experience in tests automation
• Experience testing AI-driven or data-driven systems (LLMs, ML models,rule engines, recommendation systems, NLP-based features, etc.)
• Understanding of AI/ML behavior concepts such as prompt variability, non-deterministic outputs, confidence thresholds, bias, hallucinations, and edge-case handling.
• Ability to design validation strategies for probabilistic systems where results may not always be binary (pass/fail)
• Strong hands-on experience with Playwright automation framework
• Proficiency in JavaScript or TypeScript
• Demonstrated expertise using GitHub Copilot, Codex, or AI coding assistants as part of daily development workflow
• Solid understanding of automation framework architecture and design patterns
• Experience integrating automated tests into CI/CD pipelines
• Experience with test management tools such as Zephyr, Xray, or similar
• Strong understanding of software testing fundamentals (test design techniques, defect lifecycle, risk analysis)
• Proven experience in manual and exploratory testing of web applications
• Excellent analytical, debugging, and communication skills
• Upper-Intermediate/Advanced English level

Nice to have

• Experience validating AI systems in regulated environments (auditability, traceability, explainability requirements)