QA Engineer - AI Tooling and Infrastructure

Hi! We're launching a dedicated AI division creating both internal tooling and customer-facing AI products. With startup energy backed by our established 20+ year tech company, we're building everything from developer infrastructure to productivity solutions.

Our team collaborates with leading AI researchers, operating from our New York  and Krakow hubs with a horizontal structure that gives you direct impact.

What You'll Do

• Design and implement comprehensive test strategies for AI-powered tools and systems
• Create test frameworks to verify accuracy, reliability, and performance of LLM integrations
• Develop automation tools to test APIs, frameworks, and infrastructure components
• Collaborate with developers to ensure quality across the entire AI product lifecycle

• Help establish QA standards and best practices for emerging AI technologies

   

What We Need

• Enthusiasm for AI quality assurance and testing methodologies
• Experience testing backend systems and APIs
• Hands-on experience with testing tools and automation frameworks
• Familiarity with LLMs (Claudes, OpenAI models, etc.) and their behavior
• Problem-solving mindset and eagerness to learn
• 2+ years professional QA/testing experience

Nice to Have (We'll Teach)

• Experience testing AI systems or ML models
• Knowledge of testing multiagent systems
• Expertise in creating test automation frameworks
• Background in testing Java-based applications
• Exposure to performance and load testing