Product Engineer - DevOps and QA
Key Responsibilities:
This is a hands on technical role. Candidate should be proficient in Java, Python and React
- Develop full stack automation for AI pipelines, ETL
- Develop unit test automation
- Develop white box testing automation
- Develop evals for AI pipelining
- Translate customer needs into clear, actionable product specs.
- Act as the main liaison between Engineering, Design, and Customer Success to sign off every release
- Identify latency issues in application, backend and address them
- Test Fast APIs
- Develop technical specifications for functional requirements using prompt engineering
- Familiarity with AI tools for product engineering from design, development to sign off
- Generalist who will lead the releast lifecycle at a fast growing startup
- Be comfortable with prompt engineering to create clear acceptance criteria for every release.
- Set up and manage automated QA/QC pipelines (test automation, CI/CD).
- Define and document processes to boost product delivery and quality.
- Track execution across teams and keep timelines on point.
- Define and run evaluations for our AI scientist agent to perform ELT tasks.
- Design metrics and tests for AI agent accuracy, speed, and reliability.
Required Skills:
- Strong grasp of the software development lifecycle and QA best practices.
- Hands-on with CI/CD tools (GitHub Actions, CircleCI, GitLab CI).
- Experience with test automation frameworks (Cypress, Playwright, Selenium).
- Ability to write simple scripts (Bash, Python) and configure YAML pipelines.
- Proven skill in evaluating AI agents and their performance.
- Excellent cross-functional communication and organization skills.
Preferred Experience:
- Background in Product Ops, Technical Program Management, or DevOps-focused roles.
- Prior work in a SaaS or high-growth startup.
- Familiarity with monitoring and alerting tools (Sentry, Datadog).
Join us in shaping the future of lab automation. Become part of our mission to turn every lab into an AI powerhouse.
Published 31 May
151 views
ยท
24 applications
17% read
ยท
0% responded
๐
Average salary range of similar jobs in
analytics โ
Loading...