- Company Name
- Yolk Recruitment Ltd
- Job Title
- AI QA Engineer
- Job Description
-
**Job Title:** AI QA Engineer
**Role Summary:**
Execute end‑to‑end quality assurance for AI‑enabled SaaS platforms. Lead strategy development, build and maintain test automation across functional, non‑functional, data, and model layers, and integrate testing into continuous delivery pipelines.
**Expactations:**
- Drive reliable AI product releases by ensuring rigorous test coverage and quality metrics.
- Collaborate cross‑functionally with engineering, product, and data science teams to define acceptance criteria and validation workflows.
- Actively monitor and report on test performance, defect trends, and AI model stability.
**Key Responsibilities:**
- Design, document, and own AI‑driven test strategies covering functional, non‑functional, data, and model‑level validation.
- Develop scalable test frameworks and reusable components using modern automation tools (e.g., Playwright, Cypress).
- Build, execute, and maintain automated test suites for APIs, microservices, integrations, and data pipelines.
- Validate AI/ML workflows, assessing model behavior, output quality, bias, hallucination risks, and regression across versions.
- Integrate automated tests into CI/CD pipelines and support continuous testing alongside DevOps teams.
- Perform performance and scalability testing, including inference latency and system throughput.
**Required Skills:**
- 5+ years in software quality engineering or SDET roles.
- Expert hands‑on experience with modern test automation frameworks (Playwright, Cypress, or equivalent).
- Proven experience testing APIs, microservices, and distributed systems.
- Strong understanding of test architecture, automation design patterns, and QA best practices.
- Experience integrating automated tests into CI/CD pipelines.
- Solid grasp of AI/ML concepts (LLMs, prompts, inference, model lifecycles).
- Proficiency with defect tracking and test management tools (e.g., JIRA, TestRail).
- Comfortable working in Agile/Scrum environments with cross‑functional teams.
**Required Education & Certifications:**
- Bachelor’s degree in Computer Science, Software Engineering, or related field.
- ISTQB Advanced/Test Automation certification or equivalent is a plus.