AI QA Engineer

Responsibilities: Design and execute test plans specifically for AI/ML features and LLM-integrated product workflows Evaluate model outputs for accuracy, consistency, edge cases, hallucinations, and bias Build and maintain automated evaluation pipelines and regression benchmarks Run prompt testing, adversarial testing, and structured red-teaming exercises Define quality metrics and release criteria for AI-driven features Requirements: 2-4 years in software QA or SDET roles, with at least 1 year on AI/ML products Hands-on experience testing LLM-based features or AI APIs Proficiency in Python and testing frameworks (pytest, unittest) Familiarity with prompt engineering and evaluation techniques Experience with CI/CD pipelines and automated test infrastructure