Quality Assurance Tester (AI Tester)

About the job

Role: QA Automation Engineer (AI Tester)

Location: Hyderabad

Exp:8+ years

We are seeking a passionate QA Automation engineer who will evolve into an AI Tester. In this role you will help ensure the quality of our AI/ML-driven products by designing, developing and executing both traditional automated test scripts and AI-specific test workflows. You’ll work cross-functionally with engineering, data science, product and DevOps teams to validate and improve our AI/ML systems.

Key Responsibilities:

• Test AI/ML models and Generative AI applications for accuracy, reliability, and performance.
• Validate LLM responses to ensure correctness, relevance, and safety.
• Perform prompt testing and prompt validation for AI chatbots and AI assistants.
• Design and execute test cases for AI models, including edge cases and adversarial inputs.
• Evaluate model hallucinations, bias, toxicity, and fairness issues.
• Conduct data validation testing to ensure training and testing datasets are clean and unbiased.
• Collaborate with AI Engineers, Data Scientists, and platforms.
• Build automated testing frameworks for AI systems.
• Monitor model performance metrics such as accuracy, precision, recall, and F1 score.
• Document test results and provide recommendations for improvements and Product teams to improve model quality.
• Test AI APIs and integrations across applications.