AI Quality Assurance Engineer

About the job

Overview:

CACTUS is a remote-first organization and we embrace an accelerate from anywhere culture. You may be required to travel to our Mumbai office based on business requirements or for company/team events.

We are looking for an AI QA Engineer to ensure the quality, reliability, and ethical compliance of AI-driven systems. In this role, you will design and execute testing strategies for machine learning models, validate data and outputs, and collaborate with cross-functional teams to deliver robust, production-ready AI solutions. If you are passionate about testing intelligent systems and ensuring responsible AI performance at scale, this role offers strong ownership and impact.

Responsibilities:

• Design and execute comprehensive testing strategies for AI services including functional, performance, and bias testing
• Create detailed test plans, test cases, and regression testing suites specifically tailored for AI/ML applications and use cases
• Perform model validation testing, data quality assessment, and AI output accuracy verification against business requirements
• Conduct fairness testing, bias detection, and ethical AI compliance validation for AI applications
• Maintain comprehensive logs of defects, issues, and resolution tracking across development, staging, and production environments
• Collaborate with data scientists and ML engineers to establish protocols for model performance and reliability
• Execute automated testing frameworks for continuous integration and deployment of AI services
• Validate AI service integration points, API functionality, and data pipeline integrity
• Monitor production AI systems for performance degradation, accuracy drift, and compliance violations

Requirements:

• B.Tech / M.Sc. in Computer Science, Data Science, or related fields.
• Certification in Quality Assurance or Test Automation preferred.
• 4–6 years in quality assurance for AI/ML systems or data-driven platforms.
• Experience in functional, performance, and data validation testing of AI models.
• Familiarity with testing frameworks for NLP, CV, and data-centric applications.

Technical Competencies:

• AI Testing: Model validation, bias detection, fairness testing, AI output verification, and responsible AI compliance testing
• Test Automation: Selenium, pytest, TestNG, Cypress for automated testing frameworks and continuous integration
• Programming Languages: Python for test scripting, SQL for data validation, basic understanding of R for statistical testing
• Testing Tools: Jira, TestRail, Postman for API testing, Jenkins for CI/CD testing pipelines
• Data Validation: Data quality testing, ETL testing, data pipeline validation, and database testing techniques
• Performance Testing: Load testing, stress testing, and performance monitoring for AI services and data processing systems
• Security Testing: Data privacy validation, access control testing, encryption verification, and compliance audit support
• Cloud Testing: AWS, Azure, GCP testing environments, cloud service validation, and multi-environment testing strategies
• API Testing: REST API testing, GraphQL testing, microservices testing, and integration testing methodologies.

About Cactus:

Established in 2002, CACTUS (cactusglobal.com) is a leading technology company that specializes in expert services and AI-driven products which improve how research gets funded, published, communicated, and discovered. Its flagship brand Editage offers a comprehensive suite of researcher solutions, including expert services and cutting-edge AI products like Mind the Graph, Paperpal, and R Discovery. With offices in Princeton, London, Singapore, Beijing, Shanghai, Seoul, Tokyo, and Mumbai and a global workforce of over 3,000 experts, CACTUS is a pioneer in workplace best practices and has been consistently recognized as a great place to work.