AI Test Specialist
LTIMindtreeAbout the job
LTIMindtree is seeking AI Test Specialist across locations.
JD
1 Design automate test frameworks to verify consistency factual accuracy tone alignment and contextual precision for insurance risk management use cases
2 Build versioned golden data sets and automated benchmarking suites for regression finetuning validation aligned to clients operations
3 Integrate AI testing pipelines with OpenAI for Clients tailored solutions and model evaluations.
4 Develop validate autonomous agents for multi step reasoning tool use and goal oriented decision making.
5 Create test harnesses for LangChain LangGraph or custom orchestration layers mapped to clients operational processes
6 Build environments to test reasoning consistency error handling task prioritization and outcome reliability in client scenarios.
7 Implement detection scoring for hallucinations looping goal misalignment and ethical constraint violations per client standards.
8 Construct testbeds to assess collaboration task distribution and negotiation among agents in claimsrisk management contexts
9 Develop strategies to test MCP based systems ensuring robust context passing among models agents and tools
10 Validate schema alignment context synchronization and response correctness across chained clients AI systems.
11 Implement versioned tests to prevent data loss or intent drift between model interactions critical to clients operations
12 Build end to end automation pipelines integrating data model and agent validation within CICD for clients AI systems
13 Create modular frameworks supporting traditional API tests and LLMagent tests in a single scalable stack for Clients globally
14 Leverage MLOps tools for traceable experiment validation tailored to clients needs
15 Implement feedback loops tracking model drift hallucination rates and performance degradation in clients applications
16 Automate validation across ingestion feature transformation and prompt context building for clients specific datasets
17 Generate synthetictest data to ensure broad model validation coverage
18 Validate fairness bias and ethical compliance of outputs aligned with clients commitment to responsible AI
19 Define track test KPIs factuality coherence reasoning depth task completion success rate.
LTM is proud to be an equal opportunity employer. We are committed to equal employment opportunity regardless of race, ethnicity, nationality, gender, gender-identity, gender expression, language, age, sexual orientation, religion, marital status, veteran status, socio-economic status, dis-ability or any other characteristic protected by applicable law.