Job Title: Quality Assurance Engineer – GenAI
Location: Remote
Experience: 1–2 Years
Job Type: Full-Time
Schedule: Monday to Friday
Compensation: ₹5,00,000 – ₹10,00,000 per annum
Job Overview
Are you passionate about ensuring exceptional quality in AI-powered products? At Troopr, we're on a mission to redefine AI automation for global businesses like Starbucks, Netflix, Spotify, and Snowflake. We're looking for a Quality Assurance Engineer – GenAI to help us deliver flawless, LLM-driven B2B SaaS solutions.
This is a hybrid QA + prompt engineering role where you’ll ensure the reliability, intelligence, and performance of our GenAI systems. If you thrive in fast-paced environments, value precision, and have a deep understanding of conversational AI, this is the perfect opportunity for you.
Key Responsibilities
Prompt Engineering & LLM Optimization
-
Design and iterate prompts to optimize LLM responses for automation workflows
-
Develop reusable prompt libraries and scalable testing frameworks
-
Integrate prompt flows into AI pipelines in collaboration with product and engineering teams
-
Apply advanced prompt strategies (e.g., RAG, few-shot learning, role conditioning)
GenAI & LLM Quality Assurance
-
Conduct functional, regression, and exploratory testing of LLM-based features
-
Evaluate LLM outputs for coherence, factual accuracy, hallucinations, and ethical implications
-
Identify and document UX inconsistencies and edge cases in chatbot interactions
System QA & Performance Testing
-
Lead performance and stress testing for AI-driven systems (both backend and frontend)
-
Collaborate in Agile teams to ensure robust and scalable product experiences
-
Log bugs, usability gaps, and performance bottlenecks using tools like Jira or TestRail
Qualifications
Must-Have
-
2+ years of experience testing GenAI/chatbot or LLM-based applications
-
Hands-on knowledge of OpenAI, Anthropic, LangChain, or similar tools
-
Strong familiarity with B2B SaaS environments, especially in support automation
-
Experience with QA and ticketing tools (Jira, TestRail, etc.)
-
Strong analytical mindset and attention to detail
-
Excellent communication skills and team collaboration in Agile settings
Bonus Points
-
Knowledge of AI observability, A/B testing, or LLM evaluation metrics
-
Experience with few-shot prompting, chain-of-thought techniques, or safety guardrails
-
Background in NLP, cognitive science, or linguistics
-
Familiarity with performance testing tools like JMeter, Locust, etc.
Education
-
Master’s degree (preferred)
Perks & Benefits
-
Remote-first work culture
-
Flexible schedule
-
Opportunity to work on cutting-edge GenAI products used by top global brands
-
Fast-paced startup environment with high ownership and learning
Application Questions
-
What is your current CTC?
-
What is your notice period?
Ready to shape the future of AI-powered support? Apply now and join a team where your QA expertise will directly impact how businesses around the world interact with AI.
- Company Name: Troopr
- Average Salary Offered (for Current Role):5-10 LPA
- Must-have skills:
- Experience in SaaS
- Experience in B2B
- Experience in AI
- Quality assurance
- Jira
- Analysis skills
- Agile
- Usability
- Performance testing
- Natural language processing
- Communication skills
- A/B testing
- How to prepare for the Interview?
- Brush up on your knowledge of prompt engineering, LLM optimization, and GenAI testing
- Familiarize yourself with tools like OpenAI, Anthropic, LangChain, and AI observability tools
- Prepare examples of your experience with B2B SaaS platforms, particularly in AI support automation
- Be ready to discuss your problem-solving skills and attention to edge cases
- Prepare to showcase your excellent verbal and written communication skills
- How to prepare the resume for this job description?
- Highlight your experience in testing GenAI/chatbot applications or LLM-based products
- Emphasize your hands-on knowledge of tools like OpenAI, Anthropic, LangChain, or similar
- Showcase your familiarity with QA tools like Jira, TestRail, and evaluation of LLM outputs
- Demonstrate your strong problem-solving skills and attention to edge cases
- Highlight your experience working in fast-paced, startup environments with high ownership
- Links to prepare for the interview: