About TCS AI Testing
Tata Consultancy Services is hiring experienced AI Test Engineers to validate Generative AI applications, LLM responses, Retrieval-Augmented Generation (RAG) systems, and Responsible AI implementations. This role focuses on AI quality evaluation, governance, prompt validation, and enterprise-scale GenAI testing.
Tata Consultancy Services
6–10 Years
Hyderabad
1 August 2026
Role Overview
As an AI Test Engineer, you will validate AI-generated responses, evaluate LLMs and RAG applications, build high-quality test datasets, perform Responsible AI testing, and integrate AI evaluation into enterprise quality engineering practices.
Key Responsibilities
- Evaluate AI responses using Human Evaluation, Automated Evaluation, and LLM-as-a-Judge techniques.
- Validate accuracy, relevance, groundedness, consistency, and completeness of AI outputs.
- Identify hallucinations, factual inaccuracies, toxicity, bias, and grounding issues.
- Perform prompt validation, adversarial testing, and jailbreak testing.
- Design and maintain Golden, Regression, Edge Case, and Adversarial datasets.
- Measure AI quality metrics including Precision, Recall, Faithfulness, Context Relevance, and Safety.
- Collaborate with AI Engineers, Product Owners, and Data Scientists.
- Automate AI evaluation workflows using Python and testing frameworks.
- Integrate AI quality validation into CI/CD pipelines.
- Support Responsible AI governance, compliance, and enterprise AI quality standards.
Technical Skills
Preferred Qualifications
- 6–10 years in Software Testing or Quality Engineering.
- 1–3 years of AI, GenAI, or LLM testing experience.
- Hands-on knowledge of RAG applications and AI evaluation frameworks.
- Experience with LangSmith, RAGAS, DeepEval, or Promptfoo.
- Python scripting and automation experience is preferred.
Walk-In Interview Details
Registration Time: 9:00 AM – 1:00 PM
Experience: 6+ Years
Location: Tata Consultancy Services, Deccan Park, Madhapur, Hyderabad
Highlights
- ✔ Enterprise GenAI Testing
- ✔ LLM Response Validation
- ✔ Responsible AI Testing
- ✔ RAG Evaluation Frameworks
- ✔ Prompt Engineering Validation
- ✔ Hallucination & Bias Detection
- ✔ Python Automation
- ✔ Walk-In Opportunity at Hyderabad
Disclaimer: This job post is shared for educational and career guidance purposes only. All trademarks, logos, and company names belong to their respective owners. Please apply through the official job posting.