LTIMINDTREE CAREERS

Gen AI Tester

LLM Evaluation & AI Quality Engineering

4–9 Years Experience • Full-Time • AI Testing

LLM Testing Prompt Engineering Python

Job Information

🏢 Company
LTIMindtree

💼 Experience
4–9 Years

🎯 Role
Gen AI Tester

💻 Type
Full-Time

🚀 APPLY NOW

Core Skills

LLM Evaluation GPT Claude Llama Python Prompt Engineering API Testing LangChain LlamaIndex Hugging Face BLEU ROUGE AI Agents

Key Responsibilities

Evaluate Large Language Models including GPT, Claude, and Llama.
Measure AI quality using BLEU, ROUGE, F1 Score, Exact Match, and Perplexity.
Test hallucination rates, factual accuracy, and AI safety.
Develop prompt engineering and AI validation strategies.
Perform API testing for AI services and LLM endpoints.
Validate AI agent workflows, tool chaining, and function calling.
Create synthetic datasets and support model comparison testing.

Required Skills

4–9 years of software testing experience.
Hands-on experience with LLM evaluation.
Strong Python programming skills.
Knowledge of LangChain, LlamaIndex, and Hugging Face.
Experience with Prompt Engineering and AI testing methodologies.
Understanding of AI agent workflows and model evaluation.
Experience with API Testing and Automation Testing.

Technology Stack

Python
GPT
Claude
Llama
LangChain
LlamaIndex
Hugging Face
Prompt Engineering
REST APIs
Automation Testing
AI Evaluation Metrics
Model Comparison Frameworks

Why This Role Matters

Generative AI applications require comprehensive evaluation beyond traditional software testing. This opportunity focuses on validating LLM performance, ensuring AI safety, reducing hallucinations, improving factual accuracy, and delivering reliable AI-powered applications through advanced testing methodologies.

Apply on Naukri

Disclaimer: This job information is shared for informational purposes only. Applications are processed through the employer's official recruitment platform.