Job Information
🏢 Company
Confidential
Confidential
💼 Experience
8+ Years
8+ Years
📍 Location
Hyderabad
Hyderabad
🎯 Role
QA AI Tester
QA AI Tester
Core Skills
LLM Testing
Machine Learning
Python
Prompt Engineering
AI Validation
Model Evaluation
ETL Testing
Data Quality
MLOps
Evidently AI
DeepChecks
Cloud Platforms
Key Responsibilities
- Lead end-to-end QA strategy for AI and Machine Learning systems.
- Validate LLM responses, prompts, and AI model behaviour.
- Design automation frameworks using Python.
- Perform ETL and data pipeline validation.
- Detect model drift, bias, hallucinations, and performance issues.
- Collaborate with AI Engineers, Data Scientists, and Product teams.
- Integrate AI testing into CI/CD pipelines.
- Ensure Responsible AI and governance compliance.
Required Skills
- 8+ years of Quality Assurance experience.
- Hands-on Machine Learning testing experience.
- Strong understanding of Large Language Models.
- Python Automation expertise.
- Data Pipeline and ETL Validation.
- Knowledge of AI Ethics and Explainability.
- Experience with Agile and Scrum environments.
Technology Stack
- Python
- LLMs
- Machine Learning
- ETL Testing
- MLOps
- Evidently AI
- DeepChecks
- AWS
- Azure
- Google Cloud
- CI/CD
- AI Governance
Why This Role Matters
Modern AI applications require far more than traditional software testing. This role focuses on validating machine learning models, ensuring fairness, monitoring model drift, evaluating LLM responses, and maintaining enterprise-quality AI systems that users can trust.
Disclaimer: This job information is shared for informational purposes only. Applications are processed through the employer's official recruitment platform.