AI QUALITY ENGINEERING

QA AI Tester

Machine Learning • LLM Validation • AI Quality

8+ Years Experience • Hyderabad • Full-Time

LLM Testing ML Validation Python

Job Information

🏢 Company
Confidential
💼 Experience
8+ Years
📍 Location
Hyderabad
🎯 Role
QA AI Tester

Core Skills

LLM Testing Machine Learning Python Prompt Engineering AI Validation Model Evaluation ETL Testing Data Quality MLOps Evidently AI DeepChecks Cloud Platforms

Key Responsibilities

  • Lead end-to-end QA strategy for AI and Machine Learning systems.
  • Validate LLM responses, prompts, and AI model behaviour.
  • Design automation frameworks using Python.
  • Perform ETL and data pipeline validation.
  • Detect model drift, bias, hallucinations, and performance issues.
  • Collaborate with AI Engineers, Data Scientists, and Product teams.
  • Integrate AI testing into CI/CD pipelines.
  • Ensure Responsible AI and governance compliance.

Required Skills

  • 8+ years of Quality Assurance experience.
  • Hands-on Machine Learning testing experience.
  • Strong understanding of Large Language Models.
  • Python Automation expertise.
  • Data Pipeline and ETL Validation.
  • Knowledge of AI Ethics and Explainability.
  • Experience with Agile and Scrum environments.

Technology Stack

  • Python
  • LLMs
  • Machine Learning
  • ETL Testing
  • MLOps
  • Evidently AI
  • DeepChecks
  • AWS
  • Azure
  • Google Cloud
  • CI/CD
  • AI Governance

Why This Role Matters

Modern AI applications require far more than traditional software testing. This role focuses on validating machine learning models, ensuring fairness, monitoring model drift, evaluating LLM responses, and maintaining enterprise-quality AI systems that users can trust.


Disclaimer: This job information is shared for informational purposes only. Applications are processed through the employer's official recruitment platform.