DECCAN AI CAREERS

Quality Associate – AI/ML

AI Data Quality & Model Evaluation

📍 Hyderabad • Full-Time • Immediate Joiners

AI/ML LLM Evaluation Python

Job Information

🏢 Company
Deccan AI
📍 Location
Hyderabad
💼 Position
Quality Associate – AI/ML
⚡ Joining
Immediate

Core Skills

AI Data Quality LLM Evaluation Python Prompt Engineering Dataset Analysis LLM APIs Machine Learning Statistics Sampling Theory Hypothesis Testing Human-in-the-Loop

Key Responsibilities

  • Evaluate AI training datasets and improve overall data quality.
  • Build automated quality signal pipelines before human review.
  • Design ML-driven quality criteria for human-in-the-loop workflows.
  • Calibrate automated systems using human gold-standard datasets.
  • Develop statistical quality measurement methodologies.
  • Create quality reports and actionable dataset insights.

Required Skills

  • Strong understanding of Machine Learning fundamentals.
  • Excellent Python programming skills.
  • Experience working with LLM APIs and prompt engineering.
  • Knowledge of model training, fine-tuning, and annotations.
  • Strong statistical concepts including sampling and confidence intervals.
  • Excellent analytical thinking and attention to detail.

Good to Have

  • LLM-as-a-Judge experience.
  • AI evaluation frameworks.
  • Annotation platforms.
  • Six Sigma or ISO Quality Systems.
  • Clinical or Manufacturing QA exposure.

Why This Role Matters

Modern AI models depend on high-quality datasets for accurate learning. This role combines machine learning, statistical analysis, AI evaluation, and human-in-the-loop workflows to improve training data quality and build reliable Generative AI systems for leading AI companies worldwide.


Disclaimer: This job information is shared for informational purposes only. Applications are processed through the employer's official recruitment platform.