About the Role
We are hiring an AI Quality Analyst (Personalization) to evaluate advanced AI personalization capabilities. The role focuses on testing how AI systems use personal context from conversations, search history, email, and other data sources to generate accurate, relevant, and helpful responses.
Remote (Worldwide)
Full-Time
AI Personalization
Competitive
Role Overview
This position involves designing multi-turn prompts, evaluating AI-generated responses, validating personalization quality, identifying incorrect reasoning, and helping improve AI systems through structured human evaluation.
Key Responsibilities
- Create and refine multi-turn prompts to evaluate AI personalization.
- Assess AI responses for grounding, integration, relevance, and helpfulness.
- Identify incorrect personalization and unsupported AI assumptions.
- Compare multiple AI responses to measure consistency and quality.
- Provide structured feedback to improve AI personalization models.
- Evaluate AI alignment with user context and intent.
- Analyze conversation history, search, email, and activity-based personalization.
- Support continuous improvement of enterprise AI systems.
Required Skills
Preferred Qualifications
- Strong proficiency in Hindi (reading and writing).
- Experience evaluating AI-generated content.
- Excellent analytical and critical thinking skills.
- Ability to design creative prompt scenarios.
- Understanding of AI personalization and context-aware systems.
- Knowledge of privacy considerations in AI evaluation.
Why Join?
Help shape the future of AI personalization by evaluating cutting-edge AI models used by leading global organizations. Work remotely, influence AI quality, and contribute directly to next-generation intelligent systems.
Highlights
- ✔ Fully Remote Opportunity
- ✔ AI Personalization Testing
- ✔ Multi-turn Prompt Design
- ✔ Human Evaluation of AI
- ✔ LLM Response Analysis
- ✔ Context & Intent Validation
- ✔ Hindi Language Expertise
- ✔ Global AI Projects
Disclaimer: This job information is provided for educational and career guidance purposes only. Company names, logos, and trademarks belong to their respective owners. Please apply through the official LinkedIn job posting.