About the Role
Lenovo is seeking a Senior Manager of Quality Engineering to lead AI quality initiatives for the Qira AI Platform. This role focuses on AI validation, LLM testing, RAG evaluation, multimodal AI, automation frameworks, and enterprise-scale quality engineering across Windows, Android, cloud, and cross-device experiences.
10+ Years
AI Quality Engineering
Senior Manager
Global Leadership
Role Overview
Lead Lenovo's AI Quality Engineering organization responsible for validating AI-powered experiences across multiple platforms. Build scalable automation frameworks, define enterprise AI quality strategy, establish evaluation pipelines, and drive quality culture across engineering teams.
Key Responsibilities
- Build and lead the AI Quality Engineering organization in India.
- Define enterprise AI testing strategy across Windows, Android, Cloud, and cross-device platforms.
- Architect automation frameworks for AI agents, multimodal systems, UI workflows, and system interactions.
- Own AI model evaluation pipelines covering accuracy, latency, hallucination detection, grounding, safety, and guardrails.
- Develop tooling for validating local vs cloud inference, RAG reliability, and agent orchestration.
- Partner with SRE teams to define AI quality gates and release criteria.
- Create reusable AI scenario libraries across multiple intelligent features.
- Implement risk-based testing strategies for parallel AI development.
- Collaborate with Platform, Cloud, Experience, and Intelligence engineering teams.
- Drive a "Testability by Design" engineering culture.
Essential Skills
Must Have
- 10+ years in Quality Engineering or Test Automation.
- Minimum 3 years leading QA or AI Quality Engineering teams.
- Hands-on experience testing LLMs, AI models, RAG systems, or Agentic AI.
- Strong automation framework architecture experience.
- Expertise in UI automation across Windows and Android.
- API, regression, performance, and scenario-based testing expertise.
- Experience working with telemetry, logs, debugging, and distributed systems.
- Strong cross-functional leadership and stakeholder management skills.
Technology Areas
- Large Language Models (LLMs)
- Retrieval-Augmented Generation (RAG)
- AI Agents
- Multimodal AI
- Cloud AI
- Windows Automation
- Android Automation
- Cross-device Testing
- Performance Validation
- Regression Automation
- Scenario Testing
- Telemetry & Debugging
- SRE Release Gates
Leadership Expectations
- Build and scale AI Quality Engineering teams.
- Drive enterprise-wide AI quality strategy.
- Partner with global engineering organizations.
- Promote Testability by Design.
- Establish AI release governance and quality standards.
- Support global engineering collaboration and travel.
Why Join Lenovo?
Join one of the world's largest technology companies and lead AI Quality Engineering for Lenovo's next-generation Qira AI Platform. Influence enterprise AI quality standards, build high-impact automation frameworks, and shape AI-powered user experiences at global scale.
Career Highlights
- ✔ Global AI Leadership Role
- ✔ Enterprise AI Platform
- ✔ LLM & Agentic AI Validation
- ✔ AI Automation Architecture
- ✔ Cross-platform AI Quality
- ✔ Large-scale Engineering Leadership
- ✔ Global Collaboration Opportunities
Disclaimer: This job information is provided for educational and career guidance purposes only. Company names, logos, and trademarks belong to their respective owners. Please apply through the official Lenovo careers portal or the LinkedIn job posting.