About Vialto Labs
Vialto Labs develops AI-powered solutions that improve tax, immigration, and enterprise workflows through Large Language Models, OCR, document intelligence, and autonomous AI systems. This role focuses on validating AI systems for production-scale reliability, performance, and responsible deployment.
Vialto Labs
7+ Years
Bangalore (Hybrid)
AI Test Engineering
Role Overview
Join Vialto Labs as an AI Test Engineer to build scalable AI evaluation frameworks, validate LLM outputs, monitor model drift, test OCR and document intelligence systems, and ensure enterprise-grade quality across production AI applications.
Key Responsibilities
- Design AI evaluation strategies for LLMs, OCR systems, and document AI.
- Create adversarial tests to identify hallucinations, failures, and edge cases.
- Develop reusable Python-based AI evaluation frameworks.
- Build AI-as-Judge evaluation pipelines with automated scoring.
- Implement drift detection and continuous quality monitoring.
- Create and maintain ground-truth datasets for AI validation.
- Perform API testing using Python and Postman/Newman.
- Validate SQL data integrity across AI workflows.
- Test end-to-end agentic workflows and fallback mechanisms.
- Support Responsible AI, governance, traceability, and audit readiness.
Technical Skills
Preferred Qualifications
- 2–3 years of AI/ML production testing experience.
- Experience building drift detection systems.
- Knowledge of AI governance and Responsible AI.
- Exposure to compliance-driven enterprise environments.
- Advanced degree in Computer Science or Data Science is preferred.
Why Join Vialto Labs?
Work on enterprise AI products that combine LLMs, OCR, retrieval systems, and intelligent workflows. Help build standardized AI quality engineering frameworks while working with cutting-edge evaluation technologies in a global engineering environment.
Highlights
- ✔ Hybrid Work – Bangalore
- ✔ AI Quality Engineering
- ✔ Production LLM Evaluation
- ✔ AI-as-Judge Frameworks
- ✔ Drift Detection & Monitoring
- ✔ OCR & Document AI Testing
- ✔ Python Automation
- ✔ Responsible AI & Governance
Disclaimer: This job information is shared for educational and career guidance purposes only. Company names and trademarks belong to their respective owners. Please apply through the official LinkedIn job posting.