AI QUALITY ENGINEERING • HIGHLEVEL

Lead Software Development Engineer in Test - AI

Own Enterprise AI Quality Strategy & Automation Architecture

7+ Years Experience • AI Testing • RAG • Hallucination Testing • Automation Architecture

AI Testing RAG QA Leadership Automation

About the Role

HighLevel is hiring a Lead Software Development Engineer in Test - AI to lead enterprise-wide AI Quality Engineering initiatives. You'll architect automation frameworks, define AI testing strategies, validate RAG systems, monitor hallucinations and bias, and shape the quality roadmap for AI-powered products used by millions of businesses worldwide.

🏢 Company
HighLevel
💼 Experience
7+ Years
🌍 Work Model
Remote First
🤖 Domain
Enterprise AI Testing

Key Responsibilities

  • Define enterprise AI Quality Engineering strategy.
  • Architect reusable cross-platform automation frameworks.
  • Lead AI testing initiatives across the organization.
  • Validate RAG, hallucination, drift and bias.
  • Design scalable AI quality methodologies.
  • Own test strategy, governance and quality roadmap.
  • Coach QA engineers and SDET teams.
  • Collaborate with Product, Engineering and AI teams.
  • Reduce product risk through AI quality improvements.

Required Skills

AI Testing LLMs RAG Bias Detection Hallucination Testing Automation Architecture Quality Strategy Leadership CI/CD AWS Azure GCP MLOps

Why Join HighLevel?

Join one of the fastest-growing AI-powered business platforms supporting over one million businesses across 150+ countries. Work on enterprise-scale AI products, influence quality strategy, and help build reliable, scalable, and production-ready AI solutions that process billions of events every day.

Technology Stack

  • Large Language Models (LLMs)
  • Retrieval-Augmented Generation (RAG)
  • AI Hallucination Testing
  • Bias & Drift Detection
  • Automation Framework Design
  • CI/CD Pipelines
  • MLOps
  • AWS
  • Azure
  • Google Cloud Platform
  • Performance Testing
  • Scalability Testing

Disclaimer: This job post is published for informational purposes only. All trademarks, logos, and company names belong to their respective owners. Please submit your application through the official HighLevel recruitment portal or LinkedIn job listing.