About the Role
State Street is hiring a Senior Software QA Tester to support enterprise AI initiatives within financial services. This role focuses on validating Large Language Models (LLMs), AI Agents, automation frameworks, and AI-powered workflows while ensuring reliability, safety, and production readiness.
State Street
8+ Years
Hybrid
R-795454
Role Overview
Join a multidisciplinary AI engineering team to design, automate, and execute quality assurance strategies for LLM-powered applications and AI Agents. You'll help deliver secure, reliable, and enterprise-grade AI systems through advanced automation and evaluation techniques.
Key Responsibilities
- Analyze functional specifications and create comprehensive AI test strategies.
- Execute functional, regression, integration, and web service testing.
- Develop automated test frameworks using Python, Selenium, and Pytest.
- Integrate automated testing into enterprise CI/CD pipelines.
- Validate LLM prompts, AI Agent workflows, and model responses.
- Perform AI accuracy, safety, ethical compliance, and reliability testing.
- Track, manage, and verify software defects using Jira.
- Collaborate with engineering teams to improve AI quality and release readiness.
Technical Skills
Required Qualifications
- 8+ years of Software Quality Assurance experience.
- Hands-on experience testing LLMs and AI Agent workflows.
- Knowledge of AI safety, ethical AI, and model evaluation.
- Strong Python automation and Selenium expertise.
- Experience with CI/CD, API testing, and enterprise QA tools.
- Excellent analytical, communication, and problem-solving skills.
Why Join State Street?
Work on cutting-edge AI initiatives within the financial services industry. Collaborate with AI engineers and automation experts to build secure, scalable, and responsible AI systems while advancing your expertise in enterprise AI quality engineering.
Highlights
- ✔ Hybrid Work Environment
- ✔ Enterprise AI & LLM Testing
- ✔ AI Agent Validation
- ✔ Python Automation
- ✔ OpenAI Evals & RAGAS
- ✔ AI Safety & Ethical Validation
- ✔ CI/CD Integration
- ✔ Financial Technology Domain
Disclaimer: This job information is shared for educational and career guidance purposes only. Company names, trademarks, and logos belong to their respective owners. Please apply through the official LinkedIn job posting.