JazzX AI logo

Senior Staff QA

JazzX AI Bengaluru, Karnataka, India

onsitefull-time
Posted Jan 16, 2026Apply by Jul 15, 2026

Role & seniority: QA Lead overseeing overall quality strategy for JazzX AI platforms and AI-powered products; leads and scales a QA team.

Stack/tools

  • Languages/frameworks: Python, Java, JavaScript

  • Automation: Playwright, Selenium, PyTest, Postman

  • CI/CD: GitHub Actions, GitLab, Jenkins

  • Cloud: AWS, GCP (Azure also mentioned)

  • Testing scope: API, microservices, backend, distributed cloud systems

  • AI/ML context: evaluation of LLMs, RAG, knowledge-grounding, tooling correctness

Top 3 responsibilities

  • Define and own end-to-end QA strategy for AI copilots, workflows, and enterprise deployments; enforce release-readiness gates

  • Lead and mentor QA engineers; collaborate with Product, ML Engineering, and Platform Engineering to bake quality in from design

  • Develop AI/ML-specific QA: evaluation of LLM accuracy, hallucination detection, safety, bias mitigation; design scalable tests for reasoning and multi-step workflows; manage automation across CI/CD and cloud services

Must-have skills

  • 12+ years in Software QA with hands-on test automation (Python/Java/JavaScript)

  • Experience with microservice architectures and automated API/backend testing in cloud (AWS/GCP/Azure)

  • Familiarity with AI/ML systems: datasets, model evaluation, vector stores, RAG, LLM operations

  • Strong analytical/problem-solving skills; ability to drive cross-organizational quality initiatives

Nice-to-haves

  • Experience testing LLMs, RAG pipelines, or auto

Full Description

About JazzX AI -

Our mission is to build a world where enterprise knowledge work is no longer constrained by human capacity.

JazzX AI is building an AGI-first system of intelligence for the enterprise — a platform designed to transform how complex, judgment-heavy work gets done.

Instead of adding AI features to existing software, JazzX re-architects enterprise workflows from first principles. Our platform integrates reasoners, knowledge fabrics, and role-native assistants to create intelligent systems that can understand goals, reason through policies, collaborate with humans, and execute work end-to-end — all within human-defined guardrails and with full explainability.

We are starting with residential lending, where deep due diligence, complex policies, and expert judgment define outcomes, and are building a horizontal platform that will enable intelligent applications across many industries characterized by knowledge-centric, manually intensive processes.

JazzX is not about dashboards or automation. It’s about Work-as-a-Service — intelligent systems that continuously learn, adapt, and deliver outcomes at enterprise scale.

Backed by SAI Group

JazzX AI is incubated and backed by SAI Group, a private investment firm that has committed $1B to build and scale next-generation, AI-powered enterprise software companies. SAI Group’s portfolio serves 2,000+ global enterprise customers, generates nearly $800M in annual revenue, and employs 4,000+ people worldwide — providing JazzX with long-term capital, deep operating expertise, and access to real-world enterprise scale from day one.

Role Overview

We are looking for a QA Lead who can architect the overall quality strategy for JazzX AI’s platforms and AI-powered products. This role requires a blend of traditional QA expertise, AI/ML awareness, and strong leadership capabilities.

You will lead the quality roadmap for agent workflows, LLM outputs, APIs, and cloud services while managing a high-performing QA team.

Key Responsibilities

Quality Strategy & Leadership Build and own JazzX AI’s end-to-end QA strategy across AI copilots, workflows, and enterprise deployments. Lead, mentor, and scale a team of QA engineers and automation specialists. Partner closely with Product, ML Engineering, and Platform Engineering to embed quality in early design phases. Define and enforce quality gates and release-readiness standards. AI/LLM-Specific Quality Assurance Develop evaluation systems for LLM accuracy, hallucination detection, factuality, safety, and bias mitigation. Design scalable tests for agent reasoning, tool-use correctness, and multi-step workflow validation. Create synthetic datasets and scenario-based tests for edge-case prediction and regression testing. Validate model performance across fine-tuning, RAG, knowledge-grounding, and inference scenarios. Automation Engineering Architect and manage automation frameworks using Python/Java/JS, Playwright, Selenium, PyTest, Postman, etc. Ensure seamless integration of automated suites into CI/CD pipelines (GitHub Actions/GitLab/Jenkins). Automated API, microservices, and backend testing for JazzX AI’s cloud architecture running on AWS/GCP. Performance Testing Load Testing, Stress Testing, Spike Testing, Endurance/Soak Testing using industry-standard tools like JMeter, LoadRunner, Gatling, k6, or Locust. Release, Monitoring & Reliability Own the release sign-off process for all AI software components and platform features. Conduct RCA, maintain issues of dashboards, and drive continuous improvement in QA lifecycle. Collaborate with DevOps/ML Ops to monitor model drift, performance anomalies, and post-production behaviors. Documentation & Communication

Prepare detailed QA documents: strategies, test plans, evaluation reports, and execution metrics. Provide clear communication of risks, quality insights, and impact analysis to leadership.

Required Qualifications

12+ years of experience in Software QA. Strong hands-on experience with test automation frameworks and scripting (Python/Java/JavaScript). Experienced in working with microservice-based architecture Working knowledge of AI/ML systems, including datasets, model evaluation, vector stores, RAG, and LLM operations. Architect and manage automation frameworks using Python/Java/JS, Playwright, Selenium, PyTest, Postman, etc. Automated API, microservices, and backend testing for JazzX AI’s cloud architecture running on Azure /AWS. Experience testing distributed cloud systems, APIs, and high-performance backend services. Strong analytical and problem-solving skills with the ability to drive organization-wide quality initiatives.

Preferred Skills

Experience testing LLMs, RAG pipelines, or autonomous AI agents. Familiarity with AI observability tools, logging/monitoring stacks (ELK, Prometheus, Datadog). Exposure security testing, performance/load testing, and compliance (SOC2, GDPR). Ability to operate in a fast-paced, zero-to-one startup environment.

Why Join JazzX AI -

What draws people to JazzX AI is the opportunity to build something truly foundational.

We are at the beginning of a new era — one where enterprise systems will no longer be static tools, but dynamic collaborators that learn, reason, and evolve alongside the people who use them. At JazzX AI, you’ll help build a platform that redefines how work happens in the AGI era.

JazzX AI brings together vision, deep technology, and purpose. This is not about experimenting with AI features; it’s about turning the promise of AGI into practical, auditable, and human-aligned systems that enterprises can trust and rely on at scale. The work here directly impacts productivity, efficiency, and decision-making in complex, real-world environments.

If you’re motivated by building systems that matter — systems that combine intelligence with responsibility — JazzX AI offers the chance to do that work at a deeper level, with real ownership and lasting impact. Show more Show less

Quality AssuranceTest AutomationAI/ML AwarenessLeadershipMicroservice ArchitectureAPI TestingCloud ArchitecturePerformance TestingAutomation FrameworksAnalytical SkillsProblem-SolvingLLM TestingContinuous ImprovementDocumentationCollaborationRelease Managementmulti-locationreview:company

Cookies & analytics consent

We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.

Read how we use data in our Privacy Policy and Terms of Service.