**Role & seniority: ** AI QA Engineer (SDET/QA Automation), 4–6 years; reports to Director, QA Engineering

**Location & work type: ** Bengaluru (Bangalore); (work type not specified)

**Stack/tools: **

Java (mandatory), basic Python
Selenium WebDriver, RestAssured, TestNG
Automation frameworks (Hybrid / POM-based)
API/UI/backend, microservices & event-driven systems
Jenkins, Maven, Git/Bitbucket
Test reporting: Allure (or similar)
Data: SQL, BigQuery, JSON pipeline validation
AI/LLM testing: prompt validation, response scoring/comparison; NLP/LLM models (e.g., BERT, GPT, QWEN, Gemini)
Top 3 responsibilities:
- Build/maintain scalable automation frameworks for UI, API, and backend systems
- Execute end-to-end testing for AI/ML pipelines and LLM/NLP applications (including LLM output validation)
- Ensure quality via data validation (SQL/BigQuery) and CI/CD integration of automated regression/smoke/e2e tests
Must-have skills:
- QA automation with Selenium + RestAssured + TestNG
- Strong Java; experience with API/UI/microservices testing
- Experience validating NLP/LLM outputs (prompt/output evaluation, scoring, model comparison)
- SQL + BigQuery; JSON/data pipeline validation; understanding of event-driven systems (Pub/Sub)
- Jenkins/Maven/Git and CI/CD test reporting integrat

Full Description

Title: QA Engineer

Reporting to: Director, QA Engineering

Location: Bengaluru (Bangalore)

Opportunity

We are seeking a skilled AI QA Engineer with 4–6 years of experience in test automation and a strong focus on validating AI/ML and LLM-based systems. The ideal candidate will have hands-on expertise in automation frameworks, API/UI testing, and experience in validating NLP/LLM models across complex, data-driven applications.
Key Responsibilities
Design, develop, and maintain scalable automation frameworks for UI, API, and backend systems
Perform end-to-end testing of AI/ML pipelines, including NLP and LLM-based applications
Validate LLM outputs using techniques such as prompt validation, response scoring, and model comparison
Build and execute test strategies for microservices and event-driven architectures
Conduct data validation across systems using SQL/BigQuery and ensure data accuracy in pipelines
Automate regression, smoke, and end-to-end test suites to improve coverage and efficiency
Integrate automated tests into CI/CD pipelines using Jenkins or similar tools
Collaborate with developers, data scientists, and product teams to ensure high-quality AI solutions
Analyze defects, identify root causes, and ensure timely resolution
Continuously improve test frameworks, tools, and processes
Required Skills & Qualifications
Automation & Testing
Strong experience in Selenium WebDriver, RestAssured, TestNG
Expertise in API Testing, UI Testing, and Microservices Testing
Experience in building Hybrid/POM-based automation frameworks
Programming
Proficiency in Java (mandatory)
Basic working knowledge of Python
AI / ML / LLM Testing
Experience testing NLP/LLM models (e.g., BERT, GPT-based models, QWEN, Gemini)
Knowledge of NER validation, prompt testing, and output evaluation techniques
Exposure to model validation, scoring mechanisms, and dataset validation
Data & Cloud
Strong SQL skills with experience in BigQuery or similar platforms
Understanding of event-driven systems (Pub/Sub or similar)
Experience in validating JSON-based data pipelines
DevOps & Tools
Experience with Jenkins, Maven, Git/Bitbucket
Knowledge of CI/CD pipeline integration and test reporting (Allure or similar)
Good to Have
Experience in Healthcare, OTT, or E-commerce domains
Exposure to EMR/EHR systems or clinical data validation
Knowledge of UMLS, CUI mapping, or healthcare NLP concepts
Experience with mobile testing (Appium)
Experience
4–6 years of experience in QA Automation / SDET roles
Hands-on experience in AI/ML or LLM validation is highly preferred
Education
Bachelor’s degree in Engineering, Computer Science, or related field

About Get Well

Now part of the SAI Group family, Get Well is redefining digital patient engagement by putting patients in control of their personalized healthcare journeys, both inside and outside the hospital. Get Well is combining high-tech AI navigation with high-touch care experiences driving patient activation, loyalty, and outcomes while reducing the cost of care. For almost 25 years, Get Well has served more than 10 million patients per year across over 1,000 hospitals and clinical partner sites, working to use longitudinal data analytics to better serve patients and clinicians. AI innovator SAI Group led by Chairman Romesh Wadhwani is the lead growth investor in Get Well. Get Well’s award-winning solutions were recognized again in 2024 by KLAS Research and AVIA Marketplace. Learn more at Get Well and follow-us on LinkedIn and Twitter.
Get Well is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age or veteran status.

About SAI Group

SAIGroup commits to $1 Billion capital, an advanced AI platform that currently processes 300M+ patients, and 4000+ global employee base to solve enterprise AI and high priority healthcare problems. SAIGroup - Growing companies with advanced AI; https://www.cnbc.com/2023/12/08/75-year-old-tech-mogul-betting-1-billion-of-his-fortune-on-ai-future.html

Bio of our Chairman Dr. Romesh Wadhwani: Team - SAIGroup (Informal at Romesh Wadhwani - Wikipedia) TIME Magazine recently recognized Chairman Romesh Wadhwani as one of the Top 100 AI leaders in the world - Romesh and Sunil Wadhwani: The 100 Most Influential People in AI 2023 | TIME