🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Gemini Solutions Pvt Ltd • Gurugram, Haryana, India
Role & seniority: QA Engineer, 4+ years experience; end-to-end quality assurance for AI-powered applications.
Stack/tools: Manual & automation testing; Selenium, Playwright, PyTest; CI/CD integration; Git; AI/LLM quality evaluation; GenAI test design; SDLC/QA methodologies.
Own QA lifecycle for AI-driven features, ensuring accuracy, reliability, safety, and performance across releases.
Manual testing (test plans/cases, functional/UI/integration/regression/exploratory testing) and end-to-end user journeys.
Automation development/maintenance; build frameworks, automate AI workflows where feasible, and support production defect analysis.
2–7 years of hands-on QA (manual + automation).
Strong QA methodology, SDLC, and defect lifecycle understanding.
Experience testing AI/ML applications; hands-on test automation; Git; Agile.
Excellent analytical, communication, and problem-solving abilities.
Experience evaluating LLM outputs (factuality, hallucinations) and developing evaluation datasets/golden tests.
Regression testing for prompt changes, dataset updates, or model upgrades; improving automation quality and coverage.
Participation in sprint planning, design reviews, and root-cause analysis.
Location & work type: not specified.
POSITION SUMMARY We are seeking a skilled QA Engineer with 4+ years of experience to drive end-to-end quality assurance for AI-powered applications. The ideal candidate will have strong foundations in both manual and automation testing, along with hands-on exposure to evaluating LLM-based systems. This role will own the quality lifecycle for AI-driven features, ensuring accuracy, reliability, safety, and performance across releases.
Manual Testing
Create and execute test plans, test cases, and scenarios.
Perform functional, UI, integration, regression, and exploratory testing for AI and non-AI modules. • Validate end-to-end user journeys.
Log defects with clear reproduction steps and collaborate with engineering teams for triage and resolution. Automation Testing
Develop and maintain automated test suites. • Build and enhance automation frameworks using Selenium, Playwright, or PyTest.
Automate test execution for AI workflows where feasible.
Integrate automated tests into CI/CD pipelines for continuous validation.
Improve automation code quality, reliability, and coverage. AI / LLM Quality Assurance • Test GenAI applications powered by LLMs.
Evaluate LLM outputs for correctness, factual accuracy, and hallucinations.
Develop structured evaluation datasets and golden test cases.
Perform regression testing for prompt changes, dataset updates, and model upgrades. Quality Governance • Ensure adherence to QA processes and documentation standards.
Participate in sprint planning, requirement discussions, and design reviews.
Support root-cause analysis for production defects and contribute to preventive actions.
2–7 years of hands-on QA experience
(manual and automation).
Strong understanding of QA methodologies, SDLC, and defect lifecycle.
Experience testing AI/ML applications.
Hands-on experience with test automation tools
Experience with Git and Agile methodologies.
Strong analytical, communication, and problem-solving skills.