Full Description

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE We are looking for a Manual QA Engineer to ensure the quality and reliability of web applications and AI-driven features in an Agile environment. This role is critical in validating user experiences, APIs, and LLM-powered functionality, safeguarding accuracy, compliance, and performance across releases. You’ll collaborate closely with engineering to strengthen testing practices, contribute to CI/CD quality gates, and elevate standards in both traditional and AI-focused QA processes.

WHAT YOU WILL DO

• Perform manual testing of web applications to identify bugs, glitches, and inconsistencies;

• Develop, maintain, and execute detailed manual test cases based on product requirements and specifications;

• Perform thorough cross-browser UI testing to ensure consistent behavior across Chrome, Firefox, Safari, Edge, etc.;

• Validate AI-generated test cases, summaries, and recommendations produced by integrated LLMs to ensure accuracy, completeness, and alignment with project requirements;

• Design and execute test scenarios to verify AI behavior, including prompt–response consistency, contextual relevance, and deterministic vs. non-deterministic outputs;

• Evaluate AI model quality using defined acceptance metrics (precision, recall, hallucination rate, duplication rate);

• Conduct manual API testing to validate request/response accuracy, error handling, and integration;

• Use TestRail to create, manage, and track test plans, test cases, and test execution results;

• Use Jenkins CI/CD pipelines;

• Report and document defects clearly using the bug tracking system (JIRA);

• Participate in daily stand-ups, sprint planning, and other Agile team meetings;

• Review user stories and acceptance criteria to understand the scope of testing;

• Estimate own tasks, report on risks to the team lead;

• Collaborate with developers and other QA team members to reproduce issues and verify fixes;

• Maintain and update test documentation as needed.

MUST HAVES

• 2+ years of experience with manual testing;

• Basic understanding of methodologies and SDLC and STLC (Software Development and Testing Life Cycle) models;

• Knowledge of Testing and Quality Assurance Processes;

• Strong experience with Test Design activities to cover a set of product requirements;

• Knowledge of Test Design techniques;

• Knowledge of testing methodologies;

• Defect analysis skills and the ability to write detailed and useful defect reports with expected defect-fixing outcomes;

• Experience with Postman (API testing) and Browser developer tools;

• Experience with UI testing;

• Understanding of LLM evaluation principles, including prompt engineering, output validation, and model fine-tuning cycles;

• Familiarity with AI/ML concepts, APIs, and frameworks (e.g., OpenAI API, Azure OpenAI, LangChain);

• Knowledge of data protection and compliance standards for AI systems (GDPR, zero-data retention, PII anonymization);

• Experience with TestRail as a Test Management system (as a user, test execution is required);

• Basic understanding of CI/CD process;

• Upper-intermediate English level.

NICE TO HAVES

• Experience with SSO testing;

• Experience in Performance or Load.

PERKS AND BENEFITS

Professional growth: Mentorship, TechTalks, and personalized growth roadmaps.

Competitive compensation: USD-based pay with education, fitness, and team activity budgets.

Exciting projects: Modern solutions with Fortune 500 and top product companies.

Flextime: Flexible schedule with remote and office options.

Meet Our Recruitment Process

It includes main stages

• Application → Coding Challenge → Video Interview → Technical Interview or Interview with the Hiring Manager(s).
• Each step helps us understand your skills and overall fit.
• If it’s a match, you’ll receive an offer.