Full Description

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE We are looking for a Manual QA Engineer to ensure the quality and reliability of web applications and AI-driven features in an Agile environment. This role is critical in validating user experiences, APIs, and LLM-powered functionality, safeguarding accuracy, compliance, and performance across releases. You’ll collaborate closely with engineering to strengthen testing practices, contribute to CI/CD quality gates, and elevate standards in both traditional and AI-focused QA processes.

WHAT YOU WILL DO

• Perform manual testing of web applications to identify bugs, glitches, and inconsistencies;

• Develop, maintain, and execute detailed manual test cases based on product requirements and specifications;

• Perform thorough cross-browser UI testing to ensure consistent behavior across Chrome, Firefox, Safari, Edge, etc.;

• Validate AI-generated test cases, summaries, and recommendations produced by integrated LLMs to ensure accuracy, completeness, and alignment with project requirements;

• Design and execute test scenarios to verify AI behavior, including prompt–response consistency, contextual relevance, and deterministic vs. non-deterministic outputs;

• Evaluate AI model quality using defined acceptance metrics (precision, recall, hallucination rate, duplication rate);

• Conduct manual API testing to validate request/response accuracy, error handling, and integration;

• Use TestRail to create, manage, and track test plans, test cases, and test execution results;

• Use Jenkins CI/CD pipelines;

• Report and document defects clearly using the bug tracking system (JIRA);

• Participate in daily stand-ups, sprint planning, and other Agile team meetings;

• Review user stories and acceptance criteria to understand the scope of testing;

• Estimate own tasks, report on risks to the team lead;

• Collaborate with developers and other QA team members to reproduce issues and verify fixes;

• Maintain and update test documentation as needed.