🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Pivotree • Mumbai, Maharashtra, India
Role & seniority: Level 4 Expert Specialist / QA Lead (primary driver of software quality within R&D; leads QA strategy and projects impacting core metrics)
Stack/tools: Automation: Playwright (preferred), Cypress or Selenium; AI evaluation: DeepEval, Deepchecks; performance: k6, Locust, or JMeter; API/diagnostics: Postman, Insomnia; workflow: JIRA, Zephyr, Bitbucket, CI/CD (GitHub Actions)
Strategic QA leadership: manage QA resources, mentorship, career development, and analyst function
AI/ML and technical innovation: design/implement testing frameworks for LLM outputs and ML performance; pioneer AI-augmented testing tools
Shift-left/process architecture: define QA standards and begin testing during discovery; deliver automated UI/API test suites integrated into CI/CD; data and performance testing at scale
8+ years in complex web QA
Quality governance tools (Sonar, PMD, Checkstyle, FindBugs)
Diagnostic/root-cause analysis
B.Sc. in Engineering/CS or equivalent
Agile QA experience; strong communication; emotional intelligence
Direct experience with LLM/AI-focused testing frameworks
Experience leading QA in fast-moving R&D environments
Familiarity with AI evaluation tooling and AI-augmented testing approaches
Location & work type: Location not specified; work type not specified (assumed full-time in a QA leadership capacity)
Our goal at Pivotree is to help accelerate the future of frictionless commerce. We will help lead this change over the next decade because we believe a future where technology is embedded intimately into all aspects of our everyday lives can benefit everyone and will shape the interactions with the brands we love. We will help shape the future of frictionless commerce by working together with some of the best brands in the world and some of the best people in the industry to leverage converging technologies that will make it possible to accelerate frictionless commerce faster than ever.
Pivotree provides services focused on the design, implementation, management, and maintenance of complex ecommerce solutions for large enterprises. We provide the technical skills necessary to enable the effective use of technologies combined with the business context to leverage a solution to solve our clients' business challenges. We strive to fill the gaps in available technology with our own IP to reduce the barriers to adoption.
We enable inclusive, immersive and highly personalized experiences for our clients and their customers. We build our products with a view to productizing and scaling technology to lower the costs and reduce the risks of implementing and managing our integrated solutions. Each of our solutions starts with reliable and reputable e-commerce and MDM platforms, which run on enterprise grade infrastructure that are customized to meet a variety of client needs, situations, and budgets. Over the next 10 years we will add new categories and capabilities that will define frictionless commerce ecosystems.
This is a journey of technology acceleration combined with consumer readiness and adoption. We are looking for people capable of adapting relentlessly to the rapidly evolving world around us.
Role Overview As a Level 4 Expert Specialist , you will be the primary driver of software quality within our dynamic R&D team. You will exhibit complete mastery of your specialization, anticipating business needs and leading projects that directly impact our core metrics. This role requires a visionary leader who can balance the pioneering of testing methodologies for Large Language Models (LLMs) with the disciplined oversight of the entire project lifecycle. As the QA Lead, you will own all aspects of QA status and collaborate closely with the Development Lead, Project Manager, and Key Customer Stakeholders.
CORE RESPONSIBILITIES
● Strategic QA Leadership: Manage QA resources, overseeing team development, mentorship, and career growth pathways. You will lead the Analyst function, training team members and delegating tasks to those best suited to complete them.
● AI/ML & Technical Innovation: Design and implement testing frameworks for LLM outputs and Machine Learning performance. You will pioneer new methodologies using AI-augmented testing agents and evaluation tools like DeepEval or Deepchecks.
● Process Architecture (Shift Left): Define and implement QA standards, incorporating "Shift Left" methodologies by starting the testing process during the discovery phase.
● Technical Ownership: Lead the creation of automated testing suites for UI and API-based systems, ensuring they are integrated into CI/CD pipelines for high-velocity delivery.
● Data & Performance at Scale: Develop specialized processes for data normalization and verification of large customer delivery files. Lead performance and reliability testing for complex data sets.
● Stakeholder & Project Management: Collaborate with Development Leads and Project Managers to provide accurate estimates and ensure project delivery is on time and within budget.
REQUIREMENTS AND SKILLS
TECHNICAL EXPERTISE
● Experience: 8+ years in complex web-based software development QA.
● Quality Governance: Expertise in quality tools such as Sonar, PMD, Checkstyle, and FindBugs.
● Diagnostic Skills: High proficiency in log files and root-cause investigation.
● Education: B.Sc. in Engineering, Computer Science, or equivalent. LEADERSHIP & SOFT SKILLS
● Emotional Intelligence: Demonstrated ability to manage your own emotions and those of others in a high-pressure R&D environment.
● Communication: Excellent English verbal and written skills to translate complex functional requirements into clear test scenarios.
● Agile Mindset: Deep experience performing QA functions within an Agile development methodology.
● Organizational Mastery: Strong ability to monitor project progress, report on quality trends, and ensure the team follows best practices.
MODERN TOOLSET & TECHNICAL STACK
● Automation: Playwright (preferred), Cypress, or Selenium.
● AI Evaluation: Tools for LLM validation (e.g., DeepEval, Deepchecks) and AI-augmented testing agents.
● Performance & Data: k6, Locust, or JMeter for high-scale performance testing.
● API & Grey-Box Testing: Postman, Insomnia, or similar diagnostic tools.
● Ecosystem: JIRA, Zephyr, Bitbucket, and modern CI/CD tools (e.g., GitHub Actions).
● Diagnostics: High proficiency in log files and other diagnostic aids to identify root causes.
● A Root-Cause Investigator: Curious with a genuine desire to get to the root cause of complex technical issues.
● A Practical Thinker: A straightforward and practical thinker able to multi-task and prioritize test activities accordingly.
● Detail-Oriented & Driven: Meticulous in ensuring requirements traceability and engaged in getting things done. We are a dynamic and diverse group, and we recognize that experience comes in many shapes and sizes. If you “just about” meet the requirements we’ve laid out and are excited about the future of AI and R&D, we want to hear from you and encourage you to apply. Pivotree is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive and accessible workplace.