🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Coupa Software, Inc. • pune, Maharashtra, India
Role & seniority: AI Quality Engineer (mid-level, 3–5+ years QA with 1–2+ years in AI/ML systems)
Stack/tools: Google Cloud Platform (Vertex AI, BigQuery, Cloud Functions/Run, Pub/Sub), Google ADK, Python, pytest/unittest, API testing tools; CI/CD and Git
Design and implement AI-specific test strategies for agents built on Google ADK/Vertex AI
Develop/maintain automated test suites and test harnesses for AI agents, including LLM outputs and multi-agent interactions
Validate AI solutions on Vertex AI and ensure responsible AI practices (bias, safety, guardrails) with performance/reliability testing and integration checks
3–5+ years in software QA/testing; 1–2+ years focused on AI/ML or data-intensive apps
Strong understanding of AI/ML fundamentals, LLM behavior, prompt engineering
Experience testing on Google Cloud (Vertex AI, BigQuery, Cloud Functions/Run)
Python for test automation; familiarity with pytest/unittest; API testing
Ability to design test strategies, perform edge-case testing, and analyze defects
CI/CD, version control (Git), and solid communication/documentation skills
Experience with AI agent frameworks (Google ADK, LangChain) and LLM evaluation metrics
Responsible AI testing methods (bias, fairness, explainability, safety)
Load testing and monitoring tools (Locust/JMeter; Cloud Monitoring/Logging)
Containerization and testing in Docker/Cloud R
Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins.
Why join Coupa?
🔹 Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend.
🔹 Collaborative Culture: We value collaboration and teamwork, and our culture is driven by transparency, openness, and a shared commitment to excellence.
🔹 Global Impact: Join a company where your work has a global, measurable impact on our clients, the business, and each other.
Learn more on Life at Coupa blog and hear from our employees about their experiences working at Coupa.
We are seeking a detail-oriented AI Quality Engineer to ensure the quality, reliability, and safety of our generative AI solutions built on Google Cloud's AI ecosystem. This role is a core part of our AI Delivery team, responsible for designing and executing comprehensive testing strategies for AI agents and solutions developed with Google ADK (Agent Developer Kit), Vertex AI, and related Google Cloud services.
This position combines QA expertise with AI-specific testing methodologies, ensuring that our agentic AI solutions meet quality standards, perform reliably in production, and adhere to responsible AI principles. The AI Quality Engineer will partner closely with AI Architects, Agentic AI Developers, and business stakeholders to validate solutions from concept through production deployment within the Google Cloud environment. \n
AI-Specific Test Strategy: Design and implement comprehensive testing strategies for AI agents built with Google ADK and Vertex AI, including functional testing, prompt validation, model behavior testing, and agent orchestration verification.
Automated Testing for AI Systems: Develop and maintain automated test suites for AI agents using Python, Vertex AI APIs, and testing frameworks. Create test harnesses for evaluating LLM outputs, agent responses, and multi-agent interactions.
Vertex AI Quality Assurance: Test and validate AI solutions across the Vertex AI platform including model deployments, endpoint configurations, vector search accuracy, RAG pipeline quality, and integration points with Google Cloud services.
Responsible AI Testing: Implement and execute tests for AI safety, bias detection, fairness metrics, toxicity screening, and compliance requirements using Vertex AI monitoring tools and responsible AI frameworks. Validate guardrails and safety mechanisms.
Performance & Reliability Testing: Conduct performance testing, load testing, and reliability validation for AI agents deployed on Google Cloud Platform. Monitor latency, throughput, cost optimization, and scalability under various conditions.
Integration Testing: Validate integrations between AI agents and enterprise systems including BigQuery, Cloud Functions, Cloud Run, Pub/Sub, and third-party applications. Ensure data flows, API connections, and orchestration logic function correctly.
Test Documentation & Reporting: Create detailed test plans, test cases, and quality metrics specific to AI systems. Document test results, defect reports, and quality trends. Provide clear feedback to development teams on agent behavior and edge cases.
Continuous Improvement: Collaborate with AI Architects and Developers to establish quality standards and testing best practices. Identify patterns in failures, suggest improvements to agent design, and contribute to CI/CD pipeline quality gates.
User Acceptance Support: Facilitate UAT processes with business stakeholders, helping them validate AI agent behavior against requirements and ensuring solutions meet real-world use cases.
\n Coupa complies with relevant laws and regulations regarding equal opportunity and offers a welcoming and inclusive work environment. Decisions related to hiring, compensation, training, or evaluating performance are made fairly, and we provide equal employment opportunities to all qualified candidates and employees.
Please be advised that inquiries or resumes from recruiters will not be accepted.
By submitting your application, you acknowledge that you have read Coupa’s Privacy Policy and understand that Coupa receives/collects your application, including your personal data, for the purposes of managing Coupa's ongoing recruitment and placement activities, including for employment purposes in the event of a successful application and for notification of future job opportunities if you did not succeed the first time. You will find more details about how your application is processed, the purposes of processing, and how long we retain your application in our Privacy Policy.