Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
SIXT • Lisbon, Portugal
Salary: 000 cooperation pa
Role & seniority: Customer Service Agentic AI QA Engineer (m/f/d); several years in software QA/Test Engineering; mid-to-senior level role focused on AI and agentic automation.
Stack/tools: Python automation; REST API testing; AI/ML testing (LLMs, chatbots, multi-agent systems); agentic frameworks (e.g., LangChain); AWS AgentCore; LLMOps/MLOps concepts; CI/CD integration; test data and synthetic scenarios.
Design and execute end-to-end test plans for customer-service virtual agents (voice, chat, email) and validate autonomous workflows (e.g., bookings, billing, damages).
Define/monitor AI quality metrics (resolution rate, deflection, CSAT, safety violations); develop test data and edge-case scenarios; assess reasoning traces, tool-use, and memory usage.
Implement/improve automated testing frameworks for conversational flows, APIs/integrations; contribute to CI/CD pipelines; perform bias, fairness, and safety testing; document defects and insights.
Proven QA/testing fundamentals (functional, regression, integration, performance).
Hands-on AI/ML testing experience (LLMs, chatbots, recommender systems); knowledge of multi-agentic systems and agentic frameworks.
Python automation; REST API testing; understanding of LLMOps/MLOps (versioning, monitoring, rollback).
Customer-service process awareness; strong analytical/documentation/communication; English fluency (German or other languages a plus).
Nice
Company Description Job Description As a Customer Service Agentic AI QA Engineer (m/f/d), you ensure that SIXT’s virtual agents and Generative-AI–powered workflows deliver reliable, safe, and delightful support across all customer service channels. You design and run intelligent test strategies for LLM- and agent-based systems, combining classic QA skills with a deep understanding of agentic automation, conversational AI, and customer service KPIs. YOUR ROLE AT SIXT Design and execute end-to-end test plans for customer service virtual agents (voice, chat, email). Build and maintain agentic AI test suites validating autonomous workflows (e.g., booking changes, billing, damages). Define and monitor AI quality metrics such as resolution rate, deflection, CSAT, and safety violations. Develop test data and synthetic scenarios for edge cases, ambiguous queries, and multilingual requests. Evaluate agent behavior through reasoning traces, tool-use decisions, and memory usage. Implement and improve automated testing frameworks for conversational flows, APIs, and integrations. Contribute to LLMOps / CI/CD pipelines to automatically detect regressions. Perform bias, fairness, and safety testing in line with SIXT policies and regulatory expectations. Collaborate with cross-functional teams to refine requirements and acceptance criteria. Document defects, test results, and insights clearly for stakeholders. YOUR SKILLS MATTER Foundations Several years of experience in software QA / test engineering. Strong understanding of testing principles: functional, regression, integration, performance. AI Testing Hands-on experience testing AI or ML systems such as LLM chatbots or recommendation engines. Familiarity with key concepts of multi-agentic systems, agentic frameworks (e.g., LangChain), AWS AgentCore. Automation Scripting skills in Python and experience with REST API testing.
LLMOps: Understanding of LLMOps / MLOps: versioning, monitoring, rollback strategies. Customer Focus Experience or interest in customer service processes and KPIs. Communication Excellent analytical, documentation, and communication skills. Fluency in English; German or additional languages a plus. WHAT WE OFFER Generous Time Off Enjoy 28 days of vacation, an additional day off for your birthday, and 1 volunteer day per year Work-Life Balance & Flexibility Benefit from a hybrid working model, flexible working hours, and no dress code Great Employee Benefits Access discounts on SIXT rent, share, ride, and SIXT+, along with partner discounts Training & Development Participate in training programs, external conferences, and internal dev & tech talks designed for your personal growth and development Health & Well-being Private health insurance to support your well-being Additional Perks Enjoy the Coverflex advantage system to enhance your employee experience Additional Information
Legal Entity: Sixt Research Development Services, Lda.