🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Premier NX • Lahore, Punjab, Pakistan
Role & seniority: AI Agent Testing Specialist (2+ years QA/Software testing; mid-level)
Stack/tools: Conversational AI (ChatGPT, Dialogflow, Lex, etc.); IVR/CCaaS (Amazon Connect, Twilio, 3CX); test planning, scenario testing, automation; Postman/API testing; Python (preferred)
Design and execute scenario-based tests to evaluate AI agent behavior, accuracy, and naturalness in simulated calls
Test call flows, intent recognition, response accuracy, and escalation handling; document issues and user-experience gaps
Collaborate with developers, AI trainers, and QA to refine conversational logic; analyze logs/transcripts; support AI fine-tuning and validation; advance test plans and automation
Must-have skills: 2+ years in software/QA testing (AI/IVR/CCaaS); familiarity with conversational AI systems; test planning and quality documentation; strong analytical and communication abilities; user-centric evaluation mindset; collaborative, cross-functional work style
Nice-to-haves: Experience with AI prompt design or conversational flow building; background in speech recognition, NLP, or voice app testing; exposure to Python, Postman, or API testing tools
Location & work type: Not specified in the role description; training provided; on-site vs. remote unclear.
Were looking for a skilled and detail-oriented AI Agent Testing Specialist to help ensure the quality and performance of our AI-driven voice and conversational agents. This role goes beyond traditional software testing — youll be evaluating how AI behaves, responds, and performs in real-world call scenarios across our communication platforms.
If you enjoy testing interactive systems, analyzing conversational flows, and helping shape how intelligent virtual agents interact with customers, this role is for you.
Design and execute scenario-based test cases to evaluate AI agent behavior, accuracy, and naturalness in simulated call environments. Test AI call flows, intent recognition, response accuracy, and escalation handling. Identify and document behavioral issues, misclassifications, or poor user experiences. Collaborate with developers, AI trainers, and QA teams to refine conversational logic and performance. Analyze call logs, transcripts, and AI decision paths to suggest improvements. Support the fine-tuning and validation of AI responses based on training data and feedback. Contribute to continuous test automation and test plan improvements.
2+ years of experience in software or QA testing, preferably with AI, IVR, or contact center solutions (CCaaS, Amazon Connect, Twilio, 3CX, etc.) Familiarity with conversational AI systems (ChatGPT, Dialogflow, Lex, or similar). Understanding of test planning, scenario testing, and quality documentation. Strong analytical and communication skills. Ability to think from the end-user perspective and evaluate how interactions feel. Comfortable working in collaborative, cross-functional environments.
Experience with AI prompt design or conversational flow building. Background in speech recognition, NLP, or voice application testing. Exposure to Python, Postman, or API testing tools.
We provide hands-on training on our specific AI testing platform, tools, and process.
Candidates with a strong QA foundation and a willingness to learn are highly encouraged to apply.
Market-competitive salary Career growth opportunities Learning & development programs On-the-job training Medical Coverage (IPD) Life Insurance Paid Leaves (Annual, Casual, Sick, Marriage, Maternity, Paternity, Hajj, Bereavement) Provident Fund Employee Old Age Benefits (EOBI) Employee engagement & wellness initiatives Show more Show less