🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Kavak GCC • Punjab, Pakistan
Salary: AED 3,675 / month
Role & seniority: QA / Test Engineer for conversational AI; 3+ years of QA/testing experience focused on conversational systems
Stack/tools: LangChain, LangGraph, prompt-driven workflows; voice tools (Twilio, Dialogflow, Amazon Lex, Synthflow); testing tools (Postman, Playwright, pytest, JMeter); NLP testing concepts; optional: LangSmith, Promptfoo, TruLens; real-time TTS/STT (nice-to-have)
Design and execute test plans for voice and chat AI agents
Perform load testing, latency measurement, barge-in handling; test flows across LLMs/tools
Build/maintain automated regression tests; evaluate intent accuracy and NLP robustness; report bugs and track fixes
3+ years QA/testing in conversational AI
Familiarity with LangChain/LangGraph or prompt-driven workflows
Experience with voice automation tools
Strong testing tools proficiency (Postman, Playwright, pytest, JMeter)
NLP testing knowledge (intent/slot recognition, confusion matrix, false positives/negatives)
Excellent debugging, test documentation, and bug reporting
Experience with real-time voice TTS/STT, barge-in, silence detection
Familiarity with OpenAI/Claude/Gemini or other LLMs
QA automation in CI/CD, conversational analytics, or prompt-eval tools (LangSmith, Promptfoo, TruLens)
Domain knowledge in automotive, e-commerce, or support systems
Arabic language testing
Location & work type: Not specifie
Simulate edge cases: noisy environments, overlapping speech, disconnections, multilingual input. Report bugs, behavioral inconsistencies, hallucinations, and voice UX issues. Monitor and interpret analytics, call logs, response latencies, prompt token usage, etc. Collaborate closely with engineers and product leads to prioritize fixes.
Requirements
Experience with voice automation tools: Twilio, Dialogflow, Amazon Lex, or Synthflow. Strong knowledge of testing tools (Postman, Playwright, pytest, JMeter, etc.).
Understanding of NLP testing: intent/slot recognition, confusion matrix, false positives/negatives. Excellent debugging, test documentation, and bug reporting skills.
Nice to Have Experience testing systems with real-time voice TTS/STT, barge-in, and silence detection.
Familiarity with LLM-based applications: OpenAI, Claude, Gemini, etc.
Hands-on with QA automation: CI/CD test suites, conversational analytics, or prompt eval tools like LangSmith, Promptfoo, or TruLens. Knowledge of automotive, e-commerce, or support systems. Arabic language testing experience. Do you want to be part of this story? Apply now!