Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.

EPAM Systems • Armenia
Role & seniority: Senior Automation Tester (AI/ML testing focus)
Stack/tools: Python; AI/ML concepts; automated testing frameworks; Microsoft Azure; CI/CD; version control; monitoring/reporting; cross-functional collaboration
Design and maintain automated testing processes for AI/ML solutions; build automated test pipelines for LLMs and ML models
Create/execute test cases for AI-based systems; verify integration with enterprise platforms; monitor performance, accuracy, reliability in production
Implement/maintain CI/CD pipelines for automated testing; analyze results; document procedures; provide quality feedback; stay current with AI testing tools
3+ years in testing AI-based solutions; strong AI/ML knowledge
Proficient Python for automated testing; Azure cloud experience
Knowledge of automated testing frameworks/tools; QA processes, CI/CD, version control; detail-oriented; cross-functional collaboration; strong English (B2+)
Experience with AI testing tools/frameworks; understanding of monitoring/telemetry for AI systems; familiarity with LLM/ML model evaluation
Location & work type: Fully remote within Armenia (remote option); collaboration with Yerevan or Gyumri offices available; potential for short-term international work/travel; relocation opportunities exist within the company network
We are seeking a Senior Automation Tester to join our AI product development team, focusing on automated testing of AI and machine learning solutions. You will collaborate with developers, data scientists, and product managers to ensure AI features meet business and technical requirements. Apply now to contribute to innovative AI testing processes and quality assurance. Responsibilities Design and maintain automated testing processes for AI and ML solutions Build automated test pipelines for large language models and machine learning models Create and execute test cases for AI-based systems Verify system integration with enterprise platforms Measure performance, accuracy, and reliability of AI components in production Set up monitoring and reporting systems to detect issues early Collaborate closely with developers, data scientists, and product managers to align testing with requirements Implement and maintain CI/CD pipelines for automated testing Ensure adherence to QA processes and version control standards Analyze test results and identify areas for improvement Document testing procedures and outcomes Provide feedback to improve AI product quality and reliability Stay updated with latest AI testing tools and frameworks Requirements Proven experience in testing AI-based solutions (minimum 3 years) Strong expertise in AI technologies and machine learning concepts Proficient programming skills in Python for automated testing Experience with Microsoft Azure cloud environment Knowledge of automated testing frameworks and tools Understanding of QA processes, CI/CD pipelines, and version control systems Detail-oriented mindset with proactive problem-solving skills Ability to collaborate effectively in cross-functional teams Strong communication skills in English (B2 level or higher) We offer We connect like-minded people Delivering innovative solutions to industry leaders, making a global impact Enjoyable working environment, whether it is the vibrant office or the comfort of your home Opportunity to work abroad for up to two months per year Relocation opportunities within our offices in 55+ countries Corporate and social events We invest in your growth Leadership development, career advising, soft skills and well-being programs Certifications, including GCP, Azure and AWS Unlimited access to LinkedIn Learning and Get Abstract Free English classes with certified teachers We cover it all Participation in the Employee Stock Purchase Plan Monetary bonuses for engaging in the referral program Comprehensive medical & family care package Four trust days per year for personal needs Discounts for fitness clubs Benefits package (hotels, restaurants, stores and services) Immerse yourself in our collaborative culture by working on-site at our well-equipped offices in Yerevan or Gyumri. This is a fully remote position that offers you the flexibility to work from any location in Armenia, whether it's your home or well-equipped offices in Yerevan or Gyumri. EPAM Armenia is a team of talented innovators united by a passion for technology. In 2014, we opened our first office in Yerevan, and now we have a second engineering hub in Gyumri. We've built a continuously learning organization that helps its employees rapidly advance their careers. Here you will work with the world's industry leaders, support impactful projects using the latest technologies, collaborate with multi-national teams, and have access to a wide variety of development opportunities. Show more Show less