🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
EPAM Systems • Georgia, United States
Role & seniority: Senior Automation Tester, AI/ML-focused QA
Stack/tools: Python for automation; AI/ML testing concepts; Microsoft Azure; automated testing frameworks/tools; CI/CD; QA processes and version control
Design and maintain automated testing processes for AI/ML solutions and build automated test pipelines for LLMs and ML models
Create/execute test cases, verify system integration, and monitor performance, accuracy, and reliability in production
Implement CI/CD pipelines for automated testing; document procedures; analyze results; provide feedback to improve AI quality; stay current with tooling
3+ years testing AI-based solutions; solid AI/ML concepts
Proficient Python for automated testing
Azure cloud experience; knowledge of automated testing frameworks/tools
Understanding of QA processes, CI/CD, and version control; strong English (B2+); detail-oriented with problem-solving and cross-functional collaboration
Experience with monitoring/reporting in production; test documentation practices
AI testing tool/framework familiarity; certifications (e.g., GCP/AWS/Azure)
Ability to work with developers, data scientists, product managers; proactive communication
Location & work type: Remote work from anywhere in Georgia; option to work from Tbilisi or Batumi offices or coworking spaces in Kutaisi; potential for occasional travel and relocation opportunities within t
We are seeking a Senior Automation Tester to join our AI product development team, focusing on automated testing of AI and machine learning solutions. You will collaborate with developers, data scientists, and product managers to ensure AI features meet business and technical requirements. Apply now to contribute to innovative AI testing processes and quality assurance. Experience the freedom of remote work from anywhere in Georgia, whether from the comfort of your home, our modern offices in Tbilisi and Batumi or a coworking space in Kutaisi. Responsibilities Design and maintain automated testing processes for AI and ML solutions Build automated test pipelines for large language models and machine learning models Create and execute test cases for AI-based systems Verify system integration with enterprise platforms Measure performance, accuracy, and reliability of AI components in production Set up monitoring and reporting systems to detect issues early Collaborate closely with developers, data scientists, and product managers to align testing with requirements Implement and maintain CI/CD pipelines for automated testing Ensure adherence to QA processes and version control standards Analyze test results and identify areas for improvement Document testing procedures and outcomes Provide feedback to improve AI product quality and reliability Stay updated with latest AI testing tools and frameworks Requirements Proven experience in testing AI-based solutions (minimum 3 years) Strong expertise in AI technologies and machine learning concepts Proficient programming skills in Python for automated testing Experience with Microsoft Azure cloud environment Knowledge of automated testing frameworks and tools Understanding of QA processes, CI/CD pipelines, and version control systems Detail-oriented mindset with proactive problem-solving skills Ability to collaborate effectively in cross-functional teams Strong communication skills in English (B2 level or higher) We offer We connect like-minded people Delivering innovative solutions to industry leaders, making a global impact Enjoyable working environment, whether it is the vibrant office or the comfort of your own home Opportunity to work abroad for up to two months per year Relocation opportunities within our offices in 55+ countries Corporate and social events We invest in your growth Leadership development, career advising, soft skills and well-being programs Certifications, including GCP, Azure and AWS Unlimited access to LinkedIn Learning and Get Abstract Free English classes with certified teachers We cover it all Participation in the Employee Stock Purchase Plan Monetary bonuses for engaging in the referral program Comprehensive medical & family care package Five trust days per year (sick leave without a medical certificate) Benefits package (sports activities, a variety of stores and services) EPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, clients, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow. Show more Show less