🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
OVA.Work • Alpharetta, Georgia, United States
Role & seniority: AI QA Engineer; mid-to-senior level (3+ years QA with at least 1 year in AI/ML testing).
Stack/tools: Python (preferred) or Java; RESTful APIs; ML frameworks (TensorFlow, PyTorch, scikit-learn); automated testing frameworks (PyTest, Selenium, Robot Framework); data pipelines; experience with MLflow/Kubeflow/Airflow (nice-to-have); cloud platforms (AWS/GCP/Azure) (nice-to-have).
Design, develop, and execute test plans and test cases for AI/ML-based products; validate models for accuracy, robustness, fairness, and performance.
Test data pipelines, feature engineering processes, and model integration with production systems; develop automated test scripts for model APIs, training pipelines, and inference workflows.
Collaborate with data scientists, ML engineers, and software developers; implement monitoring/alerting for deployed AI systems; perform regression testing and ensure compliance with data privacy, security, and responsible AI standards.
Bachelor’s or Master’s in CS/Engineering or related field
3+ years QA experience, 1+ year in AI/ML testing
Strong QA methodologies, tools, and processes
Hands-on with automated testing frameworks (PyTest, Selenium, Robot Framework)
Familiarity with ML frameworks (TensorFlow, PyTorch, scikit-learn)
API/microservice testing; proficiency in Python (preferred) or Java; strong problem-solving/detail orientation
About The Role
We are looking for a highly skilled AI QA Engineer to join our team and ensure the quality, reliability, and performance of AI/ML-driven applications. The ideal candidate will have a strong background in software testing, a solid understanding of AI/ML workflows, and experience with automated testing frameworks. This role will focus on validating AI models, testing data pipelines, and ensuring the overall robustness of intelligent systems before deployment.
Key Responsibilities
Design, develop, and execute test plans and test cases for AI/ML-based products. Validate AI models for accuracy, fairness, robustness, and performance. Test data pipelines, feature engineering processes, and model integration with production systems. Develop automated test scripts for model APIs, training pipelines, and inference workflows. Collaborate with data scientists, ML engineers, and software developers to identify and resolve quality issues. Implement monitoring and alerting mechanisms for deployed AI systems. Conduct regression testing to ensure changes do not degrade model performance. Ensure compliance with data privacy, security, and responsible AI standards.
Required Qualifications
Bachelor's or Master's degree in Computer Science, Engineering, or related field. 3+ years of experience in software quality assurance, with at least 1 year in AI/ML testing. Strong knowledge of QA methodologies, tools, and processes. Hands-on experience with automated testing frameworks (e.g., PyTest, Selenium, Robot Framework). Familiarity with ML frameworks (TensorFlow, PyTorch, Scikit-learn). Experience testing RESTful APIs and microservices. Proficiency in Python (preferred), Java, or other programming languages. Strong problem-solving skills and attention to detail.
Preferred Qualifications
Experience with ML model validation, monitoring, and drift detection. Knowledge of MLOps tools (MLflow, Kubeflow, Airflow, CI/CD for ML). Understanding of bias, fairness, and explainability in AI systems. Exposure to cloud platforms (AWS, GCP, Azure) for AI/ML deployment. ISTQB or equivalent certification in QA.
What We Offer
Competitive salary and benefits package. Opportunity to work on cutting-edge AI products. Collaborative, innovative, and growth-focused work environment. Professional development and learning opportunities.