TAWANTECH logo

AI Quality Assurance Engineer

TAWANTECH • Riyadh, Riyadh Region, Saudi Arabia

onsitefull-time
Posted Oct 6, 2026

**Role & seniority: ** AI Quality Assurance Engineer (5+ years), full-time

**Stack/tools: **

  • Languages: Python

  • Testing: automated testing frameworks; regression/integration/functional/performance testing; CI/CD integration

  • Data: SQL; data validation/integrity testing; data quality checks

  • APIs/Platforms: APIs; cloud platforms; version control

  • ML Ops/Monitoring: ML evaluation metrics; production model monitoring; drift detection

  • Top 3 responsibilities:

    • Develop/execute QA & testing strategies across AI/ML models, data pipelines, and AI applications

    • Validate model/data quality (accuracy, consistency, robustness, performance) and test outputs for bias/hallucinations/reliability

    • Implement automated testing and quality gates for deployment; monitor production for drift and report issues

  • Must-have skills:

    • 5+ years in QA, AI/ML testing, software testing, or data quality

    • Strong understanding of AI/ML lifecycle and model evaluation/monitoring

    • Python-based automated testing and CI/CD integration

    • SQL and data validation/integrity testing

    • APIs/cloud/version control experience; strong analytical and communication skills

  • Nice-to-haves:

    • Experience with model governance, auditability, and security/regulatory compliance

    • Extensive knowledge of QA documentation (defects, risks, remediation) and collaboration across DS/AI/Data Eng/Business

  • Location & work type: Full-time (location not specifie

Full Description

Job Title: AI Quality Assurance Engineer

Experience: 5+ Years

Job Type: Full-Time Job Summary Responsible for ensuring the quality, reliability, accuracy, and performance of AI/ML solutions throughout the development lifecycle. The role develops and implements testing strategies for AI models, data pipelines, AI applications, and production deployments while ensuring solutions meet business, technical, security, and regulatory requirements. Key Responsibilities Develop and execute comprehensive QA and testing strategies for AI/ML solutions. Validate AI models for accuracy, consistency, robustness, and performance. Design test cases for machine learning models, AI applications, APIs, and data pipelines. Perform data quality, data validation, and data integrity testing. Test AI outputs for accuracy, bias, hallucination, reliability, and consistency where applicable. Conduct regression, integration, functional, performance, and automated testing. Establish quality gates and acceptance criteria for AI model deployment. Monitor model performance and identify model/data drift in production. Collaborate with Data Scientists, AI Engineers, Data Engineers, and Business stakeholders. Automate testing processes and integrate QA activities into CI/CD pipelines. Document defects, test results, risks, and remediation activities. Support model governance, auditability, and compliance requirements. Bachelor’s degree in Computer Science, Data Science, AI, Engineering, or a related field. 5+ years of experience in QA, AI/ML testing, software testing, or data quality. Strong understanding of machine learning and AI lifecycle processes. Experience with Python and automated testing frameworks. Knowledge of SQL and data validation techniques. Experience with APIs, cloud platforms, CI/CD, and version control. Understanding of ML model evaluation metrics and model monitoring. Strong analytical, problem-solving, and communication skills.

AI/ML TestingPythonAutomated TestingSQLData ValidationAPI TestingCI/CDModel MonitoringRegression TestingData IntegrityMachine Learning LifecycleVersion ControlCloud PlatformsModel GovernanceAnalytical Skillsmulti-location

Cookies & analytics consent

We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.

Read how we use data in our Privacy Policy and Terms of Service.