GEN AI testing Engineer
Virtusa • Bengaluru, Karnataka, India
**Role & seniority: ** AI Testing Specialist (mid-level); 5–7 years experience stated (despite “1–3 years” in qualifications)
**Stack/tools: **
-
Python (image processing, data processing, automation testing)
-
TensorFlow/Keras and/or PyTorch
-
CI/CD for AI (AI-tailored pipelines)
-
Cloud: AWS or Azure
-
Testing/QA methods: SDLC/STLC with AI-specific phases
-
Top 3 responsibilities:
-
Plan and execute test plans/test cases/scenarios for AI systems
-
Build and maintain automated test frameworks/scripts for AI components
-
Design benchmarking/performance tests and apply QA standards for accuracy/reliability/performance
-
-
Must-have skills:
-
AI/ML fundamentals and understanding of deep learning testing
-
Proficiency in Python and automated testing for AI workloads
-
Experience testing AI-driven applications across platforms
-
Strong statistical analysis to evaluate/validate model performance
-
Knowledge of SDLC/STLC and AI-specific QA activities
-
-
Nice-to-haves:
-
Experience with ML pipelines and AI CI/CD workflows
-
Advanced image processing algorithms
-
Cloud-based AI testing experience on AWS/Azure
-
-
Location & work type: Not specified in provided text.
Full Description
Job Requirements
AI Testing Specialist
We are seeking a skilled AI Testing Specialist to join our team. The ideal candidate will have experience in testing AI-based applications and systems, with a strong understanding of AI/ML concepts and testing methodologies
Responsibilities
Collaborate with the AI test team to plan and execute test plans, test cases, and test scenarios for AI systems. Develop, execute, maintain, and enhance automated test frameworks and scripts dedicated to AI component testing. Implement quality assurance standards to ensure the accuracy, reliability, and performance of AI solutions. Design and implement benchmarking tests to evaluate AI system performance against industry standards and competitors. Expand knowledge in testing deep learning algorithms and model families.
Required Skills
Proficiency in Python and related packages for image processing, data processing, and automation testing. Familiarity with machine/deep learning frameworks like TensorFlow, Keras, or PyTorch. Understanding of Software Development Life Cycle (SDLC) and Software Testing Life Cycle (STLC), with a focus on AI-specific testing phases and activities. Experience in testing AI-driven applications across diverse platforms.
Qualification
Bachelor’s in Computer Science, Data Science, Machine Learning, or related fields. 1-3 years of experience in AI testing, deep learning, or quality assurance.
Preferred Qualifications
- Proficiency in machine learning pipelines and Continuous Integration/Continuous Deployment (CI/CD) pipelines tailored for AI development and testing -workflows.
- Knowledge of advanced image processing algorithms.
- Experience with cloud computing platforms such as AWS or Azure, particularly in the context of testing AI solutions in cloud environments.
- Strong statistical analysis skills to evaluate model performance, validate results, and identify potential issues during AI testing.
Work Experience
5-7Years
