InfoBeans logo

InfoBeans Technologies - AI/ML Quality Assurance Specialist

InfoBeans • Pune City, Maharashtra, India

onsitefull-time
Posted Oct 31, 2026Apply by Nov 30, 2026

**Role & seniority: ** AI/ML QA Specialist, 5–8+ years experience (QA/data validation with ML focus)

**Stack/tools: ** Databricks (Spark/PySpark, Delta Lake, MLflow); Python; CI/CD, Git, automated testing frameworks; Azure (preferred)

**Top 3 responsibilities: **

  • End-to-end QA across ML lifecycle on Databricks: data ingestion, feature engineering, training, validation, deployment, monitoring

  • Design/execute validation & regression: dataset/schema quality, lineage, feature consistency, drift checks, reproducibility, MLflow experiment/model artifact traceability

  • Automation & CI/CD integration: build automated QA frameworks and regression suite for every deployment; validate batch/real-time execution and monitoring metrics

  • Must-have skills:

    • Hands-on Databricks (Spark/PySpark, Delta, MLflow)

    • Strong Python for test automation

    • Solid understanding of ML lifecycle

    • Experience testing data pipelines, large datasets, and model execution; familiarity with cloud-native environments

    • Working knowledge of CI/CD + Git and automated testing practices

  • Nice-to-haves:

    • MRM/regulatory experience; audit/UAT support

    • Feature stores, model monitoring/drift detection; Power BI

    • Distributed performance testing at scale

    • Platform modernization/cloud migration exposure

  • Location & work type: Not specified in provided text

Full Description

Job Summary

We are seeking skilled AI/ML QA Specialists with strong Databricks experience to ensure the quality, reliability, and regulatory readiness of AI/ML platforms. This role will focus on end-to-end testing of CCAR and ESG projects, covering data pipelines, feature engineering, model training, validation, deployment, and monitoring. The ideal candidate blends data engineering QA, ML lifecycle validation, and platform testing in cloud-native environments. The plan is to automate the QA Testing and make it part of the regression suite that will be run for every future deployment.

Key Responsibilities

Model Development Platform QA

Validate data ingestion, feature engineering, and training pipelines built on Databricks (Spark, Delta, MLflow). Design and execute QA strategies for dataset quality, schema validation, lineage, feature consistency, drift checks, and reproducibility of model training. Test MLflow experiments, model versioning, and artifacts for completeness and traceability. Ensure compliance with model risk management (MRM), audit, and documentation standards. Conduct regression testing to ensure existing functionality remains unaffected.

Model Execution / Production Platform QA

Test model deployment pipelines, including batch and real-time model execution. Validate model scoring accuracy, performance, input/output data contracts, SLAs, error handling, fallback logic, and retries. Perform regression, performance, and volume testing for production workloads. Validate monitoring metrics (model health, drift, latency, failures).

Automation & Tooling

Build and maintain automated test frameworks for data and ML pipelines (Databricks notebooks, PySpark, Python). Implement data-driven QA checks (DQ rules, nulls, thresholds, statistical validation). Integrate QA into CI/CD pipelines for ML workflows. Build automated regression suite to be run prior to any deployments.

Governance & Collaboration

Partner with Data Scientists, ML Engineers, Platform Engineers, and Model Risk teams. Support UAT, audit reviews, and regulatory validation initiatives. Document QA results clearly for technical and non-technical stakeholders.

Required Skills & Qualifications

5 - 8+ years of QA or data validation experience, with strong focus on AI/ML or data platforms. Hands-on experience with Databricks (Spark/PySpark, Delta Lake, MLflow). Strong Python experience for testing and automation. Solid understanding of the ML lifecycle. Experience testing data pipelines, large-scale datasets, and model execution. Knowledge of cloud platforms (Azure preferred). Familiarity with CI/CD, Git, and automated testing frameworks.

Preferred / Nice-to-Have

Experience with model risk management (MRM) or regulated environments. Exposure to feature stores, model monitoring, drift detection, and Power BI. Experience with performance testing at scale in distributed environments. Prior work on platform modernization or cloud migration initiatives.

Education

Bachelors or Masters degree in Computer Science, Data Science, Engineering, or a related field.

(ref: hirist.tech)

AI/ML Quality AssuranceApache SparkAzureCI/CDData Pipeline TestingData Quality ValidationDatabricksDelta LakeMachine Learning Lifecycle ValidationMLflowModel MonitoringModel Risk ManagementPerformance TestingPySparkPythonTest Automation

Cookies & analytics consent

We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.

Read how we use data in our Privacy Policy and Terms of Service.