Role & seniority
- SDET (Software Development Engineer in Test), Senior (min 8+ years IT, 5+ years in required skills)
Stack/tools
- ETL testing & automation frameworks
- Scripting (at least one language)
- SQL
- PySpark
- AWS: S3, Step Functions/SSS (as listed), Glue, EMR, Data Catalog/Crawler, SQS, EventBridge, ETL Jobs
- Athena, Redshift Spectrum
- AWS CLI (job/file movement commands)
- DevOps practices for testing/automation
- Big Data ecosystem / data lakehouse
- DBT (nice-to-have)
Top 3 responsibilities
- Design/implement automated ETL/data-integration tests (framework + test cases/scripts)
- Validate data transformations/migrations and perform regression testing after fixes
- Identify, document, and track bugs/defects, including root-cause analysis, and report QA metrics (e.g., defect density/open defects)
Must-have skills
- Strong ETL testing experience; automation framework development
- SQL proficiency
- PySpark hands-on testing/validation
- Cloud testing in AWS, including ETL tooling/services listed above
- Experience with test automation + DevOps practices
- Troubleshooting and root cause analysis
- Ability to work with Agile teams and communicate clearly cross-functionally
Nice-to-haves
- Familiarity with dbt (or similar transformation tools)
- Prior “tes

Full Description

SDET

Position Summary

The SDET (Software Development Engineer in Test) is responsible for ensuring the quality

and reliability of ETL processes and data integration workflows. This role involves designing

and implementing automated tests to validate data transformation and migration, as well as

collaborating with data engineers and developers to identify and resolve data quality issues.

The ideal candidate will leverage their expertise in ETL testing and data validation to

enhance the overall data pipeline performance and integrity.

Minimum Qualification

Tech Skills

Proficiency in ETL Testing and developing automation framework &

testcases in atleast one scripting language.

Strong SQL skills, with experience in handling big data using ETL tools (e.g.,

Informatica).

Mandatory work experience with PySpark

Testing experience in cloud environment (AWS)

S3, SSS, Glue, EMR, Data Catalog, Crawler, SQS, ETL Jobs, Event Bridge.

Athena, Redshift Spectrum Databases.

AWS Commands for running the jobs, file process and movements.

Experience with Test Automation and DevOps practices in ETL and Cloud Systems.

Experience with Test Automation and DevOps practices in ETL and Cloud

Work experience in a Big Data ecosystem processing data in data

lakehouse.

Familiarity with DBT (Data Build Tool) or similar data transformation tools is a

plus.

Experience providing testing oversight in Agile team.

Should have excellent business communication to interact with Business teams and

cross-functional teams.

Responsibilities

Review requirements, specifications, and technical design documents to understand

and feedback.

Experience in developing and implementing test strategies for complex initiatives.

Estimate, prioritize, plan and coordinate testing activities.

Create automation test framework.

Design, develop and execute automation scripts.

Identify, record, document thoroughly and track bugs.

Strong problem-solving skills, troubleshooting, and root cause analysis skills.

Perform thorough regression testing when bugs are resolved.

Develop and apply testing processes for new and existing features to meet client

needs.

Liaise with cross functional teams to identify system requirements.

Track quality assurance metrics, like defect densities and open defect counts.