
ETL Tester & Data Platform‑SRE Engineer
Beyondsoft Consulting • Kuala Lumpur, Kuala Lumpur, Malaysia
Role & seniority
Multiple sub-roles; exact allocation depends on candidate background
-
ETL Tester / Data Migration Reconciliation Engineer
-
Data Platform / ETL Operations / SRE Engineer
-
Seniority level not explicitly stated in the posting.
Stack/tools
**ETL/Data migration testing & reconciliation: ** SQL, test case/defect management, reconciliation/validation utilities
**Optional/related tech: ** Python (test automation), Databricks, Spark, Hadoop, Azure data pipelines
**Ops/SRE: ** Databricks, Hadoop, Spark, Kafka, Azure Data Factory (ADF), Linux, schedulers, logs, networking
**Observability/monitoring (preferred): ** Splunk, Azure Monitor, Grafana
**Process/tooling (preferred): ** ServiceNow, ITIL/SRE practices, runbooks, dashboards
**Automation: ** Python, Shell; (preferred) infrastructure-as-code
Top 3 responsibilities (by sub-role)
-
ETL Tester / Data Migration Reconciliation
-
Create/execute test strategy and cases for ETL + migration + reconciliation
-
Validate source-to-target mappings, transformation logic, row counts/aggregates/balances
-
Reconcile via SQL, investigate mismatches, log defects, verify fixes, support cutover validation
-
-
Data Platform / ETL Ops / SRE
-
Monitor platform health, pipelines/batch schedules/streaming, manage incidents and RCA
-
Implement observability (dashboards/alerting/runbooks) and automated operational controls
-
Support releases/cutovers/rollback; contribute to backup/DR/
-
Full Description
Multiple sub‑roles are available under this posting: ETL Tester / Data Migration Reconciliation Engineer, Data Platform / ETL Operations / SRE Engineer. Candidates with hands‑on experience in any one of these technology stacks are welcome to apply. Final role allocation will be determined during the interview phase based on each candidate’s technical background.
ETL Tester / Data Migration Reconciliation Engineer Key Responsibilities
-
Prepare test strategy, test scenarios and test cases for ETL, data migration and reconciliation.
-
Validate source-to-target mappings, transformation logic, row counts, aggregates, balances and critical data fields.
-
Perform SQL-based reconciliation and investigate mismatches between legacy and target platforms.
-
Test data completeness, accuracy, consistency, duplicates, null handling and business-rule compliance.
-
Support functional, regression, performance and cutover validation for migration releases.
-
Log defects with clear evidence, severity and reproducible steps, and verify fixes.
-
Automate repeatable validation and reconciliation checks where feasible.
-
Prepare migration quality dashboards, test completion reports and sign-off evidence.
Required Skills & Experience
-
Experience in ETL testing, data migration testing or data reconciliation.
-
Strong SQL skills and ability to analyse large datasets across source and target systems.
-
Understanding of ETL/ELT concepts, data mappings and common data-quality issues.
-
Experience writing structured test cases, defect reports and test evidence.
-
Ability to work with engineering teams to isolate data and transformation defects.
-
Knowledge of test automation using Python or similar tools is advantageous.
-
Banking migration, finance or regulatory-data experience is preferred.
Preferred / Advantageous
-
Experience testing Databricks, Spark, Hadoop or Azure data pipelines.
-
Knowledge of reconciliation frameworks and automated data comparison utilities.
-
ISTQB or equivalent testing certification.
Data Platform / ETL Operations / SRE Engineer Key Responsibilities
-
Monitor data-platform health, pipelines, batch schedules, streaming services, storage and compute resources.
-
Manage incidents, service requests, recurring problems, root-cause analysis and corrective actions.
-
Support production Databricks, Hadoop, ETL and cloud data services according to agreed SLAs.
-
Implement observability, dashboards, alerting, runbooks and automated operational controls.
-
Perform capacity, performance, reliability and availability analysis and tuning.
-
Support release deployment, change management, environment readiness, cutover and rollback activities.
-
Participate in backup, recovery, disaster-recovery and resilience testing.
-
Drive SRE practices such as automation, error reduction, operational metrics and service improvement.
Required Skills & Experience
-
Experience supporting enterprise data platforms, ETL services or cloud data environments in production.
-
Strong troubleshooting skills across Linux, SQL, jobs, schedulers, logs, network connectivity and platform services.
-
Knowledge of monitoring, alerting, incident/problem management and ITIL/SRE practices.
-
Experience with Databricks, Hadoop, Spark, Kafka, ADF or similar data technologies is preferred.
-
Scripting/automation skills in Python, Shell or comparable languages.
-
Ability to support scheduled cutovers, after-hours changes or on-call activities when required.
-
Experience with banking-grade availability and operational controls is preferred.
Preferred / Advantageous
-
Cloud/platform operations certification.
-
Experience with ServiceNow, Splunk, Azure Monitor, Grafana or similar operations tools.
-
Knowledge of infrastructure-as-code and automated deployment practices.