ConnectOS logo

Data Quality Engineer (UK IT Services, Hybrid)

ConnectOS โ€ข Manila, Metro Manila, Philippines

hybridfull-time
Posted Sep 19, 2026Apply by Oct 19, 2026

**Role & seniority: ** Data QA / Data Quality Engineering, 3+ years experience

**Stack/tools: ** SQL, Databricks (notebooks, workflows, jobs, monitoring), Python (data validation/test automation), ETL/ELT testing; CI/CD testing; large datasets. Advantage: Azure, PySpark, Event Hubs/Kafka, data observability tools

**Top 3 responsibilities: **

  • Validate data quality (accuracy, completeness, consistency, integrity) across data products/platforms and enforce business rules/calculations

  • Design/execute data tests for ingestion, transformation, enrichment, and consumption; perform integration/regression/end-to-end testing

  • Run and troubleshoot Databricks pipelines/jobs; perform source-to-target reconciliation and investigate root causes using logs/alerts

  • Must-have skills:

    • Strong SQL for validation, reconciliation, investigation, and RCA

    • Hands-on Databricks experience (notebooks/workflows/jobs/monitoring/troubleshooting)

    • Python for validation and automated tests within Databricks

    • Testing experience for ETL/ELT/data products and distributed batch/event pipelines

    • Analytical/problem-solving skills; strong attention to detail

    • Clear English communication with technical/non-technical stakeholders

  • Nice-to-haves:

    • Azure, PySpark, Event Hubs/Kafka, data observability tools

    • Familiarity with CI/CD and modern deployment practices

  • **Location & wor

Full Description

Schedule: 11:00 AM to 8:00 PM Manila time

Work Setup: Hybrid - Mega Tower, Mandaluyong

What are we looking for?

Skills Required

3+ years of experience in Data QA, Data Quality Engineering role Strong SQL skills for data validation, reconciliation, investigation, and root-cause analysis Hands-on experience working with Databricks, including notebooks, workflows, jobs, monitoring, and troubleshooting Experience using Python for data validation and test automation within Databricks notebooks Strong experience testing data pipelines, ETL/ELT processes, transformations, and data products Experience validating data ingestion, transformation, enrichment, and consumption processes Experience performing source-to-target reconciliation and investigating data discrepancies Understanding of batch and event-driven data pipelines and distributed data architectures Experience monitoring and troubleshooting Databricks jobs and workflows Experience working with large and complex datasets Familiarity with CI/CD pipelines and modern deployment practices Knowledge of software testing principles, methodologies, and defect management Strong analytical and problem-solving skills with excellent attention to detail Strong English communication skills, with the ability to clearly communicate data quality issues, findings, and technical concerns to both technical and non-technical stakeholders Experience with Azure, PySpark, Event Hubs/Kafka, or data observability tools is an advantage

What will you do?

Validate data accuracy, completeness, consistency, and integrity across data products and platforms Design and execute tests for data ingestion, transformation, enrichment, and consumption Perform source-to-target reconciliation and data validation using SQL Validate business rules, calculations, and transformation logic Test batch and event-driven data pipelines throughout the development lifecycle Perform integration, system, regression, and end-to-end testing of data solutions Monitor Databricks jobs, workflows, and platform processes Investigate and troubleshoot Databricks job and data pipeline failures Analyze execution logs, alerts, and monitoring information to identify data quality issues Develop and maintain automated data validation and reconciliation solutions using SQL, Python, and Databricks notebooks Contribute to automated testing within CI/CD pipelines Identify, document, investigate, and support the resolution of data defects and quality issues Work closely with Data Engineers, Developers, Architects, Product Owners, and QA teams Support data migrations, platform upgrades, and release readiness activities Contribute to improving data testing, automation, monitoring, and quality assurance practices

Join the awesome team and enjoy these benefits & perks

Medical, Dental Coverage and Life insurance from day 1 of employment Paid Vacation and Sick Leave (with Quarterly Sick Leave Conversion) Competitive salary package and annual appraisal Financial Assistance Program Mandatory Government Benefits and 13th Month Pay Complimentary Sleeping Quarters, Coffee at no cost Complimentary Office Fitness and Wellness Facilities at no cost Regular Company Events, Work Life Balance, and Career growth opportunities Accessible location at the heart of Metro Manila --- the Mega Tower, EDSA

JOIN CONNECTOS NOW!

ConnectOS is certified as a Great Place to Work and is a top-rated Philippines employer of choice.

Our Client is a Field Service Management (FSM) provider passionate about making work and the lives of mobile workers better. An established market leader with over 400 staff across the UK, Ireland, Australia & the Nordics, they supports over 1,000 organisations and 500,000 workers to transform the delivery of field services and experience an exceptional return on investment.

#ConnectOS #TeamConnectOS # ConnectOSRecruitment

Equal Employment Statement

Employment decisions at ConnectOS will be conducted without consideration of factors such as age', race, color, religion, gender, disability status, sexual orientation, gender identity or expression, genetic information, and marital status. ConnectOS ensures the full confidentiality of the data it processes.

Data QASQLDatabricksPythonETL/ELTData pipelinesData validationSource-to-target reconciliationDistributed data architecturesCI/CD pipelinesSoftware testingDefect managementAzurePySparkKafkaData observabilitymulti-location

Cookies & analytics consent

We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.

Read how we use data in our Privacy Policy and Terms of Service.