🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Allstemconnections • San Francisco, California, United States
Role & seniority: Senior Automation Test Engineer focused on data platforms and data-intensive applications
Stack/tools: Databricks; Tableau; R; Immuta; Collibra; SQL; Python; Jupyter notebooks; GitLab CI/CD; API testing and data integration testing; data validation frameworks (Great Expectations, Deequ)
Design, implement, and maintain automated testing frameworks for data ingestion, processing, and deployment pipelines
Create/maintain automated test suites for data validation and end-to-end data quality across the platform
Develop monitoring for production data platform operations; collaborate with engineers/scientists/stakeholders; mentor juniors; provide quality metrics
5+ years in test automation for data platforms/data-intensive apps
Python for test automation; Databricks expertise; SQL and data warehousing testing
Data validation techniques for large datasets; Jupyter notebooks; API and data integration testing
CI/CD knowledge (GitLab); strong analytical/problem-solving and attention to detail
Experience with Databricks, Tableau, R, Immuta, Collibra
Data governance/testing governance controls; data security/testing/compliance
Data quality frameworks (Great Expectations, Deequ); AWS data services; Docker/Kubernetes; performance testing; data lineage concepts
Location & work type: On-site or local to San Francisco, CA (within 1 hour drive); U.S. citizen or Green Ca
Employment Type: No C2C (Corp-to-Corp) or C2H (Contract-to-Hire) arrangements. W2 contract only. No referral fees will be entertained.
Work Authorization: Must be a U.S. Citizen or Green Card holder. Local in San Francisco, CA or 1 hour drive to San Francisco, CA 5+ years of experience in test automation with a focus on data platforms or data-intensive applications Hands-on experience testing data platforms using Databricks Proficiency in SQL and experience testing data warehousing solutions Knowledge of CI/CD tools in GitLab Experience with Databricks, Tableau, R, Immuta, or Collibra
Required Qualifications
5+ years of experience in test automation with a focus on data platforms or data-intensive applications
Strong experience with Python for developing test automation frameworks
Hands-on experience testing data platforms using Databricks
Experience with data validation techniques and tools for large datasets
Proficiency in SQL and experience testing data warehousing solutions
Proficiency with Jupyter notebooks for coding and unit testing
Knowledge of CI/CD tools in GitLab
Experience with API testing and data integration testing
Strong analytical and problem-solving skills with attention to detail
Preferred Qualifications
Experience with Databricks, Tableau, R, Immuta, or Collibra
Familiarity with data governance principles and testing governance controls
Knowledge of data security testing and compliance requirements
Experience with testing frameworks for data quality (Great Expectations, Deequ, etc.)
Understanding of AWS platforms and its data services
Familiarity with containerization technologies (Docker, Kubernetes)
Experience with performance testing of data pipelines
Knowledge of data lineage concepts and testing methodologies
Eligibility Requirement
This position requires access to confidential supervisory information, which is limited to "Protected Individuals." This includes U.S. citizens, U.S. nationals, eligible U.S. permanent residents, or those who will sign a declaration of intent to apply for naturalization.
About the Role
We are seeking an experienced Senior Automation Test Engineer with expertise in data platforms to join our team. In this role, you will be responsible for designing, implementing, and maintaining automated testing frameworks to ensure the reliability, performance, and security of our data platform built on Databricks, Tableau, R, Immuta, and Collibra.
Key Responsibilities
Design and develop comprehensive automated testing strategies for data ingestion, processing, and deployment pipelines
Create and maintain automated test suites using industry-standard tools and frameworks for data validation
Build robust testing frameworks that can validate data consistency, completeness, and accuracy across the platform using frameworks like Great Expectations and Deequ
Develop monitoring solutions to validate data platform operations in production environments
Create and execute test plans for ETL processes, data transformations, and analytics workflows
Collaborate with data engineers, data scientists, and business stakeholders to understand requirements and ensure quality standards
Implement continuous integration and continuous testing practices for data platform components
Analyze test results and provide detailed reports on data quality issues and platform stability
Mentor junior team members on data testing best practices and methodologies