Software Engineer 5 — Commerce Experiences Testing Infrastructure
Netflix • Warsaw, Masovian Voivodeship, Poland
Salary: 300 million pa
Role & seniority
- Senior Software Engineer (Testing Tools & Infrastructure)
Stack/tools
Languages: Java, JavaScript, Python; GraphQL
Testing/automation: Selenium WebDriver, Playwright, Jest, Cucumber, Mocha
CI/CD / infra: GitHub Actions
Testing analytics/telemetry and data: distributed tracing, synthetic test data generation
Others: frontend/backend testing, API/mocking/contract testing, performance tests
Top 3 responsibilities
-
Build and maintain language-agnostic testing tools and telemetry to scale to millions of test runs per month
-
Develop framework-agnostic analysis of distributed tracing, synthetic test data generation, and integration of test infrastructure into engineering workflows
-
Design, implement, and maintain tests (integration, visual, API, mock, contract, performance) ensuring reliability, scalability, and workflow usability
Must-have skills
-
Experience on a developer platform or productivity team; strong automation toolset
-
Deep understanding of testing frameworks, CI/CD, code coverage, and post-deployment verification
-
Meticulous software designer who documents tradeoffs clearly; proactive, self-motivated, and organized
-
Effective communicator with technical and non-technical stakeholders; advocate for robust testing culture
Nice-to-haves
-
Production experience with Java or JavaScript; metrics pipelines design/implementation
-
Experience operating CI systems (GitHub Actions, Jenkins, CircleCI)
-
Knowledge of distributed tracing (Zipki
Full Description
Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, anywhere, and can change their plans at any time. About the Team The Testing Tools & Infrastructure team within the Consumer Lifecycle Experiences Platform is crucial to our Commerce organization. It serves Commerce Experiences by making pre-production testing faster and more reliable. It achieves this by providing centralized platforms for distributed test execution, customer test data creation tools, flaky test analytics and management, and more. About the role We are looking for an experienced Senior Software Engineer with a demonstrated ability to build and enhance language-agnostic testing tools and telemetry which scales to meet the demand of millions of test runs per month. Our ideal candidate is passionate about developer productivity, and thrives on the satisfaction of empowering Commerce Engineering engineers worldwide to quickly and comprehensively test their software. They are excited to leverage their experience building and maintaining automated testing and resilience platforms to provide long-term benefits. Key responsibilities
Common languages and tools: Java, Javascript, Python, GraphQL, Github Actions, Selenium WebDriver, Playwright, Jest, Cucumber, Mocha Implement and manage software solutions that provide accurate and efficient analysis of test runs Create and maintain tools for framework-agnostic analysis of distributed tracing tools for test runs Develop and integrate software solutions which provide high-quality synthetic test data generation Integrate internal and vendor-provided distributed test execution infrastructure into engineering workflows with a focus on reliability and ease of use Develop and execute integration, visual screenshot, API, mock, contract, and performance tests to ensure reliability and scalability of frontend & backend systems. Design and develop tools and infrastructure to automatically detect, quarantine, and reproduce flaky tests Correlate test coverage data with code changes, runtime execution, and trace data for comprehensive reporting Maintain a strong focus on scalability, usability, and reliability in platform design to support a growing cohort of stunning engineers Stay informed about industry trends and emerging technologies to ensure Commerce Engineering remains at the forefront of testing infrastructure. Experience defining a testing strategy in partnership with other cross functional partners to build reliable systems. Document test strategies, frameworks, and troubleshooting guides for internal teams. Must Haves A stunning software engineer with experience working on developer platform or productivity teams Has deep understanding of automation tools and frameworks A meticulous software designer who researches and documents technical tradeoffs clearly and concisely A self-motivated and organized individual who can independently drive org-wide solutions A proactive communicator who engages effectively with technical and non-technical stakeholders An advocate for a strong testing culture, having familiarity with popular test frameworks, code coverage tools, continuous integration systems, and post-deployment verification methods (healthy contempt for flaky tests is a plus) Passionate about solving developer productivity challenges for engineers. Support team members and partners to boost productivity Nice To Haves You have shipped and maintained Java or JavaScript code in production You have designed and implemented metrics data pipelines Experience running and operating continuous integration systems like GitHub Actions, Jenkins, CircleCI and others Guide the roadmaps of Infrastructure teams according to the specific needs and requirements of product-focused team members Keep up-to-date with the latest research, tools, and industry standards in GenAI testing and evaluation, and drive the adoption of relevant practices within the team. You have generated and analyzed traces like Distributed tracing/ Zipkin/ Honeycomb/ Datadog/ Splunk/ Elastic Search APM You have implemented advanced log, metric, or error stack trace analysis You strive to elevate the knowledge and skills of yourself and others in a way that fosters an inclusive, collaborative environment. Deeply enjoy working on solutions that empower other engineers in their work Thrive in an ambiguous environment and can self-manage and self-prioritize your time, energy, and resources Understand engineering is a team sport and actively farm for feedback and dissent Experience working with a globally distributed team Inclusion is a Netflix value and we strive to host a meaningful interview experience for all candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner. We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.