Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Arctic Wolf • Bengaluru, Karnataka, India
Salary: 50 Most Innovative Compa
Role & seniority
Stack/tools
Selenium, Playwright, Docker, Kubernetes
AWS (Bedrock, Lambda, SQS, S3), LangChain
AI/ML testing: GenAI/AI/LLM evaluation frameworks (e.g., Ragas), OpenAPI, Postgres, Linux
Testing: Locust, CATS; CI/CD pipelines; API validation; performance/load testing; fuzzing
Top 3 responsibilities
Create, extend, and maintain automated testing frameworks and CI/CD pipelines; monitor and report test results
Architect and implement automated tests across API validation, performance/load testing, fuzzing, and AI/ML model validation (LLM prompt-response, bias, toxicity, latency, etc.)
Review testing strategies and collaborate with development teams; develop evaluation pipelines for LLM accuracy, reliability, and regression testing
Must-have skills
3+ years shipping quality software
Experience deploying services on cloud platforms (AWS, Azure, GCP)
Expertise in functional, load, and fuzz testing tools and practices
Experience with distributed systems/microservices
Nice-to-have
Experience with AI/ML security or generative AI evaluation (prompt consistency, hallucination detection)
Prior work on GenAI/AI inference pipelines and model validation
Familiarity with GenAI/LLM evaluation frameworks and model evaluation criteria
Location & work type
About the Role The Arctic Wolf security operations platform ingests and processes upwards of 600 billion events a day from a wide variety of on-premise devices and cloud platforms. The security pipeline is a distributed system of loosely-coupled microservices that constitute our Realtime analysis and threat detection systems. These services distil the incoming events into actionable intelligence that our Concierge Security Teams use to protect customers. We are looking for experienced Quality Engineers to join our pack and work with us to build and expand the capabilities of our testing platform. You Will: Create and extend software frameworks and tools to run, monitor, and report on automated tests. Have experience building and maintaining Automation frameworks and CI/CD pipeline. Review testing strategies, approaches, and test plans and provide insight to development teams. Architect, design and build software to automate a variety of testing methods (e.g. API validation, performance/load testing, fuzzing, etc.) Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection, and regression testing for AI inference APIs. Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability. Work as part of a team of highly skilled software professionals. Continuously learn and expand your technical horizons Our Technology Stack: Selenium, Playwright, Docker, Kubernetes, AWS (Bedrock, Lambda, SQS, S3, etc.), LangChain, LLM evaluation frameworks (e.g., Ragas), OpenAPI, Postgres, Linux. You: Are excited to work at the intersection of AIML, Big Data and the Cybersecurity problem space Have 3+ years of experience shipping quality software Love driving high software quality Have experience deploying services on cloud computing platforms (e.g, AWS, Azure, GCP) Are an expert using common tools for executing functional, load and fuzz testing (e.g. Locust, CATS) Have worked on distributed systems and microservices architecture (preferred) About Arctic Wolf At Arctic Wolf, we’re cultivating a collaborative and productive work environment that welcomes a diversity of backgrounds, cultures, and ideas to make our teams even stronger as we grow globally. We’ve been named one of the 50 Most Innovative Companies in the world for 2022 (Fast Company)—and the 2nd Most Innovative Security Company. We have won countless awards for our excellence in security operations and remain dedicated to providing an industry-leading customer and employee experience including: Top Workday USA (2021-2024) Great Place to Work (2022-2024) & Best Workplaces for Women (2024) in Canada Best Workplaces in Tech & For Women in the UK (2023) Top Company by Kununu in Germany (2024) Our Values Arctic Wolf recognizes that success comes from delighting our customers, so we work together to ensure that happens every day. We believe in diversity and inclusion and truly value the unique qualities and unique perspectives all employees bring to the organization. And we appreciate that—by protecting people’s and organizations’ sensitive data and seeking to end cyber risk— we get to work in an industry that is fundamental to the greater good. We celebrate unique perspectives by creating a platform for all voices to be heard through our Pack Unity program. We encourage all employees to join or create a new alliance. See more about our Pack Unity here. Arctic Wolf is an Equal Opportunity Employer and considers applicants for employment without regard to race, colour, religion, sex, orientation, national origin, age, disability, genetics, or any other basis forbidden under federal, provincial, or local law. Arctic Wolf is committed to fostering a welcoming, accessible, respectful, and inclusive environment ensuring equal access and participation for people with disabilities. As such, we strive to make our entire employee experience as accessible as possible and provide accommodations as required for candidates and employees with disabilities and/or other specific needs where possible. Please let us know if you require any accommodations by emailing . On-Camera Policy To support a fair, transparent, and engaging interview experience, candidates interviewing remotely are expected to be on camera during all video interviews. Being on camera fosters authentic connection, improves communication, and allows for full engagement from both candidates and interviewers. We understand that technical, bandwidth, or location-related challenges may occasionally prevent video use. If this applies, candidates are required to notify us in advance so we can explore appropriate accommodations. Security Requirements Conducts duties and responsibilities in accordance with AWN’s Information Security policies, standards, processes, and controls to protect the confidentiality, integrity and availability of AWN business information (in accordance with our employee handbook and corporate policies). Background checks are required for this position. At Arctic Wolf, we recognize that success comes from delighting our customers. We believe in being lean – in constantly building, measuring, and learning in all aspects of our business. We truly value people. All wolves are welcome to join the Arctic Wolf pack, with compelling compensation packages, benefits, and equity for employees. Arctic Wolf is focused on building a workforce that is diverse and inclusive. If you’re excited about this role, but do not meet all of the qualifications listed above, we encourage you to apply. We review all applications. Arctic Wolf is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, genetics, or any other basis forbidden under federal, provincial, or local law. Arctic Wolf is committed to fostering a welcoming, accessible, respectful and inclusive environment ensuring equal access and participation for people with disabilities. As such, we strive to make our recruitment, assessment and selection processes as accessible as possible and provide accommodations as required for applicants with disabilities. If you require a reasonable accommodation for any part of the application or hiring process, you may make a request by calling the Arctic Wolf general contact number at 1-888-272-8429 and asking to speak to Recruiting, or by emailing .