Hays logo

AI Automation and Performance Tester

Hays Sydney, New South Wales, Australia

onsitecontract
Posted Feb 1, 2026Apply by Mar 3, 2026

Role & seniority: AI Automation and Performance Tester (role level not specified)

Stack / tools: Python, Selenium, WebSockets; Gatling (Scala); Azure DevOps pipelines; CI/CD; logs/metrics analysis

Top 3 responsibilities

  1. Design and maintain automated test frameworks for AI and web apps; execute automation tests

  2. Develop and run performance/load tests; identify defects and performance bottlenecks

  3. Integrate automated and performance tests into Azure DevOps pipelines; collaborate with cross-functional teams

Must-have skills

  • Experience testing AI models or similar technologies

  • Hands-on Python automation and Selenium

  • WebSocket-based testing and real-time event validation

  • Gatling (Scala) for performance/load testing

  • Azure DevOps pipelines and CI/CD automation

  • Strong debugging/analytical skills; ability to interpret logs and metrics

  • Excellent communication, collaboration, and documentation; Agile environment suitability

Nice-to-haves

  • Testing chatbot or conversational AI systems

  • BrowserStack or cross-browser automation

  • Rapid7 AppSec or similar security/monitoring tools

  • Cloud-based environments and API automation

  • ISTQB or similar certifications

  • Experience in education sector or educational software

  • Location & work type: Location and work type not specified; details not provided in job description

Full Description

AI Automation and Performance Tester

Your new company You’ll be joining an organisation committed to transforming digital testing through intelligent automation and performance insights. The team is focused on delivering scalable, high‑quality AI and web‑based solutions that support modern, reliable, and future‑focused technology outcomes.

Your new role As the AI Automation and Performance Tester, you will play a key role in ensuring the quality, scalability, and reliability of AI and web‑based applications. You will design and maintain automated test frameworks, execute performance and load tests, and embed quality practices across engineering projects.

Your work will involve

  • Designing and executing automation test suites using Python, Selenium, and WebSockets
  • Developing performance test scripts in Gatling (Scala)
  • Identifying and diagnosing defects and performance bottlenecks
  • Integrating automated and performance tests into Azure DevOps pipelines
  • Collaborating with cross‑functional teams to ensure robust system validation

What you'll need to succeed Core capabilities Experience testing AI models or similar technologies Strong hands‑on experience with Python automation and Selenium Proficiency in WebSocket‑based testing and real‑time event validation Experience with Gatling (Scala) for performance and load testing Knowledge of Azure DevOps pipelines and CI/CD automation Strong analytical and debugging skills, with the ability to interpret logs and metrics Excellent communication, collaboration, and documentation skills Ability to thrive in an Agile, fast‑paced environment

Preferred experience Testing chatbot or conversational AI systems BrowserStack for cross‑browser automation Rapid7 App Sec or similar monitoring/security tools Cloud‑based environments and API automation Agile development methodologies ISTQB or similar testing certifications Experience in the education sector or with educational software

What you'll get in return The opportunity to contribute to impactful AI and digital testing initiatives A role at the forefront of automation, performance engineering, and modern CI/CD practices Collaboration with skilled engineers, developers, and DevOps professionals A supportive environment that values continuous improvement and innovation Professional growth in a team committed to delivering high‑quality technology solutions

multi-location

Cookies & analytics consent

We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.

Read how we use data in our Privacy Policy and Terms of Service.