
AI Automation and Performance Tester
Hays • Sydney, New South Wales, Australia
Role & seniority: AI Automation and Performance Tester (role level not specified)
Stack / tools: Python, Selenium, WebSockets; Gatling (Scala); Azure DevOps pipelines; CI/CD; logs/metrics analysis
Top 3 responsibilities
-
Design and maintain automated test frameworks for AI and web apps; execute automation tests
-
Develop and run performance/load tests; identify defects and performance bottlenecks
-
Integrate automated and performance tests into Azure DevOps pipelines; collaborate with cross-functional teams
Must-have skills
-
Experience testing AI models or similar technologies
-
Hands-on Python automation and Selenium
-
WebSocket-based testing and real-time event validation
-
Gatling (Scala) for performance/load testing
-
Azure DevOps pipelines and CI/CD automation
-
Strong debugging/analytical skills; ability to interpret logs and metrics
-
Excellent communication, collaboration, and documentation; Agile environment suitability
Nice-to-haves
-
Testing chatbot or conversational AI systems
-
BrowserStack or cross-browser automation
-
Rapid7 AppSec or similar security/monitoring tools
-
Cloud-based environments and API automation
-
ISTQB or similar certifications
-
Experience in education sector or educational software
-
Location & work type: Location and work type not specified; details not provided in job description
Full Description
AI Automation and Performance Tester
Your new company You’ll be joining an organisation committed to transforming digital testing through intelligent automation and performance insights. The team is focused on delivering scalable, high‑quality AI and web‑based solutions that support modern, reliable, and future‑focused technology outcomes.
Your new role As the AI Automation and Performance Tester, you will play a key role in ensuring the quality, scalability, and reliability of AI and web‑based applications. You will design and maintain automated test frameworks, execute performance and load tests, and embed quality practices across engineering projects.
Your work will involve
- Designing and executing automation test suites using Python, Selenium, and WebSockets
- Developing performance test scripts in Gatling (Scala)
- Identifying and diagnosing defects and performance bottlenecks
- Integrating automated and performance tests into Azure DevOps pipelines
- Collaborating with cross‑functional teams to ensure robust system validation
What you'll need to succeed Core capabilities Experience testing AI models or similar technologies Strong hands‑on experience with Python automation and Selenium Proficiency in WebSocket‑based testing and real‑time event validation Experience with Gatling (Scala) for performance and load testing Knowledge of Azure DevOps pipelines and CI/CD automation Strong analytical and debugging skills, with the ability to interpret logs and metrics Excellent communication, collaboration, and documentation skills Ability to thrive in an Agile, fast‑paced environment
Preferred experience Testing chatbot or conversational AI systems BrowserStack for cross‑browser automation Rapid7 App Sec or similar monitoring/security tools Cloud‑based environments and API automation Agile development methodologies ISTQB or similar testing certifications Experience in the education sector or with educational software
What you'll get in return The opportunity to contribute to impactful AI and digital testing initiatives A role at the forefront of automation, performance engineering, and modern CI/CD practices Collaboration with skilled engineers, developers, and DevOps professionals A supportive environment that values continuous improvement and innovation Professional growth in a team committed to delivering high‑quality technology solutions