Elysium Digital logo

Senior Tester - AI Validation

Elysium Digital • Brisbane, Queensland, Australia

onsitecontract
Posted Nov 20, 2026Apply by Dec 20, 2026

**Role & seniority: ** Senior Test Analyst / Test Lead for a large-scale digital transformation program (enterprise/government context)

**Stack/tools: **

  • Test management/traceability: qTest, Zephyr, Jira, Confluence, Azure DevOps Test Plans, HP ALM (or similar)

  • CI/testing/automation exposure: Tosca, Selenium, Playwright, Postman, REST Assured, JMeter (as applicable)

  • CRM/enterprise platforms: Salesforce Service Cloud/Experience Cloud/PSS, Microsoft Dynamics 365 (or similar)

  • Dev/Agile artifacts (implied): test plans, RTMs, test completion reporting, governance metrics

  • Top 3 responsibilities:

    • Develop and execute test strategies/plans/RTMs, including risk-based testing

    • Lead system, integration, end-to-end, regression, UAT, and production validation; manage release readiness

    • Ensure traceability and defect governance; coordinate UAT planning/execution/sign-off across stakeholders

  • Must-have skills:

    • Senior experience leading QA/testing in complex enterprise transformation programs

    • Strong skills in test governance artifacts: Test Strategy, Test Plan, RTM, Test Completion Reports

    • Proven UAT coordination with business testers/SMEs and release sign-off

    • Defect triage, quality metrics, risk-based testing, release/production validation

    • Experience validating Microsoft Copilot and AI-generated content for accuracy/compliance/user acceptance (incl. prompt/outputs)

  • **Nice-

Full Description

We are seeking an experienced Senior Test Analyst to lead quality assurance activities across a large-scale digital transformation program involving customer-facing platforms, workflow automation, CRM solutions, integrations and emerging AI-enabled capabilities. This role combines traditional test leadership responsibilities with the testing and validation of AI-generated content and Microsoft Copilot-assisted outputs, ensuring business accuracy, traceability, compliance and user trust.

The successful candidate will be responsible for driving testing strategy, governance, UAT, release readiness and quality outcomes across multiple integrated solutions and stakeholder groups.

Key Responsibilities Develop and execute Test Strategies, Test Plans, RTMs and risk-based testing approaches. Lead System, Integration, End-to-End, UAT, Regression and Production Validation testing. Coordinate business testers, SMEs and stakeholders through UAT planning, execution and sign-off. Manage defect governance, triage processes, reporting and quality metrics. Validate customer-facing portals, CRM platforms, online forms, payments, workflows and system integrations. Support release readiness activities including smoke testing, deployment validation and Test Completion Reporting. Ensure traceability from requirements through to test execution, defects and release outcomes. Validate Microsoft Copilot and AI-generated outputs for accuracy, completeness, business rule compliance and user acceptance. Test AI-assisted workflows, prompts, summaries, communications and knowledge content for quality and consistency. Contribute to continuous improvement, shift-left testing and quality assurance best practices.

Key Selection Criteria Demonstrated experience leading testing activities across complex enterprise or government transformation programs. Proven capability developing Test Strategies, Test Plans, RTMs, Test Completion Reports and governance artefacts. Strong experience coordinating UAT, business testers, stakeholder engagement and release sign-off activities. Hands-on experience with qTest, Zephyr, Jira, Confluence, Azure DevOps Test Plans, HP ALM or similar enterprise test management platforms. Experience testing Salesforce Service Cloud, Salesforce Experience Cloud, Salesforce Public Sector Solutions (PSS), Microsoft Dynamics 365 or other CRM/case management platforms. Strong System Integration Testing, API Testing, Data Migration Testing and End-to-End business process validation experience. Experience in defect management, risk-based testing, release readiness and production validation activities. Exposure to automation and quality engineering tools such as Tosca, Selenium, Playwright, Postman, REST Assured or JMeter. Demonstrated experience validating Microsoft Copilot, Copilot Studio, Generative AI solutions, AI-generated content, prompt engineering, Responsible AI controls and AI quality assurance frameworks. Excellent communication skills with the ability to engage technical teams, business stakeholders and executive audiences.

AI ValidationAPI TestingCRM TestingData Migration TestingDefect ManagementEnd-to-End TestingMicrosoft Copilot ValidationRelease ReadinessRequirements TraceabilityRisk-Based TestingStakeholder EngagementSystem Integration TestingTest GovernanceTest PlanningTest StrategyUser Acceptance Testing

Cookies & analytics consent

We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.

Read how we use data in our Privacy Policy and Terms of Service.