Gramian Consulting logo

Senior Test Automation Engineer (AI Systems)

Gramian Consulting Bosnia and Herzegovina

hybridcontract
Posted Aug 26, 2026
  • Role & seniority

    • Senior Test Automation Engineer (contractor)
  • Stack / tools

    • Test automation: Selenium, Playwright, Cypress (or comparable frameworks)

    • Testing scope: frontend + API + backend/data flows + system integration + E2E + regression

    • LLM testing: validate prompt behavior, model outputs, consistency, hallucination

    • Performance/load testing

    • CI/CD integration (automated test execution)

  • Top 3 responsibilities

    • Design and maintain automated testing strategies across frontend, APIs, backend/data flows, and integrations

    • Build/maintain automated test suites and ensure strong regression coverage over evolving releases

    • Validate LLM-enabled behavior (prompt/output correctness and consistency) and run performance/load testing pre-release

  • Must-have skills

    • 5–10 years in QA/test automation/software testing

    • Hands-on experience with Selenium/Playwright/Cypress (or similar)

    • Experience with E2E, regression, and system integration testing for web apps + APIs + backend integrations

    • Hands-on performance/load testing experience

    • Strong defect investigation (reproducible bug reports + root-cause support)

    • Experience integrating automated tests into CI/CD pipelines

    • Fluent professional English

  • Nice-to-haves

    • Experience specifically in AI/LLM application testing or regulated AI environments

    • Experience working with enterprise workflow automation and business-rule/SLA validation

  • **Location & work typ

Full Description

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About The Role

Our client is a Big4 Consultancy group that works with leading financial institutions on AI-driven transformation, automation, advanced analytics, and financial crime prevention. Their work spans intelligent fraud detection, AML/KYC modernization, autonomous workflows, enterprise AI platforms, and the secure industrialization of AI in highly regulated environments.

We are looking for a Senior Test Automation Engineer to design and execute automated testing strategies for complex AI-enabled applications. The role spans API testing, frontend automation, backend data flows, system integration, performance testing, and validation of LLM outputs and prompt behavior.

CONTRACT: Contractor assignment, expected October 2026 - July 2027, with potential extension

COMMITMENT: Full-time

LOCATIONS: Europe-based, preferably CEE; remote, with potential future hybrid work in Prague

PROCESS: Initial qualification followed by technical and client interviews

NOTES: Fluent English is required.

Responsibilities

Design and maintain comprehensive automated testing strategies across frontend, backend, APIs, and data flows Build and maintain automated test suites using Selenium, Playwright, Cypress, or comparable frameworks Develop test approaches for validating LLM prompts, model outputs, consistency, and hallucination behavior Execute system integration, regression, and end-to-end testing Perform performance and load testing before production releases Validate that automated workflows meet defined business rules and performance SLAs Investigate defects, document reproducible bug reports, and support root-cause analysis Collaborate closely with developers and platform teams on issue resolution Maintain reliable regression coverage across evolving application releases Contribute to test standards, quality gates, and release-readiness criteria

Requirements

5-10 years of professional QA, test automation, or software testing experience Strong hands-on experience with Selenium, Playwright, Cypress, or similar automation frameworks Proven experience testing complex web applications, APIs, and backend integrations Experience designing and executing end-to-end, regression, and system integration tests Hands-on experience with performance or load testing Strong ability to investigate failures, identify root causes, and document defects clearly Experience integrating automated testing into CI/CD pipelines Fluent professional English

Test AutomationSeleniumPlaywrightCypressAPI TestingLLM ValidationPerformance TestingLoad TestingCI/CDSystem Integration TestingRegression TestingBackend TestingFrontend AutomationRoot Cause AnalysisEnglish Fluency

Cookies & analytics consent

We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.

Read how we use data in our Privacy Policy and Terms of Service.