YOUR HRM EXPERT logo

AI LLM QA Automation Specialist ( Shopify/ Playwright )

YOUR HRM EXPERT • India

remotefull-time

Salary: INR 1,000,000 - INR 1,200,000 / year

Posted Oct 3, 2026

**Role & Seniority: ** Quality Analyst / QA Automation Engineer (3–5 years)

**Location & Work Type: ** Remote / Work From Home (listed as “Permanent Work From Home / Remote”); Work Location field says “In person” (potential mismatch)

**Stack / Tools: **

  • Automation/Testing: Automation Testing, Playwright

  • Languages: JavaScript, TypeScript

  • Apps/Platforms: Shopify application testing

  • API & Web Testing: API testing, end-to-end, regression, cross-browser, responsive testing

  • CI/CD & DevOps: CI/CD pipelines, automation integration

  • AI/LLM QA automation: AI-powered testing tools, OpenAI APIs, LangChain, LangGraph, CrewAI, AutoGen

  • AI-assisted coding/testing: GitHub Copilot, Cursor, Windsurf, Claude, ChatGPT

  • Test/Defect mgmt: defect tracking and test management tools

  • Top 3 Responsibilities:

    • Build/maintain scalable QA automation frameworks using Playwright + JS/TS

    • Own Shopify-specific web/UI and API testing (E2E/regression, cross-browser/responsive)

    • Implement AI/LLM-based QA automation (test generation, execution, defect analysis, reporting; possibly AI agents)

  • Must-have Skills:

    • 3–5 years QA experience; 2–3+ years Shopify testing

    • Strong automation testing experience and framework development/maintenance

    • Proficiency with Playwright (JS/TS)

    • Strong knowledge of web + API testing and regress

Full Description

Date posted: October 2, 2026

Pay: ₹10,00,000- ₹1,200,000 per year

Job description

  • 3–5 Years
  • Permanent Work From Home / Remote
  • Role Overview
  • We are looking for a Quality Analyst with strong experience in Automation Testing, Shopify application testing, Playwright, JavaScript/TypeScript, and AI/LLM-based QA automation.
  • The ideal candidate should be capable of designing and maintaining scalable automation frameworks and leveraging AI tools and AI Agents to automate QA activities such as test-case generation, test execution, defect analysis, reporting, and workflow optimization.

The ideal candidate will have a combination of

  • QA Automation + Shopify + Playwright + JavaScript/TypeScript + API Testing + CI/CD + AI/LLM + AI Agents

  • Required Skills & Qualifications-

  • 3–5 years of Software QA experience.

  • 2–3+ years of hands-on experience testing Shopify-based applications.

  • Strong hands-on experience in Automation Testing.

  • Strong proficiency in Playwright with JavaScript/TypeScript.

  • Experience designing, developing, and maintaining automation frameworks.

Strong understanding of

  • Web Application Testing

  • API Testing

  • Cross-Browser Testing

  • Responsive Testing

  • End-to-End Testing

  • Regression Testing

  • Hands-on experience with AI-powered testing tools and LLMs.

  • Experience building or deploying AI Agents for QA automation.

Familiarity with AI/agent frameworks such as

  • OpenAI APIs

  • LangChain

  • LangGraph

  • CrewAI

  • AutoGen

  • Similar AI orchestration platforms

  • Good understanding of CI/CD pipelines and automation integration.

  • Experience with defect tracking and test management tools.

  • Strong analytical and problem-solving skills.

  • Excellent attention to detail.

  • Strong verbal and written communication skills.

  • Ability to work independently in a remote environment.

  • Good-to-Have Skills

  • API automation

  • Agile/Scrum experience

  • Performance Testing

  • Security Testing

  • Cloud Testing Platforms

  • CI/CD test integration

  • GitHub Copilot

  • Cursor

  • Windsurf

  • Claude

  • ChatGPT

  • Other AI-assisted coding/testing tools

  • Ideal Candidate Profile

The ideal candidate will have a combination of

  • QA Automation + Shopify + Playwright + JavaScript/TypeScript + API Testing + CI/CD + AI/LLM + AI Agents
  • Candidates who have only traditional manual QA experience without strong automation, Shopify, Playwright, and AI/LLM exposure would not closely match this requirement.

Work Location: In person

QA AutomationShopify TestingPlaywrightJavaScriptTypeScriptAutomation FrameworksAPI TestingCross-Browser TestingResponsive TestingEnd-to-End TestingRegression TestingAI-Powered TestingLarge Language ModelsAI AgentsCI/CDDefect Tracking

Cookies & analytics consent

We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.

Read how we use data in our Privacy Policy and Terms of Service.