Apple logo

Siri Quality Engineer

Apple โ€ข Beijing, Beijing, China

onsitefull-time
Posted Oct 26, 2026
  • Role & seniority

    • Software Quality Engineer (Siri Quality / AI Quality), hands-on; seniority not explicitly stated, requires strong experience
  • Stack/tools

    • Programming/scripting: Python, Swift, Java, or Go

    • Testing/automation frameworks for: client-side, backend services, end-to-end integrations

    • CI/CD, containerization, cloud/distributed infrastructure

    • LLM tooling & model APIs (build evaluation workflows/tools)

    • Data/infra fundamentals: SQL, databases, Unix/Linux/macOS

    • Evaluation concepts: LLM offline evaluation, online monitoring, A/B quality assessment

    • (Preferred) LLM QA pipelines, dashboards/metrics, benchmark datasets

  • Top 3 responsibilities

    • Set and raise quality bar for Siri features and intelligent services across the lifecycle (traditional QA + LLM evaluation)

    • Build automation for testing, LLM evaluation, and operational efficiency (E2E + online/offline monitoring)

    • Define model quality metrics, analyze bad cases, and drive closed-loop fixes with cross-functional teams

  • Must-have skills

    • Strong software engineering fundamentals (DS, DB/SQL, OS)

    • Hands-on test automation framework architecture/implementation for multi-tier systems

    • Experience with CI/CD, containerization, and distributed/cloud environments

    • Solid understanding of Generative AI / LLM concepts; ability to build evaluation tooling/scripts using model APIs

    • Stron

Full Description

We are looking for an exceptional Software Quality Engineer with hands-on experience and a strong technical background to elevate the quality bar for Siri features and intelligent services in Mainland China. In this role, you will champion product quality across the entire lifecycle, blend traditional QA rigor with cutting-edge Generative AI and LLM evaluation methodologies, and build innovative automation tools that push testing, evaluation, and operational efficiency to the next level.

DESCRIPTION

As a Siri Quality Engineer, you will work at the intersection of AI, speech/language technologies, and customer experience. Your key responsibilities

include

MINIMUM QUALIFICATIONS

BS/MS in Computer Science, Computer Engineering, or equivalent practical experience. Strong proficiency in at least one modern programming or scripting language (e.g., Python, Swift, Java, Go), with solid fundamentals in data structures, databases, SQL, and OS environments (Unix/Linux/macOS). Hands-on experience architecting and implementing test automation frameworks for client-side applications, backend services, and end-to-end integration flows. Experience with CI/CD pipelines, containerization, and modern cloud/distributed infrastructure. Solid understanding of Generative AI / LLM concepts, with proven ability to build tools, scripts, or workflows utilizing model APIs. Strong

analytical, logical, and debugging skills: capable of breaking down complex, ambiguous problems into testable hypotheses and investigating issues across diverse technical stacks. High adaptability and resilience to navigate rapidly shifting priorities in a fast-paced environment. Strong communication and interpersonal skills, with the ability to collaborate effectively across multi-functional and geographically distributed teams. Professional working proficiency in both written and spoken English and Mandarin.

PREFERRED QUALIFICATIONS

LLM-Based Lifecycle QA & Evaluation Pipelines: Proven track record in establishing an LLM-driven, full-lifecycle quality assurance system and automated evaluation pipelines (e.g., automated test case generation, offline model evaluation, self-healing E2E test automation, continuous online monitoring, and A/B experimentation quality assessment). Model Quality Metrics &

Bad Case Closed-Loop: Demonstrated ability to define model quality metrics and dashboards; systematically collect, categorize, and analyze bad cases (distinguishing hallucinations, tool-invocation errors, retrieval failures, and prompt deficiencies); and partner closely with cross functional teams to drive

closed-loop fixes. Evaluation & Benchmark Design: Experience designing evaluation schemes, curated benchmark datasets, adversarial/negative samples, and edge cases across conversational AI, RAG, tool-use/agents, and multimodal

scenarios. AI Productivity Tooling: Hands-on experience developing lightweight AI-driven developer productivity tools (e.g., agentic workflows, LLM-assisted

code or test generation). Safety & Compliance: Experience in content safety, compliance, privacy, and responsible AI risk evaluation (e.g., bias, harmful

content generation). Apple Ecosystem: Experience testing on Apple platforms

(iOS, iPadOS, macOS, watchOS and etc). Soft Skills & Mindset: Self-motivated and proactive, with demonstrated creative and critical thinking capabilities.

Language Skills: Fluency or proficiency in Cantonese is a strong plus.

CI/CDCloud InfrastructureCommunicationContainerizationData StructuresDebuggingDistributed SystemsGenerative AIGoJavaLLMPythonSoftware Quality AssuranceSQLSwiftTest Automation

Cookies & analytics consent

We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.

Read how we use data in our Privacy Policy and Terms of Service.