Quality Assurance Specialist (Japanese) | $11/hr Remote
Crossing Hurdles • Japan
Role & seniority: LLM – AI Quality Analyst (Personalization) – Japanese; Short-Term Contract (2 months); entry to mid-level QA/AI evaluation focus.
Stack/tools: Data annotation and AI quality evaluation; creative prompt engineering; bilingual (Japanese) proficiency; use of personal Google account and data sources; remote collaboration tools; ability to extract and verify debug information.
Top 3 responsibilities
-
Evaluate a personalization feature for Gemini and assess use of past conversations/activity to generate relevant responses.
-
Design and run multi-turn prompts; perform side-by-side evaluations and stack-rank responses by helpfulness/naturalness.
-
Write clear rationales tied to specific turns; verify data sources/summaries; maintain data hygiene by deleting evaluation conversations after completion.
Must-have skills
-
Strong Japanese reading and writing; high attention to detail.
-
Experience in data annotation, AI quality evaluation, content moderation, or related roles.
-
Structured feedback delivery; ability to work independently in a remote environment.
-
Experience with creative prompt engineering and personalization concepts.
-
Ability to extract and reference debug information; analytical thinker.
Nice-to-haves
-
Experience with grounding/hallucination assessment in LLMs.
-
Prior use of data/privacy practices or handling personal data in evaluation tasks.
-
Location & work type: Remote, Global; Part-time commitment 30–40 hrs/
Full Description
Position: LLM – AI Quality Analyst (Personalization) – Japanese
Type: Short-Term Contract (2 months)
Compensation: $11 per hour
Location: Remote (Global)
Commitment: Part-time availability required (30–40 hrs/week)
Role Responsibilities Evaluate a personalization feature for Gemini Design and execute multi-turn conversational prompts that require the AI to utilize personal information and experiences Assess how effectively the model uses past conversations and activity to generate relevant and helpful responses Evaluate model responses based on intent and appropriate personalization Analyze responses for grounding issues, including flawed inferences or hallucinations Assess integration quality to ensure personal data is incorporated naturally into responses Perform side-by-side evaluations and stack-rank model responses based on helpfulness and naturalness Write clear rationales referencing specific conversation turns Extract and verify debug information to confirm correct use of summaries and data sources Maintain data hygiene by deleting evaluation conversations after completion
Requirements Experience in data annotation, AI quality evaluation, content moderation, or related roles Strong Japanese proficiency (reading and writing) Willingness to use a primary personal Google account and enable personal data sources for assessment Strong analytical thinking and attention to detail Experience with creative prompt engineering and personalization concepts Ability to provide structured feedback and clear written explanations Ability to work independently in a remote environment
Application Process Upload resume Interview Submit form
