Quality Assurance Analyst (Korean) | $11/hr Remote
Crossing Hurdles • South Korea
Role & seniority: LLM – AI Quality Analyst (Personalization) – Korean; short-term contract (2 months), part-time
Stack/tools: data annotation / AI quality evaluation / content moderation domain; use of personal Google account and personal data sources for assessment; documentation of rationales and debug info
Top 3 responsibilities
-
Evaluate a personalization feature for Gemini, focusing on use of past conversations and activity
-
Design and execute multi-turn prompts leveraging personal information; assess grounding and relevance
-
Perform side-by-side evaluations, stack-rank model responses by helpfulness/naturalness, write clear rationales, and verify data-source usage
Must-have skills
-
Strong Korean reading/writing proficiency
-
Experience in data annotation, AI quality evaluation, or content moderation
-
Excellent analytical thinking and attention to detail
-
Experience with creative prompt engineering and personalization concepts
-
Ability to provide structured feedback and work independently in a remote setting
Nice-to-haves
-
Familiarity with data privacy/data hygiene practices (e.g., evaluating data disclosures)
-
Experience documenting debug information and data-source verification
-
Comfort with using personal data sources for assessment
-
Location & work type: Remote (Global); Short-Term Contract (2 months); compensation $11/hour; part-time availability required
Full Description
Position: LLM – AI Quality Analyst (Personalization) – Korean
Type: Short-Term Contract (2 months)
Compensation: $11 per hour
Location: Remote (Global)
Commitment: Part-time availability required
Role Responsibilities Evaluate a personalization feature for Gemini Design and execute multi-turn conversational prompts that require the AI to utilize personal information and experiences Assess how effectively the model uses past conversations and activity to generate relevant and helpful responses Evaluate model responses based on intent and appropriate personalization Analyze responses for grounding issues, including flawed inferences or hallucinations Assess integration quality to ensure personal data is incorporated naturally into responses Perform side-by-side evaluations and stack-rank model responses based on helpfulness and naturalness Write clear rationales referencing specific conversation turns Extract and verify debug information to confirm correct use of summaries and data sources Maintain data hygiene by deleting evaluation conversations after completion
Requirements Experience in data annotation, AI quality evaluation, content moderation, or related roles Strong Korean proficiency (reading and writing) Willingness to use a primary personal Google account and enable personal data sources for assessment Strong analytical thinking and attention to detail Experience with creative prompt engineering and personalization concepts Ability to provide structured feedback and clear written explanations Ability to work independently in a remote environment
Application Process Fill out the application form Complete the ICF Complete the assessment
