🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Crossing Hurdles • South Korea
Role & seniority
LLM – AI Quality Analyst (Personalization) – Korean
Short-Term Contract (2 months), part-time, remote/global
Stack/tools
Data annotation / AI quality evaluation
Content moderation basics
Creative prompt engineering and personalization concepts
Evaluation workflows: side-by-side comparisons, ranking, rationales
Data hygiene: handling and deleting evaluation data, referencing sources
Top 3 responsibilities
Evaluate a Gemini personalization feature and assess integration of personal data into responses
Design and execute multi-turn prompts requiring use of personal information and past conversations
Compare model responses for helpfulness, naturalness, grounding/accuracy; write clear rationales with references to turns
Must-have skills
Strong Korean reading/writing proficiency
Experience in data annotation, AI quality evaluation, or content moderation
Analytical thinking with high attention to detail
Structured feedback and clear written explanations
Experience with prompt engineering and personalization concepts
Ability to work independently in a remote setting
Nice-to-haves
Familiarity with using personal Google accounts and enabling personal data sources for evaluation
Prior experience in debug data extraction and validating data-source usage
Background in data privacy hygiene and evaluation documentation
Location & work type
Location: Remote (Global)
Work typ
Position: LLM – AI Quality Analyst (Personalization) – Korean
Type: Short-Term Contract (2 months)
Compensation: $11 per hour
Location: Remote (Global)
Commitment: Part-time availability required
Role Responsibilities Evaluate a personalization feature for Gemini Design and execute multi-turn conversational prompts that require the AI to utilize personal information and experiences Assess how effectively the model uses past conversations and activity to generate relevant and helpful responses Evaluate model responses based on intent and appropriate personalization Analyze responses for grounding issues, including flawed inferences or hallucinations Assess integration quality to ensure personal data is incorporated naturally into responses Perform side-by-side evaluations and stack-rank model responses based on helpfulness and naturalness Write clear rationales referencing specific conversation turns Extract and verify debug information to confirm correct use of summaries and data sources Maintain data hygiene by deleting evaluation conversations after completion
Requirements Experience in data annotation, AI quality evaluation, content moderation, or related roles Strong Korean proficiency (reading and writing) Willingness to use a primary personal Google account and enable personal data sources for assessment Strong analytical thinking and attention to detail Experience with creative prompt engineering and personalization concepts Ability to provide structured feedback and clear written explanations Ability to work independently in a remote environment
Application Process (Takes 20 Mins) Fill out the application form Complete the ICF Complete the assessment