Full Description

Position: Bilingual Traditional Chinese Generalist Evaluator Expert

Type: Hourly contract

Compensation: $25-$30 per hour

Location: Remote

Commitment: 10-40 hours/week

Role Responsibilities Create detailed prompts in Traditional Chinese and/or English with multiple constraints and instructions, ensuring natural phrasing and real-world relevance Establish high-level expectations for correct responses in Traditional Chinese consumer contexts and develop comprehensive evaluation rubrics Run prompts through models and assess outputs for accuracy, fluency, and cultural fit in Traditional Chinese, comparing results against English where needed Collaborate in QA review processes to ensure prompt tasks and rubrics maintain consistency and reliability before integration into official evaluations

Requirements Native-level fluency in written Traditional Chinese with strong reading and writing ability in English BS or BA from a reputable institution (completed or in progress) Strong writing and critical thinking skills Ability to work independently and meet deadlines Significant familiarity with ChatGPT or similar tools for personal decision-making, hobbies, or general interests Experience in teaching, research, editing, or academic writing Experience creating evaluation criteria, rubrics, or grading guidelines Familiarity with LLMs, prompting, or model evaluation

Application Process (Takes 20 Mins) Upload resume Interview (15 min) Submit form