crewlia logo

Software Tester (Remote)

crewlia • Ireland

remotecontract
Posted Oct 26, 2026

**Role & seniority: ** Software Tester (contract), likely mid-level/individual contributor

**Stack/tools: **

  • Multimodal dataset review/annotation (text, images, spreadsheets, structured documents)

  • QA auditing against project guidelines/rubrics

  • Tools not explicitly stated (focus on dataset annotation and validation)

**Top 3 responsibilities: **

  • Annotate, categorize, and validate large-scale multimodal datasets per strict guidelines

  • Audit AI outputs for hallucinations, formatting errors, and prompt deviations

  • Identify edge cases, labeling ambiguities, and data inconsistencies to improve taxonomies

**Must-have skills: **

  • Strong reading comprehension, logical reasoning, and attention to subtle errors

  • Native-level English fluency and exceptional written communication

  • Ability to evaluate work against strict rubrics/guidelines (required/strongly preferred)

  • Meet daily volume targets while maintaining rigorous QA standards

  • Reliable high-speed broadband and quiet workspace for remote work

**Nice-to-haves: **

  • Experience evaluating creative or technical work against strict guidelines/rubrics

**Location & work type: **

  • Remote (Contract)

  • Applicants must currently reside in Australia, Canada, Ireland, New Zealand, or the United States

  • Note: applications from other regions will be rejected; text also states geographically located within the US or Canada (inconsistent—follow p

Full Description

Role: Software Tester (Remote)

Location: Remote (Australia, Canada, Ireland, New Zealand, United States)

Employment Type: Contract

Location: Applicants must currently reside in Australia, Canada, Ireland, New Zealand or the United States.

Overview

  • We are looking for a detail-oriented Software Tester to review, annotate, and structure multimodal datasets for advanced artificial intelligence models. You will play a crucial role in improving data quality across text, images, spreadsheets, and complex structured documents.

Key Responsibilities

  • Annotate, categorize, and validate large-scale multimodal datasets according to strict project guidelines.
  • Audit AI system outputs to identify hallucinations, formatting errors, or deviations from user prompts.
  • Identify edge cases, labeling ambiguities, and data inconsistencies to help improve labeling taxonomies.
  • Consistently meet daily volume targets while upholding rigorous quality assurance standards.

Requirements

  • Superb reading comprehension, logical reasoning, and a sharp eye for spotting subtle errors.
  • Experience evaluating creative or technical work against strict rubrics or guidelines is strongly preferred.
  • Native-level fluency in English with exceptional written communication skills.
  • Consistent, high-speed broadband connection and a quiet remote working environment.
  • Geographically located within the US or Canada (applications from other regions will be rejected).

Equal Opportunity Employer

  • We are an equal opportunity employer. We are committed to building an inclusive workplace and welcome applications from all qualified individuals regardless of race, color, ethnicity, nationality, gender, gender identity or expression, sexual orientation, age, religion, disability, marital status, or any other characteristic protected by applicable law. All hiring decisions are made solely on the basis of qualifications, skills, and demonstrated ability.

Apply Now!

Attention to DetailAuditing AI OutputsData CategorizationData ValidationDataset AnnotationError DetectionLogical ReasoningQuality AssuranceReading ComprehensionRubric EvaluationTaxonomy ImprovementWritten Communication

Cookies & analytics consent

We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.

Read how we use data in our Privacy Policy and Terms of Service.