Role & seniority: AI Model Testing Engineer (mid–senior level implied by scope; not explicit)

Stack/tools: Node.js, TypeScript; experience with AI model APIs (OpenAI, Google, Anthropic); testing pipelines; transcription models; LLMs; real-time inference models; scalable/instrumented infrastructure

Top 3 responsibilities

Design, develop, and maintain testing pipelines and logic for transcription models and other AI models
Collaborate with veterinary medical team to translate clinical scenarios into structured test cases
Implement frameworks for comparative analysis and manage end-to-end AI model testing/infrastructure for scalability and reliability

Must-have skills

Experience building/shipping software that incorporates AI models (LLMs and/or transcription)
Proficiency in Node.js and TypeScript
Familiarity with AI model APIs (OpenAI, Google, Anthropic)
Strong problem-solving, collaborative, and cross-functional communication abilities

Nice-to-haves

Track record of shipping AI-enabled projects
Experience optimizing accuracy, speed, and cost-efficiency
Familiarity with veterinary/medical domain or domain-specific test design (not required)
Location & work type: Flexible remote work environment; no specific location required

Full Description

About the role

We are looking for a scrappy, creative, and detail-oriented AI Model Testing Engineer to build, manage, and continuously enhance our infrastructure for testing and evaluating AI models from leading providers such as OpenAI, Google, and Anthropic. This role will have a particular focus on LLMs & transcription model testing and optimization. You’ll collaborate closely with our medical team to craft targeted test cases, enabling veterinarians to identify and select the most accurate and effective AI workflows.

What you'll do Design, develop, and maintain testing pipelines and logic primarily focused on transcription models, while also covering other AI models such as LLMs and real-time inference models. Collaborate closely with the veterinary medical team to translate clinical scenarios into structured transcription and AI model test cases. Implement frameworks for comparative analysis, allowing veterinarians to systematically review and select optimal AI outputs. Balance and optimize accuracy, quality, speed, and cost-efficiency of AI model usage. Manage end-to-end infrastructure for AI model testing and experimentation, ensuring scalability and reliability. Continuously identify creative solutions to enhance AI performance and usability based on testing feedback and outcomes. Qualifications Demonstrable experience building and shipping software or projects that incorporate AI models (LLMs and/or transcription models), with specific examples of past work. Experience or familiarity with AI model integration. Proficiency with Node.js and TypeScript. Familiarity with APIs from providers such as OpenAI, Google, or Anthropic. Excellent problem-solving skills with a scrappy, innovative mindset—able to devise effective solutions under resource constraints. Strong collaboration and communication skills to effectively partner with cross-functional teams, including medical professionals. Why Join Us? Opportunity to shape the future of veterinary medicine through AI-driven innovation. A highly collaborative, agile environment with room to experiment and innovate. Competitive salary and comprehensive benefits. Flexible remote work environment.

Join CoVet and help us revolutionize veterinary care through cutting-edge AI technology.