🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Fusemachines • New York, New York, United States
Salary: 10+ year old AI compa
Role & seniority: QA Engineering Lead (mid-senior level) focused on ML web applications; hands-on leadership and mentoring responsibilities.
Stack/tools: ML/AI web apps; programming (Python, R); automated testing tools (Selenium, JUnit, TestNG); ML testing (functional, performance, scalability); familiarity with LLM evaluation frameworks; Agile experience.
Lead QA efforts: develop/implement test plans, cases, and strategies for ML applications; drive automation adoption.
Test design & execution: create tests for new features, perform regression testing, and verify/validate ML models.
Collaboration & governance: work with product, ML engineers, and software engineers; define QA metrics; mentor junior QAs; participate in release planning and issue resolution.
5+ years QA/software testing experience; some ML application exposure.
Familiarity with ML concepts and ML/LLM testing approaches.
Programming experience (Python, R or similar); hands-on automation tool experience (Selenium, JUnit, TestNG).
Strong analytical, problem-solving, and cross-functional collaboration abilities; Agile experience preferred.
Direct experience with LLMs and LLM evaluation frameworks.
Deep experience in ML model testing (functional, performance, scalability) and ML deployment cycles.
Prior mentoring/leadership of QA teams.
Location & work type: Hybrid role based in Hicksville, Long Island; in-p
About Fusemachines
Fusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Founded by Sameer Maskey, Ph.D., an Adjunct Associate Professor at Columbia University, our company is on a steadfast mission to democratize AI and harness the power of global AI talent from underserved communities. With a robust presence in four countries and a dedicated team of over 400 full-time employees, we are committed to fostering AI transformation journeys for businesses worldwide. At Fusemachines, we not only bridge the gap between AI advancement and its global impact but also strive to deliver the most advanced technology solutions to the world.
Position Overview
We are seeking an experienced QA Engineering Lead with a background in testing machine learning (ML) web applications to join our team. Bonus: If you have worked with LLM's.
The ideal candidate will lead the quality assurance efforts with a very hands-on attitude for our ML-driven projects, ensuring the highest standards of quality and reliability are met.
The QA Engineering Lead will collaborate closely with cross-functional teams, mentor junior QA engineers, and drive the adoption of best practices in ML Application testing methodologies.
Hybrid. Must be able to meet in Hicksvile, Long Island twice a week*
Responsibilities
Lead the QA team in developing and implementing comprehensive test plans, test cases, and strategies specific to machine learning applications Drive the adoption of automated testing tools and frameworks to increase testing efficiency and coverage Create strategies and tests for new product features, in addition to executing regression testing of existing features Work with development teams to develop test plans, test suites, and test cases to ensure that the software stack is thoroughly verified and validated through manual and automated methods Submit, track, and verify defects through the software development lifecycle, ensuring timely resolution Write documents, tests, scripts, and tools to help facilitate testing and improve efficiency Define and establish QA metrics, measuring the effectiveness of testing processes and identifying areas for improvement Collaborate with product owners, machine learning engineers, and software engineers to ensure alignment on quality objectives and priorities Design and execute testing for ML models, including functional, performance, and scalability testing Mentor and provide guidance to junior QA engineers on testing methodologies and best practices Stay current with industry trends and advancements in ML testing techniques and tools Participate in release planning and deployment activities for ML-driven features, ensuring smooth integration and deployment Investigate and troubleshoot issues related to ML model performance or behavior, working closely with data scientists and engineers to resolve them Conduct functional, regression, performance, and security testing as needed Drive the adoption of automated testing tools and frameworks to increase testing efficiency and coverage Define and establish QA metrics to measure the effectiveness of testing processes and identify areas for improvement Participate in release planning and deployment activities, ensuring a smooth and successful release process Investigate and troubleshoot issues reported by customers or internal stakeholders, identifying root causes and driving resolution
Bachelor's degree in Computer Science, Engineering, or related field; or equivalent work experience 5 years of experience in quality assurance or software testing, with a some experience working on machine learning applications Familiarity with basic machine learning concepts Familiarity in programming languages commonly used in ML development (e.g., Python, R, etc.) Experience in designing and implementing effective test strategies for ML models including LLM's Excellent analytical and problem-solving skills, with a keen attention to detail Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams Experience with Agile development methodologies is preferred Familiarity with LLM evaluation frameworks Hands-on experience with automated testing tools and frameworks (e.g., Selenium, JUnit, TestNG, etc.).
Fusemachines is an Equal Opportunities Employer, committed to diversity and inclusion. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or any other characteristic protected by applicable federal, state, or local laws.
Powered by JazzHR
jsVBCScuOD