🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Bottomline • Lebanon, Pennsylvania, United States
Salary: $16 trillion in pa
Role & seniority: Senior AI Quality Assurance Engineer
Python; testing frameworks (PyTest, Selenium)
ML frameworks (TensorFlow, PyTorch); MLOps tools
CI/CD pipelines; cloud platforms (AWS, Azure, GCP)
AI QA platforms and low-code/no-code automation tools (preferred)
Testing & validation: develop/execute test plans for AI models; manual and automated testing; bias, edge-case, and stress testing
Automation & tools: design/implement automated testing frameworks; use AI-powered QA tools; maintain self-healing test scripts
Compliance & collaboration: ensure adherence to ethical/regulatory standards; maintain Generative AI BoMs; work with ML engineers, data scientists, and product managers; participate in code reviews
Bachelor’s in CS/Software Engineering or related field
3–7 years QA experience, with ≥2 years in AI/ML testing
Proficiency in Python and PyTest/Selenium; knowledge of TensorFlow/PyTorch; CI/CD and cloud platforms (AWS/Azure/GCP)
Strong analytical, problem-solving, and collaboration skills
Understanding of ethical AI principles and bias testing
Experience with low-code/no-code automation tools and AI-driven QA platforms
Knowledge of regulatory compliance for AI systems
Why Choose Bottomline? Are you ready to transform the way businesses pay and get paid? Bottomline is a global leader in business payments and cash management, with over 35 years of experience and moving more than $16 trillion in payments annually. We're looking for passionate individuals to join our team and help drive impactful results for our customers. If you're dedicated to delighting customers and promoting growth and innovation - we want you on our team! Senior AI Quality Assurance Engineer Role Overview An AI Quality Assurance Engineer ensures the accuracy, reliability, and compliance of AI systems and models before deployment. This role is critical for validating AI-driven applications, detecting defects, and safeguarding against risks such as bias, hallucinations, and non-deterministic behavior. The position involves designing robust test strategies for machine learning models and collaborating with data scientists, ML engineers, and product teams to maintain high-quality standards. Key Responsibilities · Testing & Validation o Develop and execute comprehensive test plans for AI models and systems. o Perform manual and automated tests to validate AI functionality under various scenarios. o Conduct bias detection, edge-case testing, and stress testing for AI models. · Automation & Tools o Design and implement automated testing frameworks for AI workflows. o Utilize AI-powered QA tools and self-healing test scripts to improve efficiency. · Compliance & Governance o Ensure AI systems adhere to ethical guidelines, regulatory standards, and internal policies. o Maintain documentation such as Generative AI Bill of Materials (BoM) for transparency and audits. · Collaboration o Work closely with ML engineers, data scientists, and product managers to resolve defects. o Participate in code reviews and contribute to continuous improvement initiatives. · Monitoring & Reporting o Analyze test results, identify defects, and track quality metrics. o Provide risk assessments and recommendations for AI deployments. Required Skills & Qualifications
· Education: Bachelor’s in Computer Science, Software Engineering, or related field.