Senior Quality Assurance Analyst
Filevine • United States
Salary: $110,000 - $140,000 / year
Role & seniority: Senior QA professional (experience across traditional QA, AI systems, and telecom integrations)
Stack/tools: Manual testing, API testing, webhooks, third-party telephony integrations, event-driven architectures; AI/ML feature validation (non-deterministic outputs), transcription accuracy, data traceability; QA documentation and standards
Top 3 responsibilities
-
Lead quality efforts for complex features (AI-powered call routing, inbound/outbound calling, third-party telephony integrations)
-
Design and execute end-to-end test strategies for workflows, integrations, and event-driven systems
-
Validate AI-generated conversations, call summaries, transcription, data capture, and downstream event notifications; ensure compliance and release readiness
Must-have skills
-
Advanced manual testing methodologies and test case design
-
Strong API, webhook, and third-party integration testing
-
Solid telephony knowledge (call flows, routing, IVR, voicemail)
-
Experience validating AI/ML features, non-deterministic outputs, regression risk
-
Assess transcription accuracy, conversational intent, AI response quality
-
Experience with event-driven architectures and data delivery
-
Familiarity with compliance workflows, auditability, and data traceability
-
Strong analytical, problem-solving, and communication skills; ability to influence development teams
Nice-to-haves
-
Experience mentoring QA teams
-
Experience shaping requirements,
Full Description
Filevine is forging the future of legal work with cloud-based workflow tools. We have a reputation for intuitive, streamlined technology that helps professionals manage their organization and serve their clients better. We’re also known for our team of extraordinary and passionate professionals who love working together to help organizations thrive. Our success has catapulted Filevine to the forefront of our field—we are ranked as one of the most innovative and fastest-growing technology companies in the country by both Deloitte and Inc.
Our Mission Filevine is building the seamless intersection between legal and business by creating a world- class platform to help professionals scale.
Role Summary
- Seeking a highly experienced QA professional who can operate comfortably across traditional QA, AI systems, and telecom integrations. This role is responsible for driving quality initiatives across AI driven telephony workflows, mentoring QA team members, and partnering closely with Product and Engineering to ensure reliable, compliant, and scalable software releases.
Responsibilities
Lead quality efforts for complex features including AI powered call routing, inbound and outbound calling, and third party telephony integrations Design and execute comprehensive test strategies covering end-to-end workflows, integrations, and event driven systems Validate inbound call capture, recording, transcription, summarization, and downstream event notifications Test phone registration workflows, including business registration, A2P compliance, and SHAKEN/STIR related processesEnsure accuracy and reliability of AI generated conversations, call summaries, and data capture across varied scenarios Validate management applications used to configure call flows, routing logic, permissions, and reporting Identify edge cases related to dropped calls, transcription errors, AI confidence thresholds, and third party provider failures Contribute to and maintain QA documentation, standards, and the organizational knowledge base Partner with Product and Engineering to influence requirements, design decisions, and release readiness Drive continuous improvement by identifying gaps in processes, tooling, and test coverage
Qualifications
Advanced expertise in manual testing methodologies and test case design for complex systems Strong experience testing APIs, webhooks, and third party integrations Solid understanding of telephony concepts such as call flows, call routing, IVR behavior, and voicemail Experience validating AI or ML assisted features, including non deterministic outputs and regression risks Ability to assess transcription accuracy, conversational intent recognition, and AI response quality Experience testing event driven architectures and downstream data delivery Familiarity with compliance driven workflows, auditability, and data traceability Strong analytical and problem solving skills with attention to detail Excellent written and verbal communication skills, including clear defect documentation Ability to influence development teams and advocate effectively for quality initiatives
Compensation Information: $110,000 - $140,000
The base salary range represents the low and high end of the salary range for this position. The total compensation package for this position will be determined by each individual’s location, qualifications, education, work experience, skills and performance. We believe in the importance of pay equity - the range listed is just one component of Filevine’s total compensation package for employees. This position is also eligible for a paid time off policy, as well as a comprehensive benefits package.
Cool Company Benefits
A dynamic, rapidly growing company, focused on helping organizations thrive Medical, Dental, & Vision Insurance (for full-time employees) Competitive & Fair Pay Maternity & paternity leave (for full-time employees) Short & long-term disability Opportunity to learn from a dedicated leadership team Centrally located open office building in Sugar House (onsite employees) Top-of-the-line company swag
Privacy Policy Notice Filevine will handle your personal information according to what’s outlined in our Privacy Policy.
Communication about this opportunity, or any open role at Filevine, will only come from representatives with email addresses using "filevine.com". Other addresses reaching out are not affiliated with Filevine and should not be responded to.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us. Show more Show less