Pyramid Consulting, Inc logo

Quality Assurance Engineer

Pyramid Consulting, Inc San José, Costa Rica

onsitefull-time
Posted Feb 11, 2026Apply by Mar 13, 2026

Role & seniority: Software Quality Assurance; individual contributor with informal leadership experience

Stack/tools: QA automation and UI tools (QTest, Axe DevTools, Selenium, Karate, SoapUI/ReadyAPI, DevTest, Bobcat, Mocha, Saucelabs, Perfecto, Azure Data Studio); digital experience & analytics platforms (Adobe CJA/Launch, Adobe Analytics, SiteSpect); web technologies; test planning & reporting

Top 3 responsibilities

  • Plan, execute, and govern QA across digital experiences, A/B tests, personalization, and analytics tagging (SIT, UAT, performance, production validation)

  • Develop and enforce QA strategies, test plans, entry/exit criteria, and quality metrics; lead/test scenario development; collaborate with IT/business on scope and risks

  • Generate reports/metrics, track progress, resolve blockers, and ensure timely delivery within milestones

Must-have skills

  • 6+ years in Software Quality Assurance; 4+ years automation testing; 2+ years technical testing; 2+ years programming/scripting

  • 1+ year in informal technical leadership; 1+ year debugging analytics tags; 1+ year performance/monitoring with tools (Adobe CJA, Dynatrace, BlueTriangle)

  • Experience with automated UI/testing tools and end-to-end manual QA of digital experiences; A/B testing and personalization

Nice-to-haves

  • Experience with SDLC, vendors, large matrix organizations, and technical documentation in QA

  • Healthcare domain, data warehousing concepts, data mart knowledge; Adobe

Full Description

Hi Hope you are doing well ! Please find the below job description and let me know if you are comfortable with this opportunity

Role: Software Quality Assurance

Location: Onsite Costa Rica

Type: Full time

Job Summary This individual contributor role is primarily responsible for performing Quality Assurance (QA) testing of digital experiences and analytics implementations related to A/B experiments, personalization activities, and analytics tagging across client.org and the Mobile App ecosystem. The role focuses on validating experiments, personalized content experiences, and analytics tracking deployed via platforms such as Adobe CJA/Launch, SiteSpect, and similar web technologies. Additionally, this position contributes to the development of a formal Global Quality Services Framework and supports the design of effective software quality assurance strategies and test methodologies.

Essential Responsibilities

Key duties include

  • Complete work assignments by applying up-to-date domain knowledge while meeting deadlines and adhering to established procedures, policies, and standards.
  • Collaborate cross-functionally to resolve business and technical challenges, communicate progress, and escalate risks when necessary.
  • Pursue continuous self-development and build effective working relationships by actively sharing knowledge, seeking feedback, and adapting to change.
  • Identify, define, and mitigate complex testing issues, dependencies, and risks.
  • Determine appropriate testing scope, strategies, and approaches in partnership with IT and business stakeholders.
  • Ensure test plans and timelines align with project and program milestones.
  • Lead and support the development of QA strategies, methodologies, and standard processes for moderately to highly complex initiatives.
  • Review and validate testable business processes, test data, and test environment requirements.
  • Define and enforce adherence to entry and exit criteria in accordance with organizational testing standards.

Manage test scenario development and execution across testing phases, including

  • System Integration Testing (SIT)
  • Performance Testing
  • User Acceptance Testing (UAT)
  • Automation Testing
  • Production Validation
  • Generate scheduled reports, including test execution metrics, defect summaries, and ad hoc reports for stakeholders and management.
  • Collaborate with cross-functional teams to obtain approval for test plans and track quality metrics throughout testing cycles.
  • Develop QA project plans, including scope, schedules, milestones, critical paths, and staffing considerations.
  • Ensure quality metrics are consistently monitored and maintained across all testing phases.

Minimum Qualifications Bachelor’s degree in Computer Science, Computer Information Systems (CIS), or a related field. Equivalent work experience may substitute for the degree requirement. Minimum 6 years of experience in Software Quality Assurance (SQA), software testing, or related fields. Minimum 4 years of experience with automation testing methodologies. Minimum 2 years of experience with technical testing methodologies. Minimum 2 years of experience in software/systems programming or scripting. Minimum 1 year of experience in an informal leadership role within technical teams.

Additional Requirements

Candidates should have demonstrated experience in

  • Automated Testing (3+ years)
  • Experience with UI and automation tools such as QTest, Axe DevTools, Selenium, Karate Framework, SoapUI/ReadyAPI, DevTest, Bobcat, Mocha, Saucelabs, Perfecto, Azure Data Studio, or similar technologies.
  • Manual Testing (3+ years)
  • Testing within digital experience programs (websites, campaigns, experiments, front-end feature releases).
  • A/B Testing & Personalization
  • Minimum 1 year creating test cases specific to A/B testing and personalization requirements.
  • Minimum 2 years performing end-to-end manual QA of digital experiences.
  • Debugging & Validation
  • Minimum 1 year debugging code and analytics tags using tools such as Chrome Developer Tools, Charles Proxy, or similar.
  • Performance Monitoring & Analytics
  • Minimum 1 year monitoring experience performance using tools such as Adobe CJA, Dynatrace, or BlueTriangle.
  • Minimum 1 year setting up synthetic monitoring (trainable).
  • Project Coordination / Management
  • Minimum 2 years tracking project status, removing blockers, and supporting delivery within targeted release windows.

Preferred Qualifications

The following are desirable but not required

  • Experience interacting with leadership-level stakeholders.
  • Experience working within large, matrixed organizations.
  • Experience collaborating with IT vendors.
  • Experience supporting Software Development Life Cycle (SDLC) implementations.
  • Experience writing technical documentation within QA or testing environments.
  • Experience working with integration technologies (e.g., web services, MQ).
  • Experience in virtual testing environments.
  • Experience in healthcare domain testing.
  • Experience testing business systems applications.
  • Experience with data mart or data warehousing concepts.
  • Master’s degree in Computer Science, CIS, or related field.
  • QA-related certifications (QAI, ASQ, or similar).

Minimum 2 years of experience working with Adobe platforms, including

  • Adobe Experience Manager (AEM)
  • Adobe Target
  • Adobe Analytics / CJA
  • Adobe Launch
multi-location

Cookies & analytics consent

We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.

Read how we use data in our Privacy Policy and Terms of Service.