Orion Innovation logo

Quality Assurance Tester

Orion Innovation Minnesota City, Minnesota, United States

onsite
Posted Feb 23, 2026

Role & seniority: Global Red Team Tester (senior-level; minimum 5 years in penetration testing/red team ops)

Stack/tools

  • Testing/security tools: SPLX, Garak, TextAttack, PyRIT, Burp Suite, Metasploit, Nessus, Cobalt Strike/Mythic/C2, NMAP, sqlmap

  • Web/app/network: HTTP, DNS, FTP; cloud and networking fundamentals

  • Generative AI/security: Generative AI, Agents, A2A, MCP

  • Programming: Python, Ruby, Go, PowerShell, Bash (or similar)

  • Certifications: OSCP, GPEN, GPXN, HackTheBox AI Red Teamer path, AISEC+ (desired)

Top 3 responsibilities

  1. Design and execute adversarial testing campaigns against AI models (LLMs, multimodal systems, autonomous agents)

  2. Conduct red team exercises simulating real-world deployment; probe for bias, toxicity, misinformation; develop remediation recommendations

  3. Collaborate with security teams and developers; document findings, create adversarial datasets, report metrics, and support risk mitigation

Must-have skills

  • 5+ years in penetration testing/red team operations

  • Background in AI red teaming, web/app/network pentesting, and cyber security

  • Familiarity with threat intelligence; strong cross-geo stakeholder communication

  • Proficiency with listed tools and web technologies; programming in at least a couple of the specified languages

Nice-to-haves

  • Experience deploying AI security tooling; AI-specific certifications; AI security tool evaluation

  • Additional certifications (GPXN, AI Red Teamer p

Full Description

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Role summary

  • The Global Red Team Tester will conduct testing of AI models to find vulnerabilities, develop new evaluation frameworks, communicate risks to stakeholders across the global teams and the network of member firms, collaborate with defensive and development teams, and mentor junior team members.
  • % of time Accountability

Key accountabilities

10

Design and execute comprehensive adversarial testing campaigns against AI models, including but not limited to large language models, multimodal systems, and autonomous agents.

10

Research attack vectors and prompt injection techniques to identify model vulnerabilities, jailbreaks, and unintended behaviors. Evaluate and introduce AI Security tools that decrease mean time to detect and respond to AI-specific threats.

50

Conduct red team exercises simulating real-world deployment scenarios and edge cases. Systematically probe for bias, toxicity, misinformation generation, and other harmful outputs across diverse contexts and demographics. Improve firm’s security posture against emerging AI threats. Concentration is on executing standardized security tests.

10

Create adversarial datasets and benchmarks to evaluate model robustness under various attack conditions.

10

Collaborate with security teams (e.g., GSOC, member firm security teams, developers) to perform red teaming activities, and document and present findings, vulnerabilities, and remediation recommendations to drive the mitigation of identified risks.

10

Develop and maintain process documentation, create reports on testing activities, track operational metrics, and perform other programmatic tasks as required to support the AI Red Team's function.

Required

  • Minimum 5 years of penetration testing or red team operations experience.
  • Computer science, information technology, or cybersecurity degree (Bachelor's or higher preferred) from an accredited college or university or equivalent work experience.
  • Background in AI red teaming, web application pentration testing, application/network penetration testing, red team operations, or cyber security.
  • Familiarity with threat intelligence. Understanding of Artificial Intelligence, Machine Learning, software applications, cloud computing, and networking.
  • Excellent communication and stakeholder management skills. Ability to work effectively across geographies and time zones.

Core technical skills include

Testing tools: SPLX, Garak, TextAttack, PyRIT, Burp Suite, Metasploit, Nessus, Cobalt Strike/Mythic/C2, NMAP, sqlmap, or similar tools (familiar with some of these tools or similar) Web application technologies and layer 7 protocols (HTTP, DNS, FTP) Technical experience in Generative AI, Agents, A2A, and/or MCP

Programming languages: Python, Ruby, Go, PowerShell, bash or similar (familiar with some of these languages or similar)

Certifications: OSCP, GPEN, GPXN, AI Red Teamer Job Role Path (HackTheBox), AISEC+, or other industry AI or Red Team related certifications desired Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law. Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains

  • What information we collect during our application and recruitment process and why we collect it;
  • How we handle that information; and
  • How to access and update that information.
  • Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.
Adversarial TestingAI ModelsLarge Language ModelsMultimodal SystemsAutonomous AgentsPrompt InjectionAI Security ToolsRed TeamingBias DetectionToxicity DetectionMisinformation GenerationAdversarial DatasetsSecurity TestingStakeholder ManagementPenetration TestingThreat Intelligencemulti-location

Cookies & analytics consent

We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.

Read how we use data in our Privacy Policy and Terms of Service.