Full Description

Role Description

Experience - As long as adequate experience is there number of years doesn't matter

Joining Date - Immediate

Job Title: Gen AI Architect (Tosca Preferred)

Overview

We are seeking a Gen AI Architect to lead the design and implementation of AI-driven automation frameworks. While experience with Tosca is highly preferred, candidates with strong expertise in other automation tools and a solid background in Generative AI are also encouraged to apply.

Key Responsibilities

Architect and implement automated test suites for GenAI models and enterprise workflows. Design and execute structured test cases, including unit, integration, and system testing for AI/ML systems. Lead GenAI-driven test case generation using Tosca or other automation platforms. Integrate GenAI testing into CI/CD pipelines and collaborate with development teams for seamless automation. Evaluate GenAI outputs using contextual comparison methodologies and validation metrics. Use tools such as LangChain, AgentGPT, SageMaker, Selenium, or other relevant platforms for automation and validation. Analyze test results, provide actionable insights, and drive model improvement. Maintain documentation for test frameworks and ensure compliance with data standards. Develop governance agents to automate metric extraction, dashboards, and health reporting. Prepare and implement AI governance and adversary testing frameworks.

Skills

tosca,test data management,hp alm,keyword driven testing,risk based testing, Show more Show less