Utkarsh Sinha — QA Automation Architect | AI-Driven Quality Engineering Leader

$ whoami

QA Automation Architect | AI-Driven Quality Engineering Leader

18+ years leading enterprise testing initiatives across BFSI, Healthcare, E-Commerce & Supply Chain. Building AI-powered test automation platforms with NLP, RAG, and multi-agent orchestration — turning manual QA into intelligent, self-driving quality engineering.

18+years experience

70%automation coverage

99.5%production stability

20+engineers mentored

get in touch view work

utkarsh@career: ~

$ cat profile.json

{
  "name": "Utkarsh Sinha",
  "role": "QA Automation Architect",
  "location": "Gurgaon, Haryana, India",
  "focus": ["AI Test Automation", "RAG", "MLOps"],
  "experience_years": 18,
  "current": "Fidelity International",
  "status": "open_to_opportunities"
}

$ _

01 · about

Executive Summary

Results-driven QA Automation Architect and Test Manager with 18+ years leading enterprise testing initiatives across BFSI, Healthcare, E-Commerce, and Supply Chain. Built scalable automation frameworks and CI/CD pipelines that drove 70% automation coverage and 40% faster regression cycles, underpinned by strong program management, release orchestration, and cross-functional stakeholder leadership.

Pioneered AI adoption in QA at Fidelity International, architecting an AI-powered test case generation platform (NLP, PyTorch, GPT-4.1) that cut manual test-design effort by 70%, and extending this into RAG pipelines, MCP-based tool integration, and LangChain/LangGraph multi-agent orchestration. Post Graduate in Artificial Intelligence (University of Texas, Austin), with hands-on expertise in MLOps, neural networks, regression modeling, cloud infrastructure (AWS/Azure), and performance engineering.

▲

Reduced regression testing cycle time by 60% through strategic automation and CI/CD integration at Fidelity International

◆

Implemented a QA Agent (LangGraph + LiteLLM) to auto-write manual & Playwright scripts running on the SIT environment

✓

Achieved 70% automation coverage across enterprise applications, improving release velocity and quality

◇

Built 3 end-to-end automation frameworks from scratch spanning Web, API, Database, and ETL testing

■

Led bi-weekly production releases with 99.5% stability and zero critical defects in production

★

Mentored and upskilled 20+ QA professionals, fostering a high-performance testing culture

02 · experience

Professional Experience

04/2020 — Present · Pune, India

Manager – Program Manager (Release & Automation)

Fidelity International

Spearheaded AI transformation in QA, driving adoption of RAG, AI test generation, and intelligent defect prediction
Developed an AI-powered test case generation solution using NLP and machine learning, reducing manual test-design by 70%
Implemented MLOps practices and enterprise-wide automation governance for seamless bi-weekly releases
Orchestrated cross-functional collaboration across multiple Agile teams, embedding CI/CD practices
Achieved 70% automation coverage and 40% reduction in regression cycle time via strategic automation roadmaps and Shift-Left testing
Established quality gates and KPIs, ensuring 99.5% production stability with executive-level dashboards
Mentored 15+ QA engineers and led technical interviews

09/2018 — 04/2020 · Pune, India

Test Architect

Globant India Ltd

Architected end-to-end test automation frameworks for a Big Data Supply Chain Analytics platform (Azure, NiFi, Hive, Power BI)
Built a Spring Boot + JUnit automation framework for ETL testing, schema validation, and data integrity checks
Designed a custom Data Generation tool for realistic test datasets across functional, performance, and load scenarios
Automated Azure Data Factory (ADF) pipeline testing, validating data accuracy and transformation logic
Achieved 60% reduction in manual testing effort through intelligent automation and reusable components

08/2015 — 09/2018 · Pune, India

Principal QA Engineer

Microsoft India

Led a team of 10+ automation engineers for a Healthcare NLP product serving US-based clients
Built SOAP API automation frameworks using Java, TestNG, and REST Assured, achieving 80% API test coverage
Served as Scrum Master for a 15-member feature team, facilitating sprint ceremonies
Implemented real-time Linux environment monitoring, reducing downtime by 30%
Automated test environment setup, cutting setup time from 4 hours to 15 minutes

10/2013 — 08/2015 · Pune, India

Sr. Technical Associate

SEARS Holdings India

Managed an 8-member automation team for an Online Media Locker platform as onsite POC
Automated RESTful API testing using Java and REST Assured, reducing manual effort by 50%
Coordinated with US-based clients (Neustar, Sterling) on requirements, test planning, and defect triage

07/2010 — 10/2013 · Pune, India

Sr. QA Engineer

Cybage Softwares Pvt. Ltd

Performed functional, regression, and automation testing for a US Auto Parts e-commerce platform
Built Selenium WebDriver automation scripts, reducing regression testing time by 35%

06/2007 — 07/2010 · Pune, India

QC Engineer

Ubisoft Entertainment Pvt. Ltd

Conducted functional, compatibility, and localization testing across all game consoles
Prepared test cases, test matrices, and defect reports ensuring high-quality game releases

03 · skills

Core Competencies & Tech Stack

// Automation Tools & Frameworks

Selenium WebDriverAppiumCucumber TestNGJUnitRobot Framework GaugeBDD/TDDSpring Boot REST AssuredSoapUIReady API UiPath (RPA)TestComplete

// Gen AI / ML Tools & Frameworks

LangChainLangGraph OpenAI API (GPT-4/5)Pinecone ChromaDBFAISS Prompt EngineeringRAG PyTorchMLflow MCP

// Programming & Scripting

JavaPythonGroovy C#JavaScriptShell Scripting VBA

// CI/CD & DevOps

JenkinsAzure DevOpsGit GitHub ActionsDockerTerraform

// Cloud & Infrastructure

AWS (EC2, S3, Lambda)Azure DockerKubernetesTerraform

// Methodologies & Leadership

AgileScrumKanbanSAFe Test Strategy & PlanningStakeholder Management Team Leadership & Mentoring

04 · projects

Selected Work

$ai_test_generator.py

AI-Powered Test Case Generation Platform

NLP + PyTorch + GPT-4.1 platform that auto-generates test cases from requirements, cutting manual test-design effort by 70% at Fidelity International.

NLPPyTorchGPT-4.1

$qa_agent.js

QA Agent — LangGraph & LiteLLM

Multi-agent orchestration that auto-writes manual and Playwright test scripts, executed automatically against the SIT environment.

LangGraphLiteLLMPlaywright

$rag_pipeline.py

RAG & MCP-Based Tool Integration

Retrieval-augmented generation pipelines with vector search (Pinecone, ChromaDB, FAISS) and MCP-based tool integration extending AI test automation across product lines.

RAGMCPVector DBs

$etl_framework.groovy

Big Data / ETL Automation Framework

Spring Boot + JUnit framework for ETL testing on a Big Data Supply Chain Analytics platform — schema validation, data integrity checks, and Power BI report validation across Azure, NiFi & Hive.

AzureNiFiPower BI

$data_generator.py

Custom Test Data Generation Tool

Configurable engine that produces realistic datasets to support functional, performance, and load testing scenarios at scale.

PythonData Engineering

$ai_recruit.ipynb

AI Recruit — Fair Candidate Matching

Academic capstone (UT Austin): modular system for NLP resume parsing, candidate-job matching with fairness constraints and explainable AI, plus an ensemble-model engagement forecaster reaching R² of 77.9%.

NLPExplainable AIRegression

05 · education & certifications

Education

Post Graduate in Artificial Intelligence

University of Texas, Austin

08/2025 — 01/2026 GPA 3.76 / 4.00

AI Recruit — modular system: NLP parsing, candidate-job matching, fairness constraints, explainable AI
Ensemble trees & neural network models for classification and clustering
Predictive analytics model (linear regression) forecasting user engagement — R² of 77.9%

Bachelor of Engineering (B.E.) — Electronics & Telecommunication

Pt. Ravishankar Shukla University (CSIT College)

Higher Secondary (10+2) — Biology + Mathematics

CBSE Board

Certifications & Training

AI for Leaders

Great Learning — affiliated with University of Texas, Austin McCombs School of Business

Certified Scrum Master (CSM)

Scrum Alliance — 100% score

RPA Developer Advanced Certification

UiPath