AI Automation Engineer

Wipro•Bellevue, WA

5h•$100,000 - $180,000•Onsite

About The Position

Wipro Limited is seeking an AI Automation Engineer to design and build end-to-end AI testing frameworks. This role involves creating automated test cases, validating model outputs, and developing load and performance testing strategies. The engineer will also build LLM evaluation pipelines and own the regression testing strategy for the AI platform to ensure quality and prevent degradation. The position is based in Bellevue (Seattle area), WA.

Requirements

Experience with LLM Evaluation frameworks like Promptfoo, DeepEval, Ragas etc.
Handon experience with AI Automation frameworks using Python PyTest, Unittest.
Experience with Load and performance testing using Locust, Jmeter etc.
Autonomous Network AI Engineering experience: 8-10 Years.
Overall IT experience: Minimum 10 years.
AI Experience: 3 Years.

Nice To Haves

AIOps/MLOps knowledge
Observability for AI
Experience working on projects for Telecom operators like T-Mobile, AT&T, Verizon or OSS/BSS area.

Responsibilities

Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing.
Develop automated test case generation and model output validation against defined quality benchmarks.
Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability under peak load.
Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows.
Own regression testing strategy across the AI platform maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts after every release.