The Principal Product Management Engineer will lead the strategy, architecture, and organizational adoption of Cisco’s end-to-end AI evaluation platform. The platform includes offline benchmarking suites, automated LLM judges, and continuous production evaluation systems that help teams deploy AI agents and LLM-powered systems safely, reliably, and with verified accuracy at enterprise scale. The role translates quality and safety standards—including factual accuracy, hallucination mitigation, safety policies, and agentic tool-use fidelity—into repeatable test suites and human-in-the-loop review pipelines. It establishes pre-deployment quality bars, risk-based release criteria, and automated regression-detection loops, while connecting offline evaluations with live telemetry, product analytics, and real-time user feedback. The role partners with research scientists, engineering leaders, and product managers across business units to promote standardized evaluation frameworks and organization-wide platform adoption.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Principal