Principal Product Manager, SeekrFlow Evaluations

Seekr • Austin, TX

9d • Hybrid

About The Position

SeekrFlow is an end-to-end AI development platform used to build, fine-tune, evaluate, and deploy AI systems in production environments. As AI adoption accelerates across enterprises and government agencies, the ability to rigorously evaluate AI models and applications, and to trust those evaluations, has become a critical capability. We’re hiring a Principal Product Manager to own SeekrFlow’s evaluations product area end to end. This is a senior individual contributor role with broad scope. You will define strategy and drive execution across all evaluation surfaces inside SeekrFlow: base models, fine-tuned models, agents, distilled applications, and beyond. You’ll work in close partnership with other product leaders, ensuring that evaluation capabilities inside SeekrFlow connect seamlessly with scoring, certification, and governance workflows across all Seekr products. You’ll operate with a high degree of autonomy, partnering directly with Engineering, Research, Design, and GTM to make AI evaluation rigorous, scalable, and customer ready.

Requirements

• 8–12+ years of product management experience, with demonstrated ownership of complex, technically deep platform or infrastructure products
• Strong understanding of AI/ML model evaluation concepts, including benchmarking, bias and reliability testing, task-specific evaluation frameworks, and application types (base models, fine-tuned models, agents)
• Experience productizing research-driven or experimental technology areas where requirements evolved through iteration and technical discovery
• Proven ability to operate autonomously as a senior IC: setting direction, writing specifications, and driving cross-functional execution
• Comfortable engaging deeply with engineers, designers, and researchers on technical tradeoffs, system design decisions, and emerging research
• Experience building for enterprise or government customers in B2B software environments, including multi-stakeholder requirements and compliance-sensitive contexts
• Strong product writing skills: able to produce structured, precise specifications that enable high-quality engineering execution
• Clear communicator capable of making complex evaluation concepts legible to both technical teams and executive or customer audiences
• Reside in or willing to relocate to Austin, TX; able to work in office on a hybrid schedule
• Deep familiarity with AI/ML evaluation and benchmarking approaches across model types and use cases
• Working knowledge of LLMs, RAG, agents, fine-tuning, and distillation, deep enough to evaluate technical tradeoffs and shape product direction
• Understanding of how evaluation integrates with broader AI lifecycle workflows: data preparation, training, deployment, and monitoring
• Ability to define API, SDK, and UI surfaces for evaluation workflows and specify behavior across SaaS and self-hosted environments
• Comfortable reviewing and engaging with research papers, experimental results, and benchmark methodologies

Nice To Haves

• Experience with AI governance, model risk management, trust and safety tooling, or audit-ready AI systems
• Experience designing platform surfaces such as dashboards, scoring systems, certification workflows, or real-time monitoring interfaces
• Background in high-growth startups or early-stage platform products where you helped define product practice and AI evaluations
• Ability to use AI-assisted tools to prototype workflows, validate concepts, or accelerate discovery
• Experience with or exposure to U.S. federal government, defense, or intelligence community AI programs

Responsibilities

• Define and own the multi-year strategy and roadmap for SeekrFlow’s evaluation capabilities, covering the full spectrum of model types (base models, fine-tuned models, agents, and distilled applications) and ensuring alignment with platform and business priorities.
• Drive evaluation features from discovery and specification through delivery, launch, and iteration, working in close partnership with Engineering and Design. Own prioritization decisions and hold the line on quality and scope.
• Develop deep expertise in the unique evaluation requirements for each model type and application surface, translating those requirements into coherent product direction across SeekrFlow.
• Partner closely with other leaders in the technology organization to ensure SeekrFlow evaluation outputs connect directly to SeekrGuard’s risk scoring and evaluation workflows, creating a seamless end-to-end trust pipeline.
• Engage with Research and Engineering teams to identify emerging evaluation techniques and benchmarks, and determine how to turn experimental work into scalable, customer-facing product capabilities.
• Work directly with enterprise and government customers to understand evaluation requirements, workflow gaps, and trust needs. Use those insights to validate direction and sharpen the roadmap.
• Write clear, detailed product specifications that define evaluation workflows, metrics, API/SDK surfaces, UI behavior, and expected system behavior across SaaS and self-hosted deployments.
• Define success metrics for evaluation capabilities and track adoption, performance, and customer outcomes to drive continuous improvement.

Benefits

• Meaningful Mission & Impact - Work with a deeply talented, collaborative team solving some of the toughest AI challenges that matter.
• Equity Ownership – RSUs that let you share directly in Seekr’s long‑term success and growth.
• Time Off That Respects Real Life – Unlimited PTO plus 14 paid company holidays to truly recharge.
• Work Your Way – A flexible hybrid work environment with offices in Reston, VA and Austin, TX.
• Competitive Total Rewards – A role‑appropriate compensation structure that supports long‑term growth, including base salary, bonuses, or commission plans depending on role.
• 401(k) with Company Match – Build your future with a retirement plan that includes employer matching.
• Comprehensive Health & Wellness – Medical, dental, vision, and life insurance coverage starting day one—for you and your family.
• Parental Leave – Paid parental leave to support employees as they welcome a new child through birth, adoption, or foster placement.

What This Job Offers

• Job Type: Full-time
• Career Level: Principal
• Education Level: No Education Listed