Senior Product Manager — AI Foundry Team

Prophet•New York, NY

5d•$165,000 - $220,000•Hybrid

About The Position

The Senior Product Manager for the AI Foundry team will own the execution, delivery, and continuous improvement of MAIA — Prophet’s internal multi-agent AI platform. Working from the strategic direction set by the AI Center of Excellence, you will translate high-level ambition into shipped product capabilities, measurable adoption, and trusted AI experiences. This role requires product judgment, technical fluency, delivery discipline, and AI systems thinking. You will partner closely with engineering to evaluate feasibility, shape architecture tradeoffs, define acceptance criteria, and ensure MAIA is reliable enough for real consulting work. You will help determine what should be built, how it should work, and whether it is good enough to ship.

Requirements

7+ years in product management, with at least 2 years in a technical product environment (AI/ML, platform products, developer tools, enterprise software, or data products).
Demonstrated technical ability — can read and write code (Python preferred), navigate APIs, data schemas, and developer environments, and hold your own in engineering discussions.
Hands-on experience with LLM-based products, agents, or AI workflow tools — including prompt engineering, model evaluation, RAG systems, tool calling, or structured outputs.
Strong understanding of AI product evaluation — can define quality for probabilistic systems, create test cases, identify hallucination or reasoning failures, and set release criteria.
Experience with enterprise data and integration patterns — APIs, databases, permissions, authentication, and workflow integrations.
Operational product discipline — production monitoring, incident triage, QA, release management, and continuous improvement from telemetry and user feedback.
Proven ability to lead cross-functional teams through ambiguity, remove roadblocks, and hold people accountable without micromanaging.
Excellent communication — clear specifications, confident presentations to technical and business audiences, message calibrated to the room.

Nice To Haves

Consulting or consulting-adjacent experience is a strong plus.
Experience building or managing internal AI tools, productivity platforms, or workflow automation products.
Experience with RAG, vector databases, embeddings, knowledge graphs, agent orchestration, or LLM observability tools.
Experience with secure enterprise environments — SSO, RBAC, audit logs, data privacy, or vendor review.
Experience in consulting, professional services, or financial services.
Track record turning prototypes into production products with clear success metrics and adoption plans.
Familiarity with Python, TypeScript, React, FastAPI, LangChain, LangGraph, LlamaIndex, OpenAI/Anthropic APIs, vector databases, Jira, GitHub, Vercel, Supabase, or similar stacks.

Responsibilities

Own the product backlog and release cadence from planning through launch.
Assess technical feasibility and architecture tradeoffs so leadership can make informed prioritization decisions.
Define acceptance criteria grounded in user value, system constraints, and release quality.
Lead day-to-day execution of the Foundry product team — unblocking work, setting priorities, and driving momentum through ambiguity.
Maintain hands-on technical involvement — building prototypes, reviewing code, and running experiments.
Partner with engineering on specifications, sprint execution, QA, release sign-off, and architecture decisions.
Define how MAIA capabilities are evaluated before and after launch.
Create testing protocols for agent accuracy, hallucination risk, tool use, latency, and reliability.
Build benchmark sets, red-team scenarios, regression tests, and release gates.
Monitor production performance — failure rates, cost, user drop-off — and translate telemetry and incident data into product fixes and roadmap priorities.
Design and run experiments to test new agent capabilities, benchmark model performance, and translate results into go/no-go recommendations.
Evaluate approaches such as RAG, knowledge graphs, agent orchestration, API integration, and model selection against complexity, cost, latency, accuracy, and maintainability.
Present clear recommendations with explicit tradeoffs and a bias toward shippable solutions.
Gather high-value use cases from consulting teams and translate them into agent specifications, workflow diagrams, tool requirements, and acceptance tests.
Manage the agent lifecycle from prototype through production, including prompt design, testing, monitoring, and deprecation.
Support client-facing applications by coordinating feature requirements and contributing to implementation.
Work with IT, security, legal, and business stakeholders to ensure MAIA handles enterprise data responsibly.
Define requirements for permissions, access control, auditability, and user-facing guardrails.
Ensure new capabilities are designed with trust and governance in mind from the start.
Drive adoption across consulting teams by understanding real workflows, shaping onboarding, and creating feedback loops.
Define and report metrics for adoption, task completion, time saved, output quality, cost-to-serve, and business impact.
Use these insights to prioritize improvements and communicate progress to CoE leadership.
Tailor communication to the audience.
Prepare technical demos, architecture documentation, release notes, and status updates.
Interface with stakeholders across design, engineering, consulting, marketing, IT/security, and external partners.
Champion the end-user experience.
Hold a high bar for UI/UX quality and articulate specifically what’s working, what isn’t, and what you’d change.