Senior AI Product Manager
About The Position
Robots & Pencils is seeking a Senior Product Manager, AI to lead end-to-end product delivery for complex generative AI and agentic AI engagements. The role combines deep AI fluency, hands-on prototyping, and product judgment to guide non-deterministic systems at enterprise scale. The product lead owns the engagement from problem framing through production rollout and builds trusted relationships with senior client stakeholders. As the primary product lead on a cross-functional AI delivery team, this person owns the roadmap, defines agent behavior, runs evaluations, and guides delivery from discovery through phased rollout. The role requires technical depth to engage with engineering on architecture decisions and communication skills to explain AI tradeoffs to executive audiences. Robots & Pencils describes its work as designing AI systems for real people and workflows, with production-ready AI targeted for delivery in 30 to 45 days.
Requirements
- At least 5 years of product management experience, including hands-on experience shipping AI features or products.
- Ability to read Python, JavaScript, or TypeScript code, evaluate architecture decisions, and make informed product tradeoffs based on technical constraints.
- Deep understanding of LLMs, RAG, fine-tuning, prompt and context engineering, agentic systems, planning, tool use, human-in-the-loop controls, guardrails, and evaluations.
- Proven ability to prototype AI and agentic solutions using modern AI tools to validate hypotheses and de-risk product decisions.
- Experience running evaluations for AI systems and iterating based on results.
- Experience defining agent behavior, including system prompts, tool schemas, and human-in-the-loop boundaries.
- Strong experience with AWS AI services in a product context, such as Bedrock, Lambda, SageMaker, or Kendra.
- Strong client communication skills and ability to explain AI capabilities and limitations to non-technical executive audiences.
- Comfort operating in ambiguous, fast-moving environments where the AI landscape evolves rapidly.
Nice To Haves
- Experience in a consulting or agency environment.
- Familiarity with agent orchestration frameworks such as LangChain, LangGraph, or AWS Strands.
- Software engineering background in Python, JavaScript, or TypeScript.
Responsibilities
- Own end-to-end product delivery for complex AI and agentic AI engagements, from discovery and hypothesis framing through phased rollout and production readiness.
- Define and maintain AI product roadmaps that connect agent capabilities to measurable enterprise business outcomes.
- Lead user research, stakeholder interviews, and assumption testing, prioritizing and de-risking the riskiest hypotheses before committing to build.
- Design and run experiments, including proofs of concept, pilot deployments, and scenario-based testing of multi-step agentic workflows, edge cases, and failure recovery.
- Define agent behavior, including system prompts, tool schemas, context management, summarization, and working-memory patterns across multi-step tasks.
- Own and run evaluation frameworks for task completion, reasoning quality, tool selection, failure recovery, and safety, iterating based on evidence.
- Define agent-level success metrics, including task completion rate, cost per task, escalation rate, and time to resolution, alongside business KPIs.
- Establish human-in-the-loop boundaries and guardrails for autonomous action, escalation, and handling non-deterministic output.
- Use AI tools such as Claude, Claude Code, Cursor, and GitHub Copilot, as well as relevant agentic frameworks, to accelerate product work.
- Lead stakeholder working sessions, prioritization discussions, and risk conversations with senior client stakeholders.
- Communicate AI tradeoffs, agent behavior, and product decisions clearly to technical and non-technical executive audiences.
- Build trusted client relationships and serve as a consultative partner throughout engagements.
- Lead prioritization by balancing business value, technical feasibility, cost, latency, and delivery timelines.
- Frame requests around user and business outcomes, challenge feature-level thinking, and set realistic expectations about AI capabilities.
- Begin mentoring junior AI product managers on evaluations, agent design, and AI product delivery practices.
Benefits
- Paid time off.
- Medical insurance.
- Dental insurance.
- Vision insurance.
- 401(k) to eligible employees.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
