Senior Product Development Specialist

Marsh McLennan • Austin, TX

3d • Hybrid

About The Position

Marsh is seeking an Applied AI Product Manager to help translate advances in AI into useful, reliable, production-ready products. This role sits at the intersection of customer discovery, product strategy, technical execution, and responsible deployment. You will partner across engineering, design, data, research, go-to-market, legal, and customer-facing teams to identify high-value workflows, prototype AI-powered experiences, define quality standards, and deliver measurable business and user impact.

Requirements

• 2+ years of experience building, shipping, implementing, analyzing, or operating software, data, AI, automation, or technical products.
• Strong product judgment and the ability to turn fuzzy problems into sharp product bets.
• Demonstrated ability to build, ship, prototype, or meaningfully contribute to technical products.
• Familiarity with modern AI tools and workflows, including hands-on use of AI assistants, coding agents, or product/research harnesses.
• Working knowledge of LLM product patterns: prompt design, context engineering, tool/function calling, agents, evaluation, failure modes, and when retrieval or external knowledge sources are useful.
• A strong evaluation mindset: you can define what “good” means, measure quality, find regressions, and connect AI performance to user and business outcomes.
• Technical fluency with APIs, data, product analytics, and system tradeoffs (SQL, Python, or lightweight scripting is helpful but not required).
• Ability to distinguish between a model problem, data problem, UX problem, workflow problem, and expectation-setting problem.
• Clear communication with both technical and non-technical audiences.
• High ownership and comfort working in ambiguity.

Nice To Haves

• Experience shipping AI, ML, automation, data, developer, or workflow products.
• Experience creating and running evaluations for AI systems (test sets, grading rubrics, failure analysis, regression tracking, human review workflows).
• Experience with observability, quality dashboards, annotation workflows, or human-in-the-loop systems.
• Experience with enterprise AI, regulated industries, privacy-sensitive products, or compliance-heavy environments.
• Familiarity with retrieval systems, search, knowledge management, or other ways of giving AI systems useful context.
• Background in engineering, data science, research, technical consulting, design, or founder-like product work.

Responsibilities

• Own product strategy, roadmap, and execution for applied AI capabilities across one or more product areas.
• Identify workflows where AI can materially improve speed, quality, decision-making, automation, or user experience.
• Translate ambiguous customer problems into clear product requirements, success metrics, prototypes, and release plans.
• Partner with engineering and AI teams on LLM-powered systems, including prompts, context design, retrieval, tool use, agents, model selection, and product architecture tradeoffs.
• Define and run practical evaluation processes for AI features, including quality rubrics, offline evaluations, regression tests, online metrics, user feedback loops, and human review.
• Make product decisions across accuracy, latency, cost, reliability, safety, privacy, and user trust.
• Use modern AI tools and coding/productivity harnesses to accelerate research, prototyping, analysis, QA, and product thinking.
• Monitor shipped AI experiences for quality, failure modes, adoption, business impact, and operational risk.
• Collaborate with design to create intuitive AI UX, including graceful failure states, user control, transparency, and feedback mechanisms.
• Work with legal, security, compliance, and policy partners to support responsible deployment.
• Enable sales, support, customer success, and marketing with clear positioning, demos, launch materials, and customer narratives.

Benefits

• Marsh is committed to embracing a diverse, inclusive and flexible work environment.
• We aim to attract and retain the best people and embrace diversity of age background, disability, ethnic origin, family duties, gender orientation or expression, marital status, nationality, parental status, personal or social status, political affiliation, race, religion and beliefs, sex/gender, sexual orientation or expression, skin color, veteran status (including protected veterans), or any other characteristic protected by applicable law.
• If you have a need that requires accommodation, please let us know by contacting [email protected].
• Marsh is committed to hybrid work, which includes the flexibility of working remotely and the collaboration, connections and professional development benefits of working together in the office.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed