About The Position

The Copilot Marketing team is seeking a hands-on, technically minded Senior Technical Product Marketing Manager to use AI automation to improve how Microsoft Copilot is evaluated, validated, and improved. The role combines product development, technical problem-solving, and AI automation to turn fragmented, manual evaluation processes into rigorous, repeatable automated systems. The person will build agents, applications, scripts, and workflows; collaborate across teams; produce actionable product and competitive insights; and help equip sellers to demonstrate Copilot’s value to customers. This role calls for someone who understands products and platforms, can work deeply with technology, and can move from experimentation to implementation. The successful candidate will address ambiguous problems, monitor competitive offerings, and collaborate across a complex matrix of teams and tools. Microsoft describes its mission as empowering every person and organization to achieve more, and emphasizes a growth mindset, innovation, collaboration, respect, integrity, accountability, and an inclusive work environment.

Requirements

  • Master's degree in Marketing, Computer Science, Business, or a related field and 3+ years of experience in business; or bachelor's degree in one of these fields and 5+ years of experience in business; or equivalent experience.
  • Experience building AI agents, agentic workflows, or prototypes using code, APIs, structured data, JSON, and developer tools.
  • Strong understanding of generative AI, LLMs, agents, and AI product experiences.
  • Experience with AI evaluation, quality measurement, experimentation, or automated testing, including automated graders, human evaluation, judge models, benchmarks, and regression testing.
  • Strong analytical skills and ability to design systematic approaches to testing and validation.
  • Excellent written and verbal communication skills, including the ability to explain complex technical concepts to non-technical audiences.
  • Demonstrated ability to work across product, engineering, research, and marketing organizations.

Nice To Haves

  • Bachelor’s degree and 8+ years of experience, or master’s degree and 6+ years of experience.

Responsibilities

  • Build AI agents, applications, and automated workflows to accelerate product testing, competitive evaluation, validation, and readiness assessment.
  • Automate the end-to-end evaluation process, from test setup and execution through scoring, validation, analysis, and reporting.
  • Detect failures, regressions, inconsistencies, and anomalies at scale, with clear mechanisms for human review where judgment matters.
  • Prototype agentic evaluation approaches, including agents that test other agents, and move the strongest concepts into production workflows.
  • Turn evaluation signals into actionable product and competitive insights that shape prioritization, readiness, differentiation, and customer experience.
  • Scale AI automation across the organization through reusable tools, templates, documentation, responsible practices, and hands-on technical leadership.
  • Embody Microsoft’s Culture & Values.

Benefits

  • Certain roles may be eligible for benefits and other compensation; specific benefits are not listed.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service