Tech Product Manager, AI Agents & Platform - Winston Match - NAMER [KK] (TEST JOB - DO-NOT-APPLY)

LinkedIn QA • Sunnyvale, CA

6d

About The Position

We are seeking a Technical Product Manager to lead the development of our AI Agents and underlying platform capabilities. This role sits at the intersection of product, engineering, and applied AI, and focuses on building scalable systems that enable intelligent, autonomous, and semi-autonomous agent workflows. You will define product strategy, drive execution, and collaborate closely with engineering, research, and design teams to deliver agent-based solutions that solve real customer problems. The ideal candidate is comfortable working with ambiguity, understands modern AI/LLM systems, and can translate complex technical concepts into clear product direction.

Requirements

• 3–5+ years of product management experience in a technical domain
• Experience working closely with engineering teams on complex systems or platforms
• Demonstrated ability to ship products from concept to launch
• Strong analytical and problem-solving skills
• Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience)
• Experience working in agile or iterative development environments
• Strong understanding of AI/ML concepts, especially LLMs, prompt engineering, and agent frameworks
• Experience with APIs, distributed systems, and platform products
• Ability to work with engineers on system design and technical tradeoffs
• Familiarity with tools like Python, SQL, or basic scripting for analysis
• Experience with experimentation, A/B testing, and data-driven decision making
• Knowledge of model evaluation, hallucination mitigation, and AI safety considerations
• Strong product sense with a focus on user outcomes and usability
• Excellent communication and stakeholder management skills

Nice To Haves

• Experience building or managing AI/ML-powered products, especially LLM-based systems
• Familiarity with AI agent frameworks, orchestration tools, or multi-step workflows
• Hands-on experience with APIs from major AI providers (e.g., OpenAI, Anthropic, etc.)
• Background in developer platforms, infrastructure, or internal tooling
• Experience with retrieval-augmented generation (RAG), embeddings, or vector databases
• Understanding of evaluation techniques for AI systems (offline evals, human-in-the-loop, etc.)
• Prior experience in a startup or fast-paced environment
• Advanced degree in a technical field (CS, AI, ML, etc.)

Responsibilities

• Define and own the roadmap for AI agents and platform infrastructure
• Partner with engineering to design scalable, reliable agent architectures
• Translate business and user needs into detailed product requirements
• Work closely with AI/ML teams to integrate LLMs, retrieval systems, and tool use into products
• Drive experimentation, evaluation, and iteration of agent behaviors and performance
• Establish metrics and frameworks to measure agent effectiveness, safety, and quality
• Collaborate cross-functionally with design, data, and go-to-market teams
• Communicate product vision, progress, and tradeoffs to stakeholders

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level