Product Analyst III (AI Context Designer)

Pennymac • Carrollton, TX

3d • Onsite

About The Position

We are seeking a highly analytical and detail-oriented Product Analyst to act as a "Context Designer" for PennyMac's voice AI and prompt-driven initiatives. While this is a non-engineering role, it requires a strong technical bent. You will focus on driving use case context development by drafting natural language prompts, configuring conversational flows, and refining business requirements across CDL/Sales, Servicing, and Production/MFD.

Requirements

• 3–5 years of experience as a Product Analyst, Business Analyst, or similar role (targeting Analyst III level).
• A non-engineer with a strong "technical bent" and the ability to quickly grasp Generative AI concepts (e.g., RAG, LLM orchestration, prompt tuning).

Responsibilities

• Act as a "Context Designer" to write, refine, and configure natural language prompts and conversational flows based on defined business logic.
• Collaborate daily with sales, servicing, and fulfillment teams to capture, define, and negotiate business requirements for AI agent interactions.
• Review and curate operational PDFs and documentation to provide a verified "Source of Truth" for the RAG Vector Database.
• Execute A/B tests on various prompt configurations and analyze the resulting data to improve accuracy, tone, and resolution rates.
• Assist the Product Owner in defining and documenting the "Golden Dataset" of test scenarios to support automated AI evaluations.
• Work alongside platform engineers who manage the underlying technical architecture within the AWS tech stack to ensure successful API handshakes and platform functionality.

Benefits

• Comprehensive Medical, Dental, and Vision
• Paid Time Off Programs including vacation, holidays, illness, and parental leave
• Wellness Programs, Employee Recognition Programs, and onsite gyms and cafe style dining (select locations)
• Retirement benefits, life insurance, 401k match, and tuition reimbursement
• Philanthropy Programs including matching gifts, volunteer grants, charitable grants and corporate sponsorships
• bonus opportunities

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed