Prompt Quality Specialist

Apricot Health • Oklahoma City, OK

14h • Hybrid

About The Position

Apricot is seeking an AI Prompt Quality Specialist to enhance their prompt portfolio. This semi-technical role involves working closely with data and systems, requiring strong writing, analytical thinking, and compliance adherence. The specialist will be part of a team focused on refining prompt quality through usage analysis, testing improvements, and collaborating with various teams to ensure prompts are accurate, compliant, and consistently improving. The role is ideal for someone energized by problem-solving, performance analysis, and language refinement for real-world application.

Requirements

• Genuine curiosity about AI, routine experimentation with AI workflows and tools, and excitement about exploring their potential.
• Excellent writing, editing, and critical reading skills, with a keen eye for detail and clarity.
• Ability to analyze data, spot patterns, and build evidence-based insights and hypotheses.
• Enjoyment in diagnosing issues and iterating towards thoughtful, effective solutions.
• Understanding of compliance guardrails while seeking creative ways to advance work.
• Thrive working cross-functionally with product, clinical, design, and engineering teams.
• Ability to dive into new domains quickly, staying flexible and open as things evolve.

Nice To Haves

• Experience in a regulated or compliance-heavy field (healthcare, legal, finance, education).
• Background in technical writing, medical writing, product operations, QA, or content strategy.
• Knowledge of healthcare workflows or clinical documentation.

Responsibilities

• Write and edit prompts with precision, balancing compliance requirements with usability and innovation.
• Monitor dashboards and metrics to track prompt performance and identify areas for improvement.
• Prioritize work based on quantitative data, customer feedback, and clinical team insights.
• Backtest and diagnose underperforming prompts, then refine and re-measure.
• Collaborate with clinical specialists to build domain expertise and with product/design to shape prompt workflows.
• Consume data from analyst partners to guide decisions—no coding required.
• Stay current with best practices in prompt design and LLM research, bringing fresh methods to the team.

Benefits

• Opportunity to have a direct impact on the quality and effectiveness of Apricot’s product.
• Work in a team that values curiosity, candor, and momentum.
• See your work directly translate into improvements for clinicians and patients.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed