Conversational AI Specialist (On-Site)

Integra Beauty•Groveport, OH

1d•Onsite

About The Position

The Conversational AI Specialist owns the performance of Integra’s AI customer service agent, built on Siena AI. The central benchmark is resolution rate: the percentage of customer conversations the AI handles accurately and autonomously from start to finish without human intervention. The specialist audits live customer interactions, identifies failure patterns, and implements fixes by revising LLM prompts, clarifying internal business policies, or refining handoff boundaries. The role also maintains the knowledge content used by the AI, including help articles, FAQs, and policy documentation. It involves working with CX agents and leadership, escalating technical issues to the appropriate team, and exercising judgment about which customer concerns the AI may handle and which require human support. Particular care is required with product-safety complaints, money disputes, and promises the AI is not authorized to make.

Requirements

1–3+ years of experience in AI Prompt Engineering, Conversational Design, or Technical Writing within an e-commerce environment, and experience within corporate Customer Experience (CX).
Hands-on experience writing LLM prompts using conditional logic, system instructions, and negative or declarative constraints, with an understanding of LLM limitations and hallucination patterns.
Hands-on experience with enterprise CX and ticketing platforms such as Zendesk, Gorgias, Gladly, or similar.
Strong operational understanding of DTC e-commerce tools, including Shopify Plus, order processing, shipping and tracking APIs, returns and exchanges, subscriptions, and ERP order flows such as NetSuite.
Exceptional written communication skills and experience drafting FAQs, knowledge bases, customer-facing policies, or product documentation.
Ability to distinguish routine queries suitable for AI resolution from sensitive issues requiring human empathy, brand protection, or executive escalation.
Ability to work cross-functionally with frontline CX agents, fulfillment supervisors, and executive leadership.

Nice To Haves

Direct experience configuring, tuning, or administering Siena AI or similar e-commerce automated AI agents, such as Gorgias AI, Gladly AI, or Sierra.
Experience in DTC Beauty, Personal Care, Hair Care, or Consumer Goods (CPG).
Familiarity with fulfillment center operations, warehouse management systems (WMS), or physical order assembly workflows.

Responsibilities

Monitor AI conversation outcomes, identify failure patterns, and prioritize fixes by impact.
Review automated conversations and revise LLM prompts to address issues or guide future conversations.
Write prompts for new customer intents using declarative constraints and conditional logic.
Translate loosely documented business rules into consistent written policies the AI can follow, asking questions when rules are unclear.
Decide when the AI should hand off a conversation to a human, especially for product-safety complaints, money disputes, or unauthorized promises.
Maintain and update help articles, FAQs, and policy documentation used by the AI.
Receive issue reports from CX agents, keep CX leadership informed about performance and changes, and escalate technical issues to the appropriate team.