AI Operations Associate

Accordion•Boston, MA

22h•Hybrid

About The Position

The AI Operations Associate monitors AI-driven workflows in production, reviews output-quality incidents, supports fallback and human-review decisions, and partners on trust-sensitive escalations. This role helps ensure AI-enabled workflows remain reliable, supportable, and safe in live finance-oriented environments. This position will ideally be based in one of our US offices and is a hybrid role with the flexibility to work remotely 2 days per week (also eligible for remote candidates). This position is not eligible for immigration sponsorship.

Requirements

4+ years of experience in production support, AI operations, business process operations, analytics, QA, or a similar role
Strong analytical skills and comfort evaluating nuanced workflow or output issues, with a focus on safe operations and clear escalation
High attention to detail with proven experience spotting subtle trust or quality issues others may miss
Ability to work across engineering and business teams in ambiguous situations
Comfortability balancing evidence, judgment, and business impact, all while remaining thoughtful, precise, and calm under pressure
Experience with AI-enabled workflows, operational analytics, business process validation, or support for workflow-heavy systems
Strong written communication and documentation discipline
Bachelor's degree preferred

Nice To Haves

Excited to be part of a growing team, with a focus on driving future growth
Passionate about delivering exceptional client service
Knowledgeable about the relationship between Private Equity sponsors and their portfolio companies, particularly within the office of the CFO
Willing to get your hands dirty in the details of a project while simultaneously seeing the whole picture
Comfortable managing projects with multiple complex workstreams while also focused on your single workstream (you are managing and doing)
A self-starter with a strong work ethic
Full of entrepreneurial spirit and comfortable in a fluid, flat organization
Able to effectively communicate complex issues and solutions, and raise issues to senior team members when necessary
A team player, able to work with team members across all levels
Someone who enjoys mentoring others and doing meaningful work
A leader of others; you lead by example

Responsibilities

Monitor AI-driven workflows in production for abnormal behavior, trust issues, degraded outputs, and recurring exception patterns
Review signals related to output quality, fallback use, low-confidence patterns, and workflow anomalies
Escalate issues that could affect live user trust, business quality, or finance-sensitive outcomes
Support investigation of output-quality incidents, orchestration failures, prompt or workflow regressions, and tool-call problems in production
Help distinguish true software defects from model behavior issues, data-quality problems, or process misunderstandings
Partner closely with Engineering, QA, and business stakeholders on judgment-heavy incidents
Support human-review patterns, fallback routes, and safe-operating responses for AI-enabled features
Help define and apply production review practices for higher-risk workflows
Document evidence and issue patterns in ways that support repeatability and better release decisions
Identify recurring AI operations issues and recommend improvements to supportability, monitoring, and quality feedback loops
Feed production learnings back into QA, Product, and Engineering
Help improve operational trust in AI-enabled solutions over time