AI Operations Analyst

Shyft6•New York, NY

2d•Remote

About The Position

We are seeking an AI Operations Analyst to support the day-to-day operations, monitoring, and performance of AI-driven applications and data platforms. This role focuses on ensuring the accuracy, reliability, and ongoing optimization of AI solutions deployed across AWS, Azure, Tableau, Power BI, and DealCloud CRM integrations. This position sits at the intersection of production support, data analysis, and AI performance monitoring, making it ideal for someone with a blend of technical troubleshooting and analytical skills.

Requirements

2–5 years of experience in Production Support, Data Analysis, QA, or IT Operations
Strong analytical skills with experience in data validation and troubleshooting
Proficiency in SQL for querying and analyzing data
Familiarity with cloud environments (AWS and/or Azure)
Experience working with or supporting data pipelines and ETL/ELT processes
Experience with monitoring tools or dashboards
Strong problem-solving skills and attention to detail

Responsibilities

Monitor and support AI/ML-driven applications in production environments
Track and analyze AI model performance, identifying issues such as data drift, anomalies, or degradation
Validate data inputs and outputs across data pipelines and reporting tools (Tableau, Power BI)
Investigate and resolve production issues, alerts, and inconsistencies related to AI and data systems
Support data pipelines (ETL/ELT) and ensure data quality across integrated systems
Assist with incident management, root cause analysis, and resolution tracking
Validate integrations across systems including CRM platforms (DealCloud)
Collaborate with data engineers, QA, and AI teams to ensure ongoing model accuracy and system performance
Maintain documentation, runbooks, and operational procedures
Identify opportunities for automation and optimization of AI operations workflows