Data Analyst (AI Track)

Medvidi•Atlanta, GA

8h•Remote

About The Position

At MEDvidi, we are transforming mental healthcare by making it more accessible and affordable across the United States. Our mission is to remove barriers to mental health support and ensure that everyone can access the care they need. As our AI initiatives scale, high-quality analytics becomes a critical bottleneck - and this role is designed to solve it. We are hiring a Data Analyst to play a key role within the AI product team, ensuring data-driven accuracy in decision-making while evaluating, improving, and scaling AI-powered solutions in production. This is a highly strategic, fast-paced role focused on measuring the real impact of AI agents and LLM-based systems, turning ambiguous problems and incomplete data into accurate decisions

Requirements

3+ years of hands-on experience as a Data Analyst working with product or platform data
Strong proficiency in Python for analytical work and ability to independently investigate data on the level of datapoints, build structural analyses, and present results
Confident SQL skills with experience working on complex queries
Experience building production-grade dashboards in BI tools, preferably in Tableau
Clear understanding of how LLM-based systems operate, including their limitations, failure modes, and trade-offs
Strong problem-solving and ownership mindset: you take responsibility for analytical outcomes, not just task execution
Ability to work in fast-changing, ambiguous environments and quickly learn new AI-related technologies
Proven experience linking product quality metrics to business impact and decision-making
Fluent Russian; English level B2 or higher
Ability to work CET-overlapping hours, with location outside Belarus and Russia

Nice To Haves

Experience evaluating or analyzing AI / ML / LLM products
Experience with dialog systems or conversational agents
Understanding of model quality metrics and evaluation approaches

Responsibilities

Analyze the performance and impact of AI initiatives already running in production
Develop and maintain dashboards that provide transparency into AI agent performance
Investigate issues, inconsistencies, and performance drops across automated user journeys
Design and implement evaluation approaches to measure system quality and user experience
Identify opportunities where automation improves outcomes, as well as areas where it introduces friction
Track adoption and effectiveness of automation across the product and support its further evolution
Partner closely with Product, Engineering, and QA teams to support data-informed decisions