Business Intelligence Analyst I – AI & Model Monitoring

Unum•Portland, ME

13d•$60,500 - $123,400•Hybrid

About The Position

We're looking for a Business Intelligence Analyst I – AI & Model Monitoring to help establish and scale a new model governance capability within our Finance Analytics organization. This is a unique opportunity to join at the ground level and play a critical role in designing how we monitor, measure, and communicate machine learning model performance across the business. In this role, you'll develop monitoring frameworks, performance KPIs, dashboards, and automated alerting solutions that ensure AI and predictive models remain accurate, reliable, and effective in production. You'll partner closely with Data Scientists, Data Engineers, BI Analysts, Business Analysts, and business stakeholders to transform complex data signals into actionable insights and governance processes. We're seeking a curious, analytical builder who enjoys solving complex problems and creating solutions from scratch. While prior governance experience is not required, success in this role requires strong critical thinking, ownership, learning agility, and communication skills. The ideal candidate is comfortable navigating ambiguity, collaborating across teams, and proactively driving work forward. Python is the primary coding language for this team, making strong Python proficiency essential. Experience with Databricks, SQL, cloud-based analytics environments, and data visualization tools is highly valued. If you're excited about AI, analytics, and building something new while working alongside a talented team of data professionals, we'd love to hear from you.

Requirements

Bachelor's degree preferred (Data Science, Statistics, Computer Science, Mathematics, or related field) and/or equivalent experience
2+ years of relevant analytics experience, with demonstrated ability to write and maintain Python code for data analysis and automation
Proficiency in Python (required) — including libraries such as pandas, numpy, scipy, and visualization libraries (matplotlib, plotly, or similar)
Proficiency in SQL for data extraction and validation
Familiarity with BI/visualization tools (Tableau, Power BI, or equivalent) for presenting monitoring outputs

Nice To Haves

Experience with or strong interest in Databricks (notebooks, jobs, Delta tables, Unity Catalog) — direct experience preferred but not required

Responsibilities

Develop and automate monitoring dashboards and reports that surface model health metrics (e.g., accuracy degradation, input/output drift, data quality anomalies) for review by leadership and model owners
Execute quantitative monitoring tests such as back-testing, benchmarking, sensitivity analysis, and statistical threshold checks on production model outputs as defined by the monitoring framework
Profile and analyze incoming data sources to evaluate data quality, completeness, and suitability for ongoing model inference and monitoring
Document monitoring methodologies, assumptions, and alert configurations to ensure reproducibility and auditability in alignment with enterprise model risk governance
Track and report on monitoring findings, including drift alerts, performance degradation events, and data quality issues, escalating to the director/manager when intervention or model recalibration is warranted
Work directly with model owners and internal customers to refine monitoring requirements, validate thresholds, and ensure outputs align with business expectations

Benefits

Award-winning culture
Inclusion and diversity as a priority
Performance Based Incentive Plans
Competitive benefits package that includes: Health, Vision, Dental, Short & Long-Term Disability
Generous PTO (including paid time to volunteer!)
Up to 9.5% 401(k) employer contribution
Mental health support
Career advancement opportunities
Student loan repayment options
Tuition reimbursement
Flexible work environments
healthcare benefits (health, vision, dental)
insurance benefits (short & long-term disability)
performance-based incentive plans
paid time off
a 401(k) retirement plan with an employer match up to 5% and an additional 4.5% contribution whether you contribute to the plan or not.