AI Quality & Performance Analyst

Mark-Taylor Residential•Scottsdale, AZ
•Onsite

About The Position

Mark-Taylor is hiring an AI Quality & Performance Analyst for its corporate office in Scottsdale, Arizona. The role evaluates AI-generated conversations, content, recommendations, and system activity to ensure accuracy, completeness, clarity, relevance, professionalism, and effective resolution of user needs. The analyst verifies that AI-driven actions—such as scheduling appointments, recording requests, updating information, and routing work—are completed correctly. The analyst reviews voice and messaging experiences, maintains quality standards and test materials, investigates root causes, and coordinates fixes with responsible teams and platform partners. The position also evaluates AI against company-approved fair housing, privacy, sensitive-information, emergency-routing, and brand standards; escalates critical failures and reports quality trends and verified results. The role measures the impact of AI performance on leasing, resident service, employee productivity, operational efficiency, and team capacity.

Requirements

  • Three or more years of relevant experience in quality assurance, customer experience, software testing, operational analytics, process improvement, or a related discipline.
  • Strong judgment and the ability to evaluate ambiguous AI outputs against documented standards.
  • Excellent analytical, written communication, and problem-solving skills.
  • Experience creating scorecards, analyzing trends, documenting defects, and coordinating improvements across teams.
  • Working knowledge of generative AI, including inaccurate responses, inconsistent behavior, and limitations of automated evaluation.
  • Ability to work with recordings, transcripts, generated content, CRM records, dashboards, and workflow histories.

Nice To Haves

  • Multifamily leasing, resident services, or centralized operations experience.
  • Experience with AI evaluation tools, conversation analytics, SQL, or workflow automation.

Responsibilities

  • Review AI-generated conversations, content, recommendations, and related system activity for accuracy, completeness, clarity, relevance, professionalism, and resolution of user needs.
  • Verify that AI completes requested or promised actions correctly, including scheduling appointments, recording requests, updating information, and routing work.
  • Assess voice and messaging experiences for delays, interruptions, speech recognition and pronunciation issues, repeated questions, conflicting answers, lost context, duplicate outreach, and incomplete handoffs.
  • Maintain quality scorecards, examples of acceptable and unacceptable behavior, issue severity definitions, and escalation procedures; establish quality baselines and recommend performance targets.
  • Combine random sampling with targeted reviews of higher-risk interactions, and validate automated evaluations against human review and verified system outcomes.
  • Investigate and document root causes involving source information, AI instructions, workflow configuration, integrations, speech recognition, or model behavior.
  • Maintain a prioritized issue backlog, coordinate fixes with responsible teams and platform partners, and verify that fixes address underlying problems and remain effective over time.
  • Maintain a reusable test library, test new capabilities and changes before release, and confirm existing functionality continues to work.
  • Evaluate AI against company-approved fair housing, privacy, sensitive-information, emergency-routing, and brand standards; escalate exceptions to designated owners and track critical policy exceptions separately.
  • Escalate critical failures immediately and recommend holding a release or restricting an affected capability when warranted.
  • Report quality trends, recurring failures, improvement priorities, and verified results.
  • Measure the impact of AI performance on leasing, resident service, employee productivity, operational efficiency, and team capacity.

Benefits

  • Employee rent discounts, subject to availability at each community.
  • Access to Mark-Taylor amenities.
  • Employee appreciation events.
  • Opportunities for career growth.
  • 401(k) with robust company match.
  • Paid time off, sick time, holidays, and volunteer time.
  • Comprehensive medical, dental, and vision benefits.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service