Staff, AI Platform Engineer
About The Position
Vivint Smart Home, an NRG-owned company, develops intelligent products and services that combine hardware, real-time sensor data, and AI to create safer, smarter, and more sustainable homes. The Staff AI Platform Engineer will build a shared product-integrity layer for customer-facing AI systems, creating the evaluation, observability, safety, and launch-readiness infrastructure needed to deliver AI features with measurable quality, reliability, and customer impact. The role involves building shared evaluation infrastructure for models, prompts, agents, and multimodal AI systems; owning golden datasets, regression suites, offline and online evaluations, and LLM-as-judge governance; and developing observability for model quality, latency, cost, drift, safety, and customer impact. The engineer will create launch-readiness gates for AI features across camera, agentic, personalization, multimodal, and energy products; partner with Product, Analytics, Privacy, Security, and Engineering; and define reusable standards for AI quality, monitoring, safety, and operational readiness.
Requirements
- Bachelor's degree in Computer Science, Software Engineering, Data Science, or a related field.
- 8 or more years of software engineering, ML engineering, or AI platform experience.
- Experience evaluating, deploying, or monitoring production AI systems.
- Strong Python and data engineering skills.
- Experience with offline or online evaluation, data quality, model monitoring, or observability systems.
- Familiarity with LLM evaluation, prompt evaluation, model regression testing, or safety guardrails.
- Strong communication skills and ability to set standards across teams.
Nice To Haves
- Experience with LLM-as-judge, agent tracing, multimodal evaluations, golden datasets, or automated regression suites.
- Experience with GCP/AWS, Vertex AI, SageMaker, MLflow, Datadog, OpenTelemetry, Private Cloud, or similar tooling.
- Experience with privacy-aware AI systems, customer trust metrics, or launch-readiness processes.
- Experience supporting computer vision, GenAI, recommendation, or edge AI products.
- Experience building developer platforms or internal AI tooling.
Responsibilities
- Build shared evaluation infrastructure for models, prompts, agents, and multimodal AI systems.
- Own golden datasets, regression suites, offline and online evaluations, and LLM-as-judge governance.
- Develop observability for model quality, latency, cost, drift, safety, and customer impact.
- Create launch-readiness gates for AI features across camera, agentic, personalization, multimodal, and energy products.
- Partner with Product, Analytics, Privacy, Security, and Engineering on trustworthy AI productization.
- Define reusable standards for AI quality, monitoring, safety, and operational readiness.
Benefits
- Free daily lunch and drinks on site.
- Paid holidays and flexible paid time away.
- Employee, friends, and family discounts.
- Onsite health clinic, gym, and gaming tables.
- Medical, dental, vision, and life coverage, plus a 24/7 Medical Hotline.
- 401(k) with employer match.
- Employee Resource Groups.
- Quarterly Innovation Weeks.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
