Lead Consultant- Machine Learning Platform
About The Position
Allstate’s Data & Analytics Technology organization is seeking a Machine Learning Platform Lead to architect, build, and scale core platforms that power enterprise-wide machine learning solutions. The role provides deep technical leadership across ML infrastructure, MLOps automation, model deployment systems, and cloud-native engineering. The successful candidate will influence platform strategy, guide architectural decisions, and collaborate with data science, engineering, security, and product teams to enable reliable, scalable, and responsible ML adoption across the enterprise. It is suited to a senior technologist who enjoys hands-on engineering, technical leadership, and building high-impact ML platform capabilities.
Requirements
- Extensive experience in ML engineering, platform engineering, or large-scale distributed systems.
- Deep hands-on expertise with MLOps tools, ML frameworks, model deployment techniques, and ML lifecycle automation.
- Strong proficiency in Python and backend development for machine learning systems.
- Experience with cloud platforms and ML services, including Azure ML Studio, AWS SageMaker, and/or Google Vertex AI.
- Exposure to cloud storage and data services such as Azure Fabric/OneLake, AWS S3, and Google Cloud Storage (GCS).
- Experience with cloud-native scanning and security tools such as Azure Defender, Microsoft Purview, AWS Security Hub, Amazon Inspector, GCP Security Command Center, or equivalent services.
- Strong understanding of Kubernetes, Docker, CI/CD, Terraform/infrastructure-as-code, or related technologies.
- Solid knowledge of system design, APIs, data pipelines, and scalable ML infrastructure patterns.
- Proven ability to lead technical initiatives and influence cross-team engineering decisions.
- 6+ years of progressive related experience.
Responsibilities
- Serve as the technical lead for ML platform architecture, guiding system design, scalability, performance, and reliability across platform components.
- Architect and build core ML platform services, including training and compute infrastructure, feature stores, model registries, inference runtimes, and data pipelines.
- Drive architectural decisions for distributed systems, cloud-native frameworks, and automated MLOps workflows that support enterprise-scale machine learning.
- Evaluate and integrate emerging ML platform technologies, tools, and best practices to strengthen platform capabilities.
- Design and implement MLOps pipelines for experiment tracking, data and model versioning, CI/CD for ML, automated retraining, and model governance.
- Develop automated workflows for reproducible model training, validation, deployment, and lifecycle management across multiple environments.
- Implement monitoring and observability systems for model performance, data quality, drift detection, and inference reliability.
- Build and optimize cloud-based ML infrastructure using Azure, AWS, or GCP, Kubernetes, containerization, and infrastructure-as-code.
- Develop scalable batch and streaming data pipelines using modern data engineering tools and frameworks.
- Embed security, compliance, responsible AI principles, and cost optimization best practices within ML platform architecture and operations.
- Collaborate with data scientists to translate modeling needs into scalable, reusable, self-service platform capabilities.
- Work with security, compliance, and governance teams to ensure safe and compliant AI/ML deployments.
- Partner with application engineering teams to accelerate adoption of ML services and enable consistent, high-quality production deployments.
- Provide technical mentorship, set engineering standards, and contribute to documentation, best practices, and ongoing platform improvements.
Benefits
- Employees eligible to work from home receive a monthly connectivity reimbursement to help offset internet costs.
- Comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
