Principal Data Platform Engineer

MetLife-posted 2 months ago
$130,000 - $185,000/Yr
Full-time • Senior
Hybrid • Cary, NC
5,001-10,000 employees
Insurance Carriers and Related Activities
Resume
Match Score
Upload and Match ResumeTrack Jobs with Teal

We are seeking a skilled Principal Data Platform Engineer with 5+ years of experience in designing, building, implementing, and managing data, analytics, and MLOps platform on Azure Cloud. Will be responsible for automating infrastructure, ensuring platform reliability, optimizing costs, and supporting data engineering, analytics, and machine learning workloads.

  • Design and architect scalable, secure, and cost-effective data, analytics, and MLOps platforms on Azure
  • Define cloud architecture patterns and best practices for data workloads
  • Create technical specifications and solution designs for complex cloud infrastructure
  • Evaluate and recommend new technologies and tools to enhance platform capabilities
  • Implement Infrastructure as Code (IaC) using Azure Resource Manager (ARM), Bicep, or Terraform
  • Develop and maintain CI/CD pipelines for infrastructure deployment and application delivery
  • Automate provisioning and configuration management using tools like Azure DevOps, GitHub Actions, or Jenkins
  • Design and implement automated backup, disaster recovery, and high availability solutions
  • Deploy and manage Azure data services including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure Data Lake
  • Implement data governance, security, and compliance frameworks
  • Monitor and optimize data pipeline performance and resource utilization
  • Ensure data quality, lineage, and metadata management across the platform
  • Build and maintain MLOps infrastructure using Azure Machine Learning, MLflow, or similar platforms
  • Implement model deployment, versioning, and monitoring solutions
  • Develop automated ML pipeline orchestration and model lifecycle management
  • Ensure reproducibility and scalability of machine learning workloads
  • Implement security best practices including identity and access management (IAM)
  • Configure network security, encryption, and data protection measures
  • Ensure compliance with regulatory requirements (GDPR, HIPAA, SOX, etc.)
  • Conduct security assessments and vulnerability management
  • Monitor and optimize cloud resource costs through rightsizing and automation
  • Implement cost allocation and chargeback mechanisms
  • Performance tuning of data processing and analytics workloads
  • Capacity planning and resource forecasting
  • Work closely with data engineers, data scientists, and analytics teams
  • Provide technical guidance and mentoring to junior team members
  • Participate in on-call rotation for platform support and incident response
  • Document processes, procedures, and system architecture
  • Bachelor's degree in Computer Science, Engineering, or related technical field, or 7+ equivalent professional experience will be considered
  • 5+ years of experience with Microsoft Azure, including deep knowledge of Azure services (Azure SQL, Cosmos DB, Azure Data Factory, Synapse, Databricks, Data Lake, Machine Learning, etc.)
  • Proficiency in ARM templates, Bicep, Terraform, or similar tools
  • Experience with Docker, Azure Container Instances, and Azure Kubernetes Service (AKS)
  • Strong experience with Azure DevOps, GitHub Actions, Jenkins, or similar platforms
  • Proficiency in Python, PowerShell, Bash, and/or other scripting languages
  • Experience with Azure Monitor, Log Analytics, Application Insights, or similar tools
  • Knowledge of data pipeline orchestration tools (Databricks, Azure Data Factory)
  • Excellent problem-solving and analytical skills
  • Strong communication and collaboration abilities
  • Ability to work in fast-paced, agile environments
  • Leadership and mentoring capabilities
  • Customer Service Orientation
  • Microsoft Azure Solutions Architect Expert (AZ-305)
  • Microsoft Azure DevOps Engineer Expert (AZ-400)
  • Terraform Associate or Professional certification
  • Experience with multi-cloud environments (AWS, GCP)
  • Experience with MLOps frameworks and tools (MLflow, Azure ML, Kubeflow)
  • Understanding of machine learning lifecycle and model deployment strategies
  • GenAI experience is preferred
  • Knowledge of data mesh and modern data architecture patterns
  • Experience with SQL, NoSQL databases, data warehousing, and big data technologies
  • Strong understanding of cloud security principles and best practices
  • Experience with Azure Active Directory, RBAC, and identity management
  • Knowledge of data privacy regulations and compliance requirements
  • Experience with security scanning and vulnerability assessment tools
  • Experience with streaming data technologies (Apache Kafka, Azure Event Hubs)
  • Background in financial services, healthcare, or other regulated industries
  • Experience with agile/scrum methodologies
  • Comprehensive health plan that includes medical/prescription drug and vision, dental insurance
  • No-cost short- and long-term disability
  • Company-paid life insurance and legal services
  • Retirement pension funded entirely by MetLife and 401(k) with employer matching
  • Group discounts on voluntary insurance products including auto and home, pet, critical illness, hospital indemnity, and accident insurance
  • Employee Assistance Program (EAP) and digital mental health programs
  • Parental leave
  • Volunteer time off
  • Tuition assistance
Track Jobs with Teal

Job Search Resources

•
AI Resume Builder
•
Platform Engineer Resume Examples
•
Cover Letter Examples

Tools

Career Hubs

Guides

Company

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service