Platform Engineering ll - Bala Cynwyd, PA

Tokio Marine Group of Companies•Lower Merion Township, PA

4d•$90,000 - $125,000

About The Position

The Platform Engineer II builds, extends, and maintains a shared data platform that enables engineering, analytics, and governance teams to deliver data products reliably and at scale. At the Group Company level, the role combines day-to-day platform operations with development of new capabilities on the Databricks Lakehouse platform. This includes managing Databricks Terraform configurations, deploying Unity Catalog structures through Infrastructure as Code, maintaining Azure DevOps pipelines, and supporting the full development-to-production data delivery lifecycle. The role applies software engineering practices—including version control, automated testing, CI/CD, and Infrastructure as Code—to the design and operation of a modern data platform. The engineer works closely with Data Engineers, Solution Architects, and Data Governance teams to support data delivery across each Group Company's environments.

Requirements

2–5 years of experience in platform engineering, DevOps, data mesh engineering, or data engineering.
Hands-on experience with the Databricks Terraform provider, including workspace provisioning, Unity Catalog configuration, and compute management.
Hands-on experience with Declarative Automation Bundles (DABs) for deployment and lifecycle management of Databricks assets.
Experience with Git version control, including branching strategies, pull requests, and code review.

Nice To Haves

Hands-on experience developing and maintaining Databricks Declarative Automation Bundles to package and standardize data pipelines, workflows, and associated configurations for infrastructure and production teams.
Familiarity with TMNAS engineering standards, CI/CD practices, security controls, and production deployment requirements.
Experience with Azure cloud services, including Entra ID, Key Vault, Storage Accounts, and Networking.
Experience with Azure DevOps CI/CD pipelines or equivalent tools such as GitHub Actions, Jenkins, or GitLab CI.
Experience with Bicep or ARM templates for Azure infrastructure provisioning.
Experience with Python and/or Bash for scripting and automation.
Exposure to data platform concepts such as Lakehouse architecture, Delta Lake, the medallion pattern, and data cataloging.
Familiarity with monitoring and observability tooling such as Azure Monitor, Grafana, Datadog, or platform-native dashboards.
Experience supporting multi-tenant or multi-environment platform configurations.
P&C Insurance industry experience.

Responsibilities

Build and configure Databricks workspaces, Unity Catalog structures, and compute resources across development, test, and production environments; maintain existing configurations.
Develop and maintain Databricks Terraform modules for repeatable, auditable provisioning, including catalog deployment, schema creation, and RBAC and permissions through Infrastructure as Code.
Manage and optimize job clusters, SQL warehouses, and serverless compute, balancing cost, performance, and isolation requirements.
Implement and maintain platform security controls, including identity integration, ABAC policies, network security, and secrets management.
Build and maintain Azure DevOps pipelines for automated deployment of Declarative Automation Bundles, notebooks, libraries, and platform configuration.
Design deployment patterns for development-to-test-to-production promotion, including gating, validation, and rollback capabilities.
Create and maintain shared pipeline templates and reusable deployment components for engineering teams.
Design and automate post-deployment tasks, including DDL execution, configuration seeding, and smoke testing.
Develop monitoring and alerting for platform health, including compute utilization, job SLAs, pipeline failures, storage growth, and cost trends.
Build platform dashboards that provide engineering and leadership visibility into operational metrics.
Investigate and resolve platform-level incidents, participate in root cause analysis, and implement preventive measures.
Monitor and optimize platform costs, identify underutilized resources, and recommend right-sizing.
Maintain platform documentation, onboarding guides, and runbooks.
Support engineering teams with workspace access, compute configuration, deployment troubleshooting, and Unity Catalog permissions.
Contribute to internal tooling and shared utilities that improve developer productivity.
Participate in platform design discussions and contribute to Architecture Decision Records.