Platform Engineering ll - Bala Cynwyd, PA

TMNA Services•Bala Cynwyd, PA

3d•$90,000 - $125,000

About The Position

The Platform Engineer II builds, extends, and maintains the shared Databricks Lakehouse data platform used by engineering, analytics, and governance teams. At the Group Company level, the role handles day-to-day platform operations and develops new capabilities, including Databricks Terraform configurations, Unity Catalog structures, Azure DevOps pipelines, and support for the full development-to-production data delivery lifecycle. The position applies software engineering practices—including version control, automated testing, CI/CD, and Infrastructure as Code—to the design and operation of a modern data platform. The Platform Engineer works with Data Engineers, Solution Architects, and Data Governance teams to support data delivery across each Group Company’s environments.

Requirements

2–5 years of experience in platform engineering, DevOps, data mesh engineering, or data engineering.
Hands-on experience with the Databricks Terraform provider, including workspace provisioning, Unity Catalog configuration, and compute management.
Hands-on experience with Declarative Automation Bundles (DABs) for deployment and lifecycle management of Databricks assets.
Experience with Git version control, including branching strategies, pull requests, and code review.

Nice To Haves

Experience developing and maintaining Databricks Declarative Automation Bundles to package and standardize data pipelines, workflows, and configurations for deployment by infrastructure and production teams.
Familiarity with TMNAS engineering standards, CI/CD practices, security controls, and production deployment requirements.
Experience with Azure cloud services, including Entra ID, Key Vault, Storage Accounts, and Networking.
Experience with Azure DevOps CI/CD pipelines or equivalent tools such as GitHub Actions, Jenkins, or GitLab CI.
Experience with Bicep or ARM templates for Azure infrastructure provisioning.
Experience with Python and/or Bash for scripting and automation.
Exposure to data platform concepts, including Lakehouse architecture, Delta Lake, the medallion pattern, and data cataloging.
Familiarity with monitoring and observability tools such as Azure Monitor, Grafana, Datadog, or platform-native dashboards.
Experience supporting multi-tenant or multi-environment platform configurations.
P&C Insurance industry experience.

Responsibilities

Build, configure, and maintain Databricks workspaces, Unity Catalog structures, and compute resources across development, test, and production environments.
Develop and maintain Databricks Terraform modules for repeatable provisioning of platform resources, including catalogs, schemas, and RBAC permissions.
Manage and optimize job clusters, SQL warehouses, and serverless compute for cost, performance, and isolation.
Implement and maintain platform security controls, including identity integration, ABAC policies, network security, and secrets management.
Build and maintain Azure DevOps pipelines for automated deployment of Declarative Automation Bundles, notebooks, libraries, and platform configuration.
Develop deployment patterns for promotion from development to test to production, including gating, validation, and rollback capabilities.
Create and maintain shared pipeline templates and reusable deployment components for engineering teams.
Design and automate post-deployment tasks such as DDL execution, configuration seeding, and smoke testing.
Build monitoring and alerting for platform health, including compute utilization, job SLAs, pipeline failures, storage growth, and cost trends.
Build platform dashboards that provide engineering and leadership with operational visibility.
Investigate and resolve platform-level incidents, participate in root cause analysis, and implement preventive measures.
Monitor and optimize platform costs, identify underutilized resources, and recommend right-sizing.
Maintain platform documentation, onboarding guides, and runbooks.
Support engineering teams with platform issues, including workspace access, compute configuration, deployment troubleshooting, and Unity Catalog permissions.
Contribute to internal tooling and shared utilities that improve developer productivity.
Participate in platform design discussions and contribute to Architecture Decision Records.