Databricks Platform Engineer

Optiver • Chicago, IL

21h

About The Position

Optiver is seeking a Databricks Platform Engineer to manage, and operate Optiver’s deployment of the Databricks platform. This role focuses on infrastructure, automation, and operational excellence, enabling teams to use Databricks effectively while maintaining strong security, consistency, and governance.
What You’ll Do:
As markets grow more data-driven and competitive, our ability to ingest, model, and deliver high-quality data at scale is fundamental to maintaining our trading edge. This role will offer ownership of a critical internal platform in a high-impact role with influence over platform standards and direction.

Requirements

• 2+ years experience administering Databricks environments
• Strong experience with Terraform and infrastructure-as-code practices
• Proficiency in Python for automation and tooling Solid understanding of CI/CD principles and tooling
• Experience with Git and collaborative development workflows Proficiency in using Linux CLI
• Understanding of cloud infrastructure concepts (networking, IAM, compute, storage)
• Familiarity with monitoring, alerting, and operational best practices

Nice To Haves

• Experience with AWS infrastructure using Terraform is beneficial
• Ideally experience operating shared developer platforms or internal tooling as well as with multi-environment or multi-account setups
• Knowledge of cloud cost management and governance is nice to have

Responsibilities

• Design, deploy, and operate Databricks workspaces and environments
• Manage workspace configuration, cluster policies, access controls, and platform settings
• Establish and enforce standards for reliability, security, and cost governance
• Support and Improve Databricks platform operations
• Build and maintain infrastructure using Terraform
• Create repeatable, version-controlled deployment patterns across environments
• Automate platform operations and maintenance using Python and shell scripting
• Design and maintain CI/CD systems for infrastructure and platform configuration
• Implement automated validation, testing, and promotion of configuration changes
• Support Git-based workflows and environment lifecycle management
• Troubleshoot Platform level issues
• Help manage system configuration, networking, and access controls
• Improve observability, logging, and operational tooling
• Implement role-based access control, secrets management, and security best practices
• Ensure platform compliance with internal security and operational standards
• Participate in incident response, root cause analysis, and reliability improvements

Benefits

• The opportunity to work alongside best-in-class professionals from over 40 different countries
• Global profit pool structure only Highly competitive compensation package
• Global profit pool structure only Global profit-sharing pool and performance-based bonus structure
• 401(k) match up to 50%
• Comprehensive health, mental, dental, vision, disability, and life coverage
• 25 paid vacation days alongside market holidays
• Extensive office perks, including breakfast, lunch and snacks, regular social events, clubs, sporting leagues and more

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed
• Number of Employees: 1,001-5,000 employees