Sr. Databricks Architect

Omm IT Solutions•Jersey City, NJ

2d•Onsite

About The Position

We are seeking an experienced Sr. Databricks Architect to lead the design, deployment, and security architecture of enterprise-scale Databricks platforms on AWS. The ideal candidate will possess deep expertise in Databricks infrastructure, cloud architecture, Terraform automation, and AWS networking while serving as the technical leader for customer architecture workshops and platform enablement sessions.

Requirements

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
10+ years of experience in cloud engineering, platform engineering, or solution architecture.
3–5 years of hands-on experience architecting and deploying Databricks on AWS.
Strong experience deploying both Databricks Classic and Serverless workspaces.
Hands-on experience with Terraform for infrastructure provisioning and Infrastructure as Code (IaC).
Deep understanding of AWS networking, storage, and identity services.
Strong expertise in Databricks security architecture and governance.
Experience leading technical workshops, architecture reviews, and stakeholder discussions.
Excellent problem-solving, documentation, and communication skills.

Nice To Haves

AWS Solutions Architect or Databricks certifications.
Experience implementing enterprise cloud security and governance frameworks.
Experience working in highly regulated industries such as banking or financial services.
Familiarity with CI/CD pipelines and DevOps automation.
Experience designing multi-account AWS environments.
Knowledge of cloud compliance standards and security best practices.
Experience mentoring engineering teams and establishing architecture standards.

Responsibilities

Design, deploy, and manage Databricks Classic and Serverless workspaces on AWS.
Architect secure and scalable Databricks platform infrastructure, including networking, storage, identity, and access management.
Develop and maintain reusable Terraform modules for provisioning AWS and Databricks resources.
Implement Databricks platform security, including workspace isolation, cluster access controls, secret management, and secure networking.
Lead architecture workshops, technical enablement sessions, and solution discussions with customer and stakeholder teams.
Support Databricks security accreditation, governance, and compliance initiatives.
Collaborate with cloud, network, infrastructure, and security teams to validate architecture and resolve deployment challenges.
Produce architecture diagrams, deployment documentation, operational runbooks, and platform standards.
Recommend infrastructure improvements, automation strategies, and cloud best practices.
Ensure enterprise-grade reliability, scalability, and security across the Databricks platform.