Databricks Platform Architect

Hitachi • Dallas, TX

3d

About The Position

We are looking for a highly skilled Databricks Platform Architect to lead the design and implementation of scalable, enterprise-grade data platforms using Databricks. The ideal candidate will combine strong technical expertise in data engineering and cloud platforms (AWS/Azure/GCP) with architectural leadership, solution design capability, and strong stakeholder engagement skills.

Requirements

• Databricks on AWS Platform Architect – Platform Architecture
• Core Technologies: Databricks, AWS S3, Delta Lake, Unity Catalog, Spark/PySpark, Terraform, GitHub, CI/CD, CloudWatch, Mosaic AI, Genie, Vector Search, MLflow, Kafka, Airflow, Kubernetes.

Responsibilities

• Architect and manage a secure, scalable, and highly available Databricks Lakehouse Platform on AWS.
• Design data platforms leveraging AWS S3, Delta Lake, Unity Catalog, and Databricks Workspaces for enterprise analytics and AI.
• Define networking architecture including VPC, PrivateLink, IAM roles, security groups, and encryption standards.
• Establish multi-environment strategies (Dev, Test, UAT, Prod) with automated provisioning through Terraform and Infrastructure as Code (IaC).
• Implement enterprise-wide data governance, lineage, metadata management, and compliance controls using Unity Catalog.
• Design high-performance data ingestion and processing architectures supporting batch, streaming, and real-time analytics workloads.
• Enable AI and GenAI capabilities through Mosaic AI, Vector Search, Model Serving, AI/BI Dashboards, and Genie Spaces.
• Define CI/CD, monitoring, logging, and observability frameworks using GitHub, Jenkins, CloudWatch, and Databricks Workflows.
• Optimize platform performance, reliability, scalability, and cloud costs through FinOps and workload optimization practices.
• Provide architectural leadership and best practices for Lakehouse modernization, advanced analytics, AI governance, and enterprise data platform adoption.

Benefits

• Industry-leading benefits, support, and services that look after your holistic health and wellbeing.
• Flexible arrangements that work for you (role and location dependent).

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed