Databricks Solution Architect

INSPYR Solutions • Pasedena, CA

7h • Onsite

About The Position

Our client is seeking an experienced Databricks Solutions Architect to lead the design, architecture, and modernization of its enterprise data platform. This role provides technical leadership for scalable, secure, and governed Databricks solutions, mentors engineering teams, and helps establish architecture standards. The ideal candidate has extensive hands-on experience designing enterprise-scale Databricks platforms, migrating legacy data environments, and implementing modern lakehouse architectures using Delta Lake, Unity Catalog, Lakeflow, and AI/ML capabilities.

Requirements

• 7+ years designing, building, and operating enterprise Databricks environments using Medallion Architecture
• Extensive hands-on experience with Delta Lake, Unity Catalog, Spark Structured Streaming, Lakeflow (or Delta Live Tables), Databricks SQL, MLflow, and Mosaic AI Model Serving
• Strong cloud architecture experience supporting Databricks on AWS (S3, KMS, VPC) and/or Azure (ADLS, VNet), including cloud networking and security
• Proven success migrating enterprise data platforms from legacy or on-prem environments to Databricks
• Experience designing and supporting production streaming and Change Data Capture (CDC) solutions
• Deep understanding of data governance, security, and compliance: Unity Catalog policies (ABAC), data classification, encryption, access auditing, and regulatory compliance
• Experience designing multi-tier Databricks environments based on data classification
• Strong skills in Python, SQL, Apache Spark, and Databricks Notebooks
• Excellent communication, presentation, and stakeholder management skills

Nice To Haves

• Active Databricks certifications
• Experience with Generative AI and AI agent development on Databricks
• Knowledge of Delta Sharing, Databricks Clean Rooms, and governed cross-organizational data sharing
• Experience integrating Databricks with major ERP platforms and their native data services, including zero-copy integration patterns
• Experience with Lakeflow Designer, Databricks Apps, Genie, and Databricks One
• CI/CD and Infrastructure-as-Code (Terraform) for data platforms
• Background designing enterprise BI reporting solutions
• Experience with Data Quality and Data Governance initiatives
• Experience in highly regulated industries (e.g., financial services, healthcare, life sciences, energy, or public sector) and associated compliance frameworks

Responsibilities

• Serve as technical advisor for Databricks reference architecture, including Lakeflow, Delta Lake, Unity Catalog, Mosaic AI, Databricks SQL, and Databricks Apps
• Design and provide hands-on guidance for end-to-end Databricks data platform solutions
• Architect batch and real-time streaming pipelines, including zero-copy data sharing patterns
• Lead migrations from legacy SQL databases, data warehouses, and document stores to Databricks and cloud data platforms
• Design secure, governed architectures using Unity Catalog, ABAC, governed tags, row- and column-level security, encryption, key management, networking, and compliance frameworks
• Develop multi-tier data lake architectures aligned with data classification and regulatory requirements
• Establish FinOps best practices for workload optimization, performance tuning, and cost management
• Mentor data engineers, analysts, and AI/ML teams; participate in architecture reviews and define technical standards
• Partner with security, infrastructure, and governance teams to ensure policy compliance
• Evaluate emerging Databricks capabilities and recommend adoption strategies and platform enhancements

Benefits

• Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, or any other protected status.
• Compliance with all applicable laws governing nondiscrimination in employment in every location in which the company has facilities.
• Reasonable accommodation during the application or interview process.

What This Job Offers

• Career Level: Senior
• Education Level: No Education Listed