Solution Architect, Delivery (Databricks)

Infinitive Inc • Ashburn, VA

1d • $140,000 - $210,000

About The Position

Infinitive is a data and AI consultancy that helps clients modernize, monetize, and operationalize data. The Solution Architect, Delivery is a technical leadership role responsible for the architecture, design, and end-to-end delivery of complex Lakehouse and Data Intelligence Platform solutions. The role connects client executive vision with production-grade engineering and leads technical direction across multi-cloud environments, scalable data pipelines, governance, and complex migrations.

The architect works with client enterprise architects, Databricks partner engineering, and Infinitive delivery teams to ensure implementations meet performance, security, cost-efficiency, and architectural governance standards. The role also advises client technology leaders, guides engineering teams, and develops reusable architectural assets for Infinitive.

The stated U.S. compensation estimate is $140,000–$210,000. Infinitive is an Equal Opportunity Employer.

Requirements

• At least 8 years of experience in data architecture, data engineering, or enterprise software development.
• At least 3 years architecting enterprise solutions centered on Apache Spark and the Databricks Data Intelligence Platform.
• Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional certification.
• Deep architectural proficiency in at least one major cloud platform (AWS, Azure, or GCP), including VPC/VNet networking, private endpoints, cloud IAM/Entra ID integration, and cloud object storage (S3, ADLS Gen2, or GCS).
• Mastery of modern data modeling methodologies, including dimensional modeling, Data Vault, and Medallion design.
• Hands-on production experience implementing Unity Catalog across multi-workspace environments.
• Advanced programming skills in Python, PySpark, and SQL.
• Production experience with Infrastructure as Code using Terraform and orchestrators such as Databricks Workflows or Airflow.
• Proven experience leading technical delivery teams, translating complex functional requirements into architectural blueprints and user stories, and resolving critical delivery blockers.

Nice To Haves

• Hands-on experience integrating Databricks with BI tools such as Power BI or Tableau, reverse ETL, dbt, or data observability platforms.
• Experience delivering architectures compliant with enterprise regulatory frameworks such as HIPAA, HITRUST, SOC 2, or FedRAMP.
• Active Public Trust or Secret clearance, or eligibility to obtain clearance, for regulated or public-sector engagements.

Responsibilities

• Design enterprise-scale, production-ready Lakehouse solutions using the Databricks Data Intelligence Platform, Medallion Architecture, Delta Lake, and Databricks SQL.
• Architect and configure enterprise security and governance models, including Unity Catalog, row- and column-level filtering, data masking, ABAC, and Delta Sharing.
• Lead architectural strategy and technical execution for migrations from legacy data warehouses and Hadoop platforms to Databricks.
• Define batch and low-latency streaming patterns using Structured Streaming, Delta Live Tables, Auto Loader, and Apache Spark optimization techniques.
• Lead engineering pods by establishing reference architectures, conducting architectural reviews, reviewing pull requests, and standardizing CI/CD pipelines using Terraform and Databricks Asset Bundles.
• Diagnose and resolve Spark and Delta performance bottlenecks; optimize query execution plans, partitioning, Z-Ordering, caching, and Photon configurations.
• Establish compute governance practices, including cluster policies, auto-termination and autoscaling rules, serverless compute configurations, and chargeback/showback tagging models.
• Partner with Machine Learning and AI engineers to integrate MLflow, Feature Store, Databricks Model Serving, and Vector Search/RAG pipelines into data platforms.
• Advise client Chief Architects, Directors of Engineering, and CDOs; lead technical workshops, architectural design sessions, and proof-of-concept evaluations.
• Collaborate with Databricks Partner Solutions Architects and field engineering to evaluate preview features and align with platform best practices.
• Create reusable architectural blueprints, reference architectures, migration accelerators, and boilerplate configurations for Infinitive’s intellectual property library.
• Break down complex functional requirements into architectural blueprints and user stories, lead technical delivery teams, and resolve critical delivery blockers.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed