Databricks Architect

Capgemini•New York, NY
•$136,000 - $150,000•Hybrid

About The Position

Capgemini is hiring a Databricks Architect to design and implement scalable data architectures, including Lakehouse solutions built with Delta Lake and Unity Catalog. The role involves managing data infrastructure on cloud platforms such as AWS, Azure, or GCP, and establishing data governance, lineage, metadata management, and access controls, including integration with third-party products such as Immuta and Protegrity. The architect will develop ETL and ELT workflows for structured and unstructured data, use Databricks Delta Live Tables and Workflows to orchestrate data processes, and optimize Apache Spark jobs and Databricks performance for scale, cost, and efficiency. The role also encompasses data security and compliance in Databricks and Azure, streaming technologies, machine-learning and advanced-analytics platforms, MLOps, enterprise security and networking, cost governance, and deployment practices developed with DevOps teams using Terraform or similar tools. The position is based in Princeton, New Jersey, with three days per week in the office.

Requirements

  • Hands-on experience with streaming technologies such as Kafka, Event Hubs, or Kinesis.
  • Experience architecting machine-learning platforms and advanced-analytics workloads, and developing and deploying MLOps on Databricks.
  • Expertise in enterprise security models, networking, and cost governance.
  • Experience working with DevOps teams to establish deployment practices using Terraform or similar.
  • Prior experience leading enterprise Azure Databricks implementations.

Responsibilities

  • Contribute to the design and implementation of scalable data architectures, such as Lakehouse architectures using Delta Lake and Unity Catalog.
  • Manage and maintain data infrastructure on cloud platforms such as AWS, Azure, or GCP.
  • Implement data governance practices, including data lineage, metadata management, and access controls, integrating third-party products such as Immuta and Protegrity.
  • Follow software engineering best practices, including code reviews and CI/CD automation.
  • Keep up to date with trends and technologies in data engineering and the Databricks ecosystem.
  • Design and build ETL and ELT workflows to ingest, transform, and load structured and unstructured data from various sources.
  • Use Delta Live Tables and Databricks Workflows to orchestrate and manage complex data processes.
  • Optimize and tune Apache Spark jobs for performance and cost efficiency on large datasets.
  • Implement and enforce data security, access control, and compliance policies in Databricks and Azure.
  • Architect machine-learning platforms and advanced-analytics workloads, and develop and deploy MLOps on Databricks.
  • Work with DevOps teams to establish deployment practices using Terraform or similar tools.
  • Optimize Databricks performance, including autoscaling, caching, Delta optimization, job tuning, and cost optimization.
  • Lead enterprise Azure Databricks implementations.

Benefits

  • Paid time off, including vacation of 12–25 days depending on employee grade, company-paid holidays, personal days, and sick leave, subject to policy.
  • Medical, dental, and vision coverage, subject to local policy and eligibility.
  • Retirement savings plans, such as a 401(k) in the U.S., subject to local policy and eligibility.
  • Life and disability insurance, subject to local policy and eligibility.
  • Employee assistance programs, subject to local policy and eligibility.
  • Other benefits provided under local policy and eligibility.
  • The role may be eligible for variable incentives, bonuses, or commissions, depending on the position and applicable laws.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service