Databricks Platform & Data Engineer

NTT DATA Services•Plano, TX

About The Position

NTT DATA is seeking a senior Databricks Platform & Data Engineer to join its Databricks Center of Excellence (CoE). The role combines platform engineering, architecture, and hands-on data engineering, with a focus on building and scaling enterprise-grade Databricks environments for large, regulated clients. The engineer will lead platform setup, governance, and adoption, and partner with clients to design and deliver use cases using Databricks capabilities such as Dataflow, Unity Catalog, AI/BI, and Genie. This is a client-facing consulting role that requires technical depth, communication skills, and the ability to translate business requirements into scalable data platform solutions. The position is based in Plano, Texas, with additional listed locations in Minneapolis, Minnesota; Chicago, Illinois; and Atlanta, Georgia. It contributes to the Databricks CoE by delivering client solutions and developing accelerators, frameworks, reference architectures, and best practices for enterprise Databricks adoption.

Requirements

  • 12+ years of experience in data engineering, platform engineering, or data architecture.
  • 5+ years of hands-on Databricks experience in large enterprise environments.
  • Deep expertise in Apache Spark using Scala or Python.
  • Deep expertise in Delta Lake and Lakehouse architectures.
  • Deep expertise in Databricks workspace setup, cluster policies, and job orchestration.
  • Strong experience with cloud platforms such as AWS, Azure, or GCP.
  • Experience implementing data governance, security, and compliance controls.
  • Proven ability to design and deliver scalable, production-grade data platforms.
  • Strong client-facing and communication skills.
  • Ability to translate business requirements into scalable data platform solutions.

Nice To Haves

  • Experience in financial services or other regulated industries.
  • Familiarity with data governance frameworks, regulatory reporting, and risk data environments.
  • Databricks certifications, such as Data Engineer or Solutions Architect.
  • Experience with real-time streaming, including Kafka or Structured Streaming.
  • Experience with MLOps or model serving.
  • Experience with data marketplace or data product architectures.
  • Exposure to AI-assisted development workflows and agent-based tooling.

Responsibilities

  • Design and deploy enterprise-scale Databricks Lakehouse platforms across AWS and Azure.
  • Establish secure, governed environments using Unity Catalog, role-based access controls, and data lineage.
  • Define platform standards, reusable patterns, and guardrails for scalable adoption.
  • Optimize platform performance, cost, and reliability for production workloads.
  • Implement CI/CD, environment promotion, and DevOps automation for Databricks.
  • Lead adoption of Databricks capabilities including Unity Catalog, Dataflow or declarative pipelines, and Genie or AI-assisted development.
  • Enable AI/BI dashboards, model serving, and advanced analytics use cases.
  • Build and optimize batch and streaming data pipelines using Spark and Delta Lake.
  • Develop data products and domain-oriented pipelines aligned with enterprise data strategies.
  • Lead end-to-end use case delivery, from requirements through production deployment.
  • Drive data quality, observability, and pipeline reliability.
  • Advise client stakeholders across architecture, data, risk, and business teams.
  • Translate business requirements into technical architecture and delivery roadmaps.
  • Lead workshops, solution design sessions, and platform adoption strategies.
  • Support proposals, solutioning, and client innovation within regulated industries.
  • Build and contribute to NTT DATA accelerators, frameworks, and reusable assets.
  • Define best practices, reference architectures, and playbooks for enterprise Databricks adoption.
  • Mentor junior engineers and support capability building across the CoE.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service