TATA Consulting Services-posted 26 days ago
$80,000 - $150,000/Yr
Full-time • Mid Level
Napa, CA
5,001-10,000 employees
Professional, Scientific, and Technical Services

Working on client projects as Data bricks Architect and successfully designing and implementing solutions on a scale Architect end-to-end data pipelines that integrate with Databricks and other cloud services. Ensure that the data architecture supports both batch and real-time data processing and analytics. Leverage Databricks Delta Lake for data storage, management, and processing.

  • Working on client projects as Data bricks Architect and successfully designing and implementing solutions on a scale
  • Architect end-to-end data pipelines that integrate with Databricks and other cloud services.
  • Ensure that the data architecture supports both batch and real-time data processing and analytics.
  • Leverage Databricks Delta Lake for data storage, management, and processing.
  • Proficiency in programming languages such as Python, Scala, or Java
  • Strong knowledge of Apache Spark and its ecosystem
  • Hands-on experience with Databricks notebooks and Delta Lake for data lake management
  • Experience with data orchestration tools like Apache Airflow, dbt, or similar
  • Strong SQL skills and familiarity with data warehousing concepts
  • Familiarity with containerization technologies like Docker and Kubernetes is a plus
  • Knowledge of machine learning and artificial intelligence concepts is beneficial.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service