Databricks Architect

TATA Consulting Services • Napa, CA

74d • $80,000 - $150,000

About The Position

Working on client projects as Data bricks Architect and successfully designing and implementing solutions on a scale
Architect end-to-end data pipelines that integrate with Databricks and other cloud services.
Ensure that the data architecture supports both batch and real-time data processing and analytics.
Leverage Databricks Delta Lake for data storage, management, and processing.

Requirements

• Proficiency in programming languages such as Python, Scala, or Java
• Strong knowledge of Apache Spark and its ecosystem
• Hands-on experience with Databricks notebooks and Delta Lake for data lake management
• Experience with data orchestration tools like Apache Airflow, dbt, or similar
• Strong SQL skills and familiarity with data warehousing concepts

Nice To Haves

• Familiarity with containerization technologies like Docker and Kubernetes is a plus
• Knowledge of machine learning and artificial intelligence concepts is beneficial.

Responsibilities

• Working on client projects as Data bricks Architect and successfully designing and implementing solutions on a scale
• Architect end-to-end data pipelines that integrate with Databricks and other cloud services.
• Ensure that the data architecture supports both batch and real-time data processing and analytics.
• Leverage Databricks Delta Lake for data storage, management, and processing.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Professional, Scientific, and Technical Services
• Education Level: No Education Listed
• Number of Employees: 5,001-10,000 employees