Databricks Architect

Vidha It Solutions Llc

11d • Remote

About The Position

Vidha IT Solutions LLC is hiring a Databricks Architect for a remote position. The role focuses on designing and maintaining scalable data pipelines and ETL/ELT workflows using Databricks and Apache Spark. The architect will work with data scientists, analysts, and business stakeholders to deliver data-driven solutions; manage Databricks clusters, notebooks, and scheduled jobs; implement Delta Lake architecture and practices for reliability and governance; and integrate Databricks with cloud platforms and enterprise data sources. The role also involves troubleshooting pipeline issues and supporting performance, cost efficiency, high availability, and data quality.

Vidha IT Solutions LLC describes itself as a technology services company delivering IT and data solutions to clients across industries, with a collaborative, growth-oriented workplace where employees can make an impact and develop their careers. The posting specifies W-2 only and says any visa is accepted.

Requirements

• Proven experience as a Databricks Engineer or Data Engineer, with hands-on Databricks platform expertise.
• Strong proficiency in Apache Spark, PySpark, and SQL.
• Experience with Delta Lake, Lakehouse architecture, and data modeling.
• Familiarity with cloud platforms (AWS, Azure, or GCP) and cloud-native data services.
• Experience building and managing ETL/ELT pipelines at scale.
• Knowledge of Python, Scala, or other relevant programming languages.
• Strong problem-solving skills and ability to work in a collaborative, fast-paced environment.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
• Build and optimize ETL/ELT workflows for data ingestion, transformation, and delivery.
• Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.
• Manage and monitor Databricks clusters, notebooks, and job scheduling for performance and cost efficiency.
• Implement Delta Lake architecture and best practices for data reliability and governance.
• Integrate Databricks with cloud platforms such as AWS, Azure, or GCP and enterprise data sources.
• Troubleshoot and resolve data pipeline issues, ensuring high availability and data quality.

What This Job Offers

• Job Type: Full-time
• Education Level: No Education Listed