Senior Databricks Data Engineer

Numentica • Calabasas, CA

2d • Onsite

About The Position

We are seeking a Senior Data Engineer with expertise in AI and Databricks to join our team. This role involves designing and developing scalable data pipelines, building robust data ingestion and transformation workflows, and creating intelligent APIs to support AI and business applications. You will work with Azure-based data platforms, ensuring high data quality and performance, and collaborate with cross-functional teams to deliver data solutions. This is a full-time, onsite position requiring 4 days per week.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related technical field.
• 10+ years of experience in Data Engineering.
• Strong expertise in Databricks, Apache Spark, and cloud-based data platforms.
• Proficiency in Python and SQL.
• Hands-on experience with Azure data services and REST API development.
• Experience with DevOps, CI/CD pipelines, and Agile methodologies.

Responsibilities

• Design and develop scalable batch and real-time data pipelines.
• Build robust data ingestion, transformation, and analytics workflows.
• Develop intelligent APIs and data products to support AI and business applications.
• Ensure high data quality, reliability, and performance.
• Collaborate with cross-functional teams to deliver scalable data solutions.
• Support Azure-based data platforms for BI and AI/ML initiatives.
• Participate in code reviews and implement CI/CD best practices.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior