Senior Databricks Data Engineer

Numentica LLC • Calabasas, CA

5d • Onsite

About The Position

We are seeking a Senior Data Engineer with expertise in AI and Databricks to join our team. This role involves designing and developing scalable data pipelines, building robust data workflows, and creating intelligent APIs to support AI and business applications. You will be responsible for ensuring high data quality, reliability, and performance, while supporting Azure-based data platforms for BI and AI/ML initiatives. Collaboration with cross-functional teams and participation in code reviews with a focus on CI/CD best practices are key aspects of this position.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related technical field.
• 10+ years of experience in Data Engineering.
• Strong expertise in Databricks, Apache Spark, and cloud-based data platforms.
• Proficiency in Python and SQL.
• Hands-on experience with Azure data services and REST API development.
• Experience with DevOps, CI/CD pipelines, and Agile methodologies.

Responsibilities

• Design and develop scalable batch and real-time data pipelines.
• Build robust data ingestion, transformation, and analytics workflows.
• Develop intelligent APIs and data products to support AI and business applications.
• Ensure high data quality, reliability, and performance.
• Collaborate with cross-functional teams to deliver scalable data solutions.
• Support Azure-based data platforms for BI and AI/ML initiatives.
• Participate in code reviews and implement CI/CD best practices.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior