Senior Data Engineer – Data Foundations (Databricks, Snowflake, AWS) - 1606

aKube • Los Angeles, CA

2d • Hybrid

About The Position

We are seeking a Senior Data Engineer with expertise in Data Foundations, specifically using Databricks, Snowflake, and AWS. This role involves designing and building scalable data pipelines, developing batch and real-time data processing solutions, and optimizing data platforms. The ideal candidate will have extensive experience with AWS data services, advanced SQL, Python, and workflow management tools like Airflow or DBT. You will be responsible for ensuring data quality, reliability, and governance, and will collaborate with cross-functional teams to translate business needs into effective data solutions. A key aspect of this role includes partnering with data scientists to deploy machine learning models.

Requirements

• Databricks
• Snowflake
• Redshift
• AWS (S3, Glue, Lambda)
• Advanced SQL (performance tuning)
• Python
• Airflow or DBT
• 7+ years of data engineering experience
• Strong experience with AWS data services
• Hands-on coding in Python and SQL
• Experience with distributed data systems and big data tools
• Experience building enterprise-scale data platforms

Nice To Haves

• Monte Carlo (data observability)
• Atlan (data catalog)
• CI/CD (GitHub Actions or Jenkins)
• Experience with ML or statistical modeling

Responsibilities

• Design and build scalable data pipelines for large datasets
• Develop batch and real-time data processing solutions
• Work with Databricks, Snowflake, and Redshift for data platforms
• Optimize SQL queries and improve data performance
• Build and maintain workflows using Airflow or DBT
• Ensure data quality, reliability, and governance
• Partner with data scientists to deploy ML models
• Collaborate with teams to translate business needs into data solutions

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed