Senior Data Engineer – Data Foundations (Databricks, AWS) - 1606

aKube Inc • Los Angeles, CA

63d • Remote

About The Position

We are seeking a Senior Data Engineer specializing in Data Foundations with expertise in Databricks and AWS. This role involves designing and building scalable data pipelines, developing batch and real-time data processing solutions, and optimizing data platforms. You will work with technologies like Databricks, Snowflake, Redshift, and AWS services (S3, Glue, Lambda). The position requires advanced SQL for performance tuning, proficiency in Python, and experience with workflow tools such as Airflow or DBT. Key responsibilities include ensuring data quality, reliability, and governance, collaborating with data scientists on ML model deployment, and translating business needs into effective data solutions. This is a remote, 12-month contract position.

Requirements

• Databricks
• Snowflake
• Redshift
• AWS (S3, Glue, Lambda)
• Advanced SQL (performance tuning)
• Python
• Airflow or DBT
• 7+ years of data engineering experience
• Strong experience with AWS data services
• Hands-on coding in Python and SQL
• Experience with distributed data systems and big data tools
• Experience building enterprise-scale data platforms

Nice To Haves

• Monte Carlo (data observability)
• Atlan (data catalog)
• CI/CD (GitHub Actions or Jenkins)
• Experience with ML or statistical modeling

Responsibilities

• Design and build scalable data pipelines for large datasets
• Develop batch and real-time data processing solutions
• Work with Databricks, Snowflake, and Redshift for data platforms
• Optimize SQL queries and improve data performance
• Build and maintain workflows using Airflow or DBT
• Ensure data quality, reliability, and governance
• Partner with data scientists to deploy ML models
• Collaborate with teams to translate business needs into data solutions

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed