Senior Data Platform Engineer

OneTrust•San Francisco, CA

2d•Hybrid

About The Position

Senior Data Platform Engineer will be part of an innovative Enterprise data team that enables Marketing, Product, Sales, and Finance to explore data and take actions that differentiate us from our competition. You will work closely with data engineers, data architects, domain experts and business analysts to understand business requirements and help to build best in class data platform solutions and architecture for scale.

Requirements

Bachelor's or master's degree in computer science, Engineering or related field
5+ years of overall experience and 3+ years of experience with very large-scale data warehouse projects.
Strong experience in SQL, knowledge of dimensional modeling, supporting data warehouse, scaling, optimizing and performance tuning ETL pipelines
3+ years of experience with Python and manipulation of various data formats for extraction and transformation
3+ years of experience with Snowflake, Airflow, ETL/Integration tools administration.
Hands-on experience with Data Warehouse technologies (Snowflake, Redshift) and Big Data technologies (Hadoop, Hive, Spark, Kafka, Kinesis)
Experience evaluating new tools and enriching existing architecture

Responsibilities

Build and automate modern data platforms (AWS, AZURE, Snowflake) with native technologies, deploy applications, and provision of infrastructure.
Perform Administration, Maintenance and provide support to production systems (Snowflake, Fivetran, DBT, Power BI, Airflow)
Build and maintain CI/CD pipelines and infrastructure as code (IaC) practice across the platform for safe and reproducible deployments.
Design, build and implement automation framework for scale that deliver data with measurable quality under the SLA
Drive technical conversations with stakeholders to understand the platform's needs and come up with a provisioning strategy.
Work effectively using scrum with multiple team members to deliver value effectively.
Reduce technical debt over time with root cause identification, issue resolution and promote best practices across the platform