Senior Data Platform Engineer

OneTrust•San Francisco, CA

1d•Hybrid

About The Position

Strength in Trust OneTrust’s mission is to enable organizations to use data and AI responsibly. Our platform simplifies the collection of data with consent and preferences, automates the governance of data with integrated risk management across privacy, security, IT/tech, third-party, and AI risk, and activates the responsible use of data by applying and enforcing data policies across the entire data estate and lifecycle. OneTrust supports seamless collaboration between data teams and risk teams to drive rapid and trusted innovation. Recognized as a market pioneer and leader, OneTrust boasts over 300 patents and serves more than 14,000 customers globally, ranging from industry giants to small businesses. The Challenge Senior Data Platform Engineer will be part of an innovative Enterprise data team that enables Marketing, Product, Sales, and Finance to explore data and take actions that differentiate us from our competition. You will work closely with data engineers, data architects, domain experts and business analysts to understand business requirements and help to build best in class data platform solutions and architecture for scale. Your Mission You will work closely with data engineers, data architects, domain experts and business analysts to understand business requirements and help to build best in class data platform solutions and architecture for scale. Build and automate modern data platforms (AWS, AZURE, Snowflake) with native technologies, deploy applications, and provision of infrastructure. Perform Administration, Maintenance and provide support to production systems (Snowflake, Fivetran, DBT, Power BI, Airflow) Build and maintain CI/CD pipelines and infrastructure as code (IaC) practice across the platform for safe and reproducible deployments. Design, build and implement automation framework for scale that deliver data with measurable quality under the SLA Drive technical conversations with stakeholders to understand the platform's needs and come up with a provisioning strategy. Work effectively using scrum with multiple team members to deliver value effectively. Reduce technical debt over time with root cause identification, issue resolution and promote best practices across the platform You Are This hands-on technical role demands excellent knowledge and can demonstrate best practices in the industry.

Requirements

Bachelor's or master's degree in computer science, Engineering or related field
5+ years of overall experience and 3+ years of experience with very large-scale data warehouse projects.
Strong experience in SQL, knowledge of dimensional modeling, supporting data warehouse, scaling, optimizing and performance tuning ETL pipelines
3+ years of experience with Python and manipulation of various data formats for extraction and transformation
3+ years of experience with Snowflake, Airflow, ETL/Integration tools administration.
Hands-on experience with Data Warehouse technologies (Snowflake, Redshift) and Big Data technologies (Hadoop, Hive, Spark, Kafka, Kinesis)
Experience evaluating new tools and enriching existing architecture
You are a self-starter, hands-on technical expert who continuously gather and synthesize high-impact needs from business partners, design and implement the appropriate technical platform solution, and effectively communicate about deliverables, timelines and tradeoffs

Responsibilities

Work closely with data engineers, data architects, domain experts and business analysts to understand business requirements and help to build best in class data platform solutions and architecture for scale.
Build and automate modern data platforms (AWS, AZURE, Snowflake) with native technologies, deploy applications, and provision of infrastructure.
Perform Administration, Maintenance and provide support to production systems (Snowflake, Fivetran, DBT, Power BI, Airflow)
Build and maintain CI/CD pipelines and infrastructure as code (IaC) practice across the platform for safe and reproducible deployments.
Design, build and implement automation framework for scale that deliver data with measurable quality under the SLA
Drive technical conversations with stakeholders to understand the platform's needs and come up with a provisioning strategy.
Work effectively using scrum with multiple team members to deliver value effectively.
Reduce technical debt over time with root cause identification, issue resolution and promote best practices across the platform