As a Senior Data Engineer, you will design and build reusable data integration components, frameworks, and libraries at scale to support Operational Data Store / Enterprise Data Lake Platforms.
Design, develop, and maintain scalable, automated, framework driven and efficient data pipelines using scripting languages like Python, Airflow, Dbt and Cloud databases such as Snowflake, RedShift, etc.
Implement data integration solutions for various data sources like SFDC, Product Telemetry, NetSuite and other systems, ensuring data accuracy, consistency, and completeness.
Work closely with DevOps and data scientists to support their data platform automation needs.
Review design, code, and test plans with Data Engineering teammates to increase knowledge and application of key frameworks and methodologies.
Assist internal and external stakeholders with data-related technical issues and support data infrastructure needs.
12+ years' experience in design and development of data pipeline automation extracting data from Cloud API based sources.
Experience developing complex automation frameworks, queries, data modeling, and extract, transform, and load (ETL) processes in SQL, Python, DBT, Apache Airflow or similar technical languages.
Deep Experience in scripting languages such as Python and Cloud database experience such as Snowflake, Redshift, etc.
Proficient in transforming structured and unstructured data.
Experience working on CI/CD processes such as Jenkins, Gitlab CI/CD etc., and source control tools such as GitHub.
Experience identifying and solving issues concerning data management to improve data quality, and clean, prepare and optimize data for ingestion and consumption.
Proven experience integrating and managing business data from enterprise applications to drive analytics and insights.
Bachelor's Degree in Computer Science, Information Technology, Computer Engineering, or related IT discipline; or equivalent experience.
Remote-friendly and flexible work culture
Market leader in compensation and equity awards
Comprehensive physical and mental wellness programs
Competitive vacation and holidays for recharge
Paid parental and adoption leaves
Professional development opportunities for all employees regardless of level or role
Employee Networks, geographic neighborhood groups, and volunteer opportunities to build connections