Director, Data Engineering
About The Position
The Search and Discovery team is responsible for creating a world class search and discovery shopping experience for our customers, from “intent” based shopping to delighting the customer with serendipitous product discovery on every visit. We are obsessed with optimizing the entire search customer journey, from query understanding and search relevance to personalized and category/mission aware search and recommendation experiences. We believe the experience of finding the right fresh groceries should be personal and different from shopping for a new laptop or your next pair of jeans. Search and Recommendations drive over 70% of product discovery for our millions of daily customers, so the scale and impact of our work is massive! Within S&D, the Data Science, Analytics, and Data Engineering team analyzes customer data to determine how our Search models should be designed. This includes assessing how customers interact with our search results, analyzing experiments, building predictive models, and much more. We partner with Product and Engineering to turn these insights into changes to our Search models.
Requirements
- 8 years of Data Engineering experience in customer-facing technology companies
- 3+ years experience as a people manager
- Proficiency in Data modeling, ETL, Python and SQL
- Experience with distributed processing technologies and frameworks and distributed storage systems (e.g. Spark, HDFS, S3)
- Experience with ETL schedulers (e.g. Airflow, Dagster, DBT)
Nice To Haves
- Experience with massive datasets, with an understanding of how to optimize data extraction
- Expertise in experimentation and statistics
- Ability to communicate data concepts simply and succinctly to cross-functional team members, up to the C-suite
- Understanding of ML concepts, and how different model configurations affect model outcomes
- Experience in e-commerce and/or search
Responsibilities
- Lead a small team of Data Engineers to ideate, build, and manage analytics and production data ETL/ELT systems for high-volume data ingestion from diverse sources
- Partner with Data Science, Engineering, and Product to enable reliable, accurate logging/implementation and usage of Search data
- Ensure data quality, observability, and reliability across the data lifecycle
- Optimize systems for performance, cost efficiency, and scalability
- Define and manage SLAs for data systems
- Ensure security and compliance of data per industry standards
Benefits
- Medical/Dental/Vision/Life, AD&D insurance
- Flexible Spending Accounts (FSA) & Health Savings Account (HAS)
- Long-term/Short-term Disability
- Employee Assistance Program (EAP) program
- 401K Plan with Company Match
- 18-21 days of Paid Time Off (PTO) a year based on the tenure
- 12 Paid Holidays
- Paid Parental leave
- Pre-tax commuter benefits
- MTV- [Free] Electric Car Charging Station
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Director
Education Level
No Education Listed
