Senior Data Engineer, PickupXP

Lyft•Toronto, ON

45d•Hybrid

About The Position

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Our mission depends on having a digital representation of the physical world - a map with all routing related (real-time) information. This is what makes Lyft different from many products: our products don’t just facilitate online interactions, they facilitate dynamic, real-world ones. Without mapping services, none of these real world interactions between people and transport can happen. We are hiring a Senior Data Engineer to join our Pickup, Places and Search team within the Mapping organization that is responsible for building, enhancing and maintaining the Rider and Driver product for the Pickup/Drop off Experience. This team supports the backbone of Lyft’s search system, supporting millions of rides by helping our riders and drivers connect and reach their destination. Our focus is to ensure the pickup/dropoff experience is seamless by enhancing guidance and routing as well as the rider experience. Additionally the team uses map data and other signals to create new product experiences in collaboration with teams across Lyft. This team has a history of enabling rich and creative features that directly influence the product for all of our users. We constantly innovate and incorporate cutting-edge technologies to make the lives of our community more enriched. In this role, you'll collaborate with other engineering teams, product, data science, analytics, and operations on programs that empower us to iterate quickly, delighting our passengers and drivers with rideshare focused mapping experiences.

Requirements

5+ years of relevant professional experience in data engineering or a related field
Strong expertise in SQL and experience with Trino or Spark/PySpark
Experience building and optimizing complex data models and pipelines with a strong understanding of ETL processes
Expertise in data modeling and ETL, with experience developing and optimizing complex data models and pipelines
Hands-on experience with workflow management tools (e.g., Airflow or similar)
Proficiency in a scripting language like Python or Bash
Comfortable working directly with cross-functional teams (data analytics, data science, engineering) to align solutions with business goals

Responsibilities

Owner of core company data pipelines, responsible for scaling up data processing flow to meet the rapid data growth at Lyft
Continuously evolve data models and schemas based on business and engineering requirements
Implement and maintain systems to monitor and enhance data quality and consistency
Develop tools that support self-service management of data pipelines (ETL) and optimize data processing performance
Write well-crafted, well-tested, readable, maintainable code that prioritizes scalability and cost efficiency
Conduct code reviews to ensure code quality standards and facilitate knowledge sharing
Participate in on-call rotations to maintain high availability and reliability of workflows and data pipelines
Collaborate with internal and external partners to remove blockers, provide support, and achieve results
Help establish technical roadmaps and architectures based on technology and our business needs.
Drive high-impact projects and innovate new solutions to provide the best mapping experience possible.
Ship ML models at scale and low cost by focussing on systems / performance engineering.