Data Engineer
About The Position
Our Data Analytics Unit, embedded in the Policy & Community Affairs Division, works at the intersection of data infrastructure and public policy. A lot of initial work starts with a policy question rather than a specification. The data (and analytics) engineering focus is on building and maintaining the infrastructure that makes good policy analysis possible everything from inspecting raw file submissions and initial ETL to designing pipelines and creating silver and gold tables to make analysis as streamlined as possible. Our goal is to make sure what we're producing is trustworthy: well-documented, reproducible, and reliable over time. We're a small team of analysts and engineers, so there is room for close collaboration. The data itself is rich: billions of trip records, GPS breadcrumb traces for every for-hire vehicle in the city, detailed session data across all major platforms. The infrastructure we've built Databricks, Delta Lake, Azure allows us to process this quickly and consistently at scale so we can focus on policy impact and not be bottlenecked by compute.
Requirements
- Master’s degree
- At least 3 years of related work experience
- US work authorization
- Infrastructure focus
- Analytical curiosity
- Comfortable with ambiguity
- Clean and readable Python and SQL
- Version control, modular code, and documentation habits
- Comfortable presenting to senior staff and external stakeholders
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
5,001-10,000 employees
