Lead Data Engineer
About The Position
As a Lead Data Engineer, you will design and implement solutions to ingest, store, transform, and distribute big data on Azure Cloud. The role uses Databricks (Spark, SQL, and PySpark), Databricks Workflows, Python, JSON, and SQL to build products, tools, and features that power customer personalization at scale. Communication and collaboration with Product and Data Science are critical to success. The role takes ownership of features through all phases of the 84.51° software development lifecycle, covering external-facing and internal applications as well as process improvement. It includes developing business-domain understanding and translating it for technical stakeholders; setting technical strategy with Data Science, Product, Architecture, and Kroger partners; and overseeing engineering teams across development and operations, with onshore and offshore resources. The position follows a five-day in-office work schedule. The role is eligible for variable compensation in addition to base salary. Applicants for employment in the United States must have work authorization that does not now or in the future require visa sponsorship for employment with 84.51° or the Kroger Family of Companies.
Requirements
- Bachelor’s degree, typically in Computer Science, Management Information Systems, Mathematics, Business Analytics, or another technically strong program.
- At least 5 years of professional data development experience.
- Strong understanding of Agile principles, including Scrum.
- At least 5 years of experience developing with Spark, including Databricks and PySpark.
- Full understanding of ETL and data warehousing concepts.
- At least 3 years of Python development experience.
- At least 1 year of REST API development experience.
- At least 1 year of Kubernetes experience.
- U.S. work authorization that does not now or in the future require visa sponsorship for employment in the United States with 84.51° or the Kroger Family of Companies.
Responsibilities
- Take ownership of features and drive them to completion through all phases of the 84.51° software development lifecycle, including external-facing and internal applications and process-improvement activities.
- Develop business-domain understanding and bridge it to technical stakeholders.
- Set technical strategy in partnership with Data Science, Product, Architecture, and Kroger partners.
- Oversee engineering teams, including operations and development, with blended offshore and onshore resources.
- Mentor junior resources.
- Lead the design and development of Databricks-based solutions.
- Develop REST APIs hosted in Kubernetes.
- Execute unit and integration testing.
- Collaborate with senior resources to ensure consistent development practices.
- Bring new perspectives to problems and continuously improve personal practices and ways of working.
Benefits
- Medical insurance with competitive plan designs and support for self-care, wellness, and mental health.
- Dental insurance with in-network and out-of-network benefits.
- Vision insurance with in-network and out-of-network benefits.
- 401(k) with Roth option and matching contribution.
- Health Savings Account with matching contribution for associates participating in a qualifying medical plan.
- AD&D and supplemental insurance options.
- Paid time off, including 5 weeks of vacation, 7 health and wellness days, 3 floating holidays, and 6 company-paid holidays per year.
- Paid leave for maternity, paternity, and family care instances.
- Variable compensation eligibility.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
