Staff Software Engineer - Core Data Engineering
Afresh
·
Posted:
July 31, 2023
·
Remote
About the position
This role is a key position within Afresh's Core Data Engineering team. The main responsibility is to make changes to the company's common code and standard schemas to meet the needs of new products and features. Additionally, the role involves developing tools to enhance customer integration velocity. The ideal candidate should have experience in designing and building ETL pipelines, as well as a strong understanding of data stores and big data frameworks. Strong problem-solving skills, dedication to code quality, and excellent communication skills are also required.
Responsibilities
- Design, build, scale, and deploy ETL pipelines in Python, Pandas, Spark, SQL, and DBT to process data from US retail stores and power the recommendation engine and ordering system
- Collaborate with interdisciplinary teams to transform customer data and implement solutions
- Monitor and analyze data, create dashboards, escalate high-priority issues, and find workarounds to extract necessary information from customer data
- Develop standard tools to increase the integration velocity of new customers and release new product features
- Identify problems or areas of improvement, design solutions, and see them through to implementation
- Strong understanding and experience with various data stores, Big Data frameworks, and cloud infrastructure
- Experienced with architecture and design of data-driven solutions
- Strong problem-solving ability and ability to work through ambiguity
- Dedication to code quality, testing, design processes, automation, and operational excellence
- Active participation in engineering tools discussions and contribution to future growth
- Excellent written communication, verbal communication, and collaboration skills
Requirements
- Design, build, scale, and deploy ETL pipelines in Python, Pandas, Spark, SQL, and DBT
- Collaborate with interdisciplinary teams to transform customer data and implement solutions
- Monitor and analyze data, create dashboards, and escalate high-priority issues
- Develop tools to increase customer integration velocity and release new product features
- Ability to identify problems, design solutions, and see them through to implementation
- Strong understanding and experience with various data stores and Big Data frameworks
- Experienced with architecture and design of data-driven solutions
- Strong problem-solving ability and ability to work through ambiguity
- Dedication to code quality, testing, design processes, automation, and operational excellence
- Active stakeholder in engineering tools discussions
- Excellent written communication, verbal communication, and collaboration skills
Benefits
- Highly competitive cash compensation, equity, and benefits package
- Pay equity audit conducted twice a year to ensure fair compensation
- Opportunity to have massive social impact at scale
- Work on a mission to eliminate food waste and make fresh food accessible to all
- Opportunity to work with uncommonly impactful software
- Opportunity to work with an interdisciplinary team of experts
- Opportunity to build software to support the company's mission
- Opportunity to work on cutting-edge technology
- Opportunity to work remotely (depending on location)
- Vibrant, diverse, and inclusive team
- Equal employment opportunities for all employees
- Opportunity to work in a positive social impact and rocket ship financial growth company