Senior Software Engineer - Integrations
Afresh
·
Posted:
August 25, 2023
·
Remote
About the position
The integration team at Afresh plays a critical role in transforming messy and complicated grocery fresh data into the Afresh standardized format. They work closely with customers and client leads to understand the customer data and operational processes, bridging the gap between divergent data models. The team builds resilient pipelines and enables rapid product development to eliminate waste in the grocery supply chain. The ideal candidate for this role should have experience in data engineering, strong problem-solving abilities, proficiency in ETL tools and methodologies, and programming skills in SQL and Python. Joining Afresh offers a unique opportunity to make a massive social impact by leveraging impactful software and fighting climate change.
Responsibilities
- Write production code to implement fast, reliable, scalable data pipelines in SQL (using DBT) and Python/PySpark to process billions of historical data points collected from tens of thousands of retail stores across the US.
- Deploy, scale and maintain ETL pipelines that power the recommendation engine and ordering system.
- Collaborate closely with cross-functional teams and customers to gather integration requirements and design integration specifications.
- Ensure data accuracy, completeness, and consistency by implementing robust quality checks and validation processes.
- Develop and maintain automated monitoring systems to detect and address data anomalies proactively.
- Troubleshoot and resolve integration or data issues, performing root cause analysis and communicating customer data fixes required.
- Identify and implement impactful projects aimed at accelerating velocity and minimizing effort for integrations and associated tools and processes.
Requirements
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Data Engineer or similar role, with a track record of successfully delivering data integration projects.
- Strong problem-solving ability and ability to work with stakeholders to identify both high-tech and low-tech solutions and choose the solution appropriate to the problem.
- Excellent communication, technical leadership, and collaboration skills.
- Proficiency in ETL tools and methodologies, demonstrating hands-on experience with data extraction, transformation, and loading processes.
- Strong programming skills in SQL and Python. Spark experience is a plus.
- Dedication to code quality, testing, design processes, automation, and operational excellence.
- Proactive mindset and the ability to work both independently and collaboratively in a fast-paced, team-oriented environment.
Benefits
- Highly competitive cash compensation
- Equity
- Benefits package
- Pay equity audit conducted twice each year
- Remote work opportunities for employees residing in specific states
- Vibrant, diverse, and inclusive team
- Company values of proactivity, kindness, candor, and humility