Software Development Engineer

Adobe • San Jose, CA

3d

About The Position

In this role, you will plan, design, build, and maintain scalable data pipelines using Databricks, leverage real-time data processing with Apache Storm, orchestrate workflows with Astronomer. The Commerce Data Platform team is focused on using the power of data to deliver optimized experiences through personalization. As a member of the Data Engineering team, you will have significant responsibility to help build large scale cloud-based data and analytics platform with enterprise-wide consumers. This role is inherently multi-functional, and the ideal candidate will work across teams. The position requires ability to own things, come up with innovative solutions, try new tools, technologies, and entrepreneurial personality.

Requirements

• Bachelor’s degree in computer science or equivalent.
• Minimum of 5 years of experience in software engineering,
• Motivated self-starter with the ability to learn and adapt quickly.
• Track record of delivering software releases or projects on time with high quality.
• Proficiency in Python for scripting, data processing, and pipeline development
• Strong SQL experience for querying, cleansing, integrating, and summarizing complex data is essential

Nice To Haves

• Master’s degree or equivalent experience is preferred.
• Experience with Databricks and Python is desirable
• Proven experience of building, testing, evaluating, and improving revenue-generating data science models
• Knowledge of propensity modeling techniques and other modeling techniques would be beneficial
• Proven experience translating complex analytics into understandable insights for senior collaborators is essential
• Strong problem-solving skills and experience in a fast-paced business environment with changing requirements

Responsibilities

• Build fault tolerant, scalable, quality data pipelines using multiple cloud- based tools.
• Work independently to design and delivering medium to complex functionality.
• Collaborate and Provide guidance to team members to build a scalable and high-performance solution with low operational overhead.
• Work with multi-functional team members to ensure a superb end-to-end user experience for our customers.
• Fast prototyping of ideas and concepts and researching the latest industry trends.
• Build features that make our products easier to use.
• We're constantly experimenting with how to improve our products to benefit our users, and you'll help track metrics and formulate ideas to improve and increase adoption.
• Perform analysis and experimentation for the data flowing through different systems/services
• Build a data consistency and validation feature in delivering high-quality data.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level