Sr Data Engineer -- Assortment and Space Planning

The Home Depot • Atlanta, GA

2d • Onsite

About The Position

Data Engineers within the Assortment and Space Planning Data Science team translate business requirements and build the infrastructure needed to structure and deliver the data that powers self-service analytics and hardened business applications. They acquire datasets that align with business needs and develop pipelines to transform data into useful, actionable information. Additionally, they build, test, and maintain data pipeline architectures, create data validation methods and data quality tooling, and develop, host, and maintain data products to improve reliability and confidence through monitoring, testing, and validation. These associates use modern data engineering techniques to cleanse, organize, and transform data, and to maintain, defend, and update data structures and integrity on an automated basis.
The Sr. Data Engineer position creates and establishes design standards and assurance processes for data pipelines and applications to ensure compatibility and operability of data connections, flows, and storage, and reviews internal and external business and product requirements to recommend changes and upgrades to systems and storage. Beyond this technical ownership, the role mentors and coaches less experienced engineers, partners closely with data science, analytics, and application engineering teams to align on pipeline design, and communicates pipeline decisions and data quality tradeoffs clearly to both technical and non-technical partners. These responsibilities require strong technical judgment, effective communication at all levels, and the ability to balance durable design standards with the business's near-term data needs.

Requirements

• Must be eighteen years of age or older.
• Must be legally permitted to work in the United States.
• 5+ years of relevant work experience
• Demonstrated experience in data architecture, data warehousing, and dimensional modeling
• Demonstrated experience developing and testing ETL/ELT jobs and pipelines, configuring orchestration, automated CI/CD, writing automation scripts, and supporting pipelines in production
• Experience with Dataform or dbt for data transformation and pipeline orchestration
• Experience in high-level programming languages such as Python
• Experience defining and capturing metadata and rules associated with ETL processes
• Experience building batch and streaming pipelines
• Prior direct experience writing analytical SQL queries and performance-tuning queries (preferably Google BigQuery)
• Ability to stitch and maintain data from multiple sources
• Ability to optimize pipeline runtime and lower cost on slot/storage consumption
• Ability to prioritize requests and manage a pipeline roadmap
• Coaching junior engineers to help improve their code, best practices, and understanding of data engineering principles
• Strong verbal and written communication skills at all levels
• The knowledge, skills and abilities typically acquired through the completion of a bachelor's degree program or equivalent degree in a field of study related to the job.

Nice To Haves

• Bachelor's or Master's in a quantitative or technical field (Computer Science, Engineering, Statistics, etc.) or relevant work experience
• No additional years of experience
• No additional education
• No additional leadership experience

Responsibilities

• Coding validation and ETL to ensure successful data integration
• Backup and optimization activities to maintain performance; code, configure, test, etc data to ensure integrity
• Create and maintain optimal data pipeline architecture; Develop data architecture to meet business requirements
• Collaborate with team leads and cross functional partners to assess business requirements and communicate opportunities

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: Associate degree