Data Engineer

The Home Depot • GEORGIA - VIRTUAL - GA01, GA

1d • $110,000 - $125,000 • Onsite

About The Position

For this role, we are looking for someone who can design, build, and maintain the data models, transformations, and pipelines that turn raw contact center data into trusted metrics and datasets in a cloud-based data warehouse. This person will own metric logic and data quality, partner with operations and enterprise data teams, and hold source system owners to quality standards in support of Customer Solutions and Data Science initiatives that drive better customer experiences and more profitable outcomes.

Requirements

• Must be eighteen years of age or older.
• Must be legally permitted to work in the United States.
• Experience in building real time streaming data ingestion and processing pipeline using Apache Beam (running on either Google Datflow or Apache (Apex, Flink, or Spark) or Kafka in an analytics or data science use case
• Experience with data processing tools (e.g. Hadoop, Spark, Dataflow, etc.)
• Experience building ETL/ELT pipelines
• Experience with column-oriented databases (e.g Redhift, BigQuery, Vertica)
• Ability to go from whiteboard discussion to code
• Ability to effectively communicate with technical and non-technical audiences
• Strong programming ability
• Success in a highly dynamic environment and ability to shift priorities with agility
• Ability to act independently with minimal supervision
• Willingness to explore and implement new ideas and technologies
• Experience working directly with subject matter experts in both business and technology domains
• 6 years of work experience

Nice To Haves

• Familiarity with Agile methodologies
• Experience with Spark dataframes, SparkSQL, Kafka, KSQL, real-time streaming, and message bus technologies
• Experience with data science technologies such as SAS, R, Matlab, or similar
• Experience with data warehousing and dimensional modeling
• Experience as a team lead

Responsibilities

• Implement a real time streaming data ingestion and processing pipeline using Google Dataflow (Apache Beam)
• Interface with business intelligence analyst and others in IT (i.e. data engineers, architects, WebOps) in frequent whiteboard sessions to discuss the design, implementation, and testing of data pipelines
• Maintain data architecture standards and ETL/ELT best practices consistent with a column oriented data store in an analytic use case
• Active and engaged participation in the Scrum delivery process
• Support solutions in production

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level