Sr. Data Engineer - Databricks

Shaw Industries • Dalton, GA

5d

About The Position

We are looking for a data engineer to join our enterprise analytics team! This individual will partner with data scientists, analysts and product owners to support data science projects and initiatives across the enterprise – including in our manufacturing, planning/forecasting and customer service areas. Applicant must be an experienced data pipeline builder who enjoys building solutions from the ground up. We are looking for someone who is self-directed and comfortable supporting the data needs of multiple teams and projects.

Requirements

• Bachelor’s degree in a quantitative field (e.g., Computer Science, Engineering) or a related quantitative field or equivalent work experience is required.
• At least 4-6 years of work experience in data management disciplines including data integration, modeling, optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks.
• Expert SQL programming skills
• Expertise in at least one relevant object-oriented programming language (e.g., Python, Scala)
• Experience building and optimizing data pipelines, architectures and data sets
• Experience with big data tools (Spark, Kafka, etc.)
• Experience in data warehousing and data modeling
• Good knowledge of data management, data integration, and database development techniques with a good understanding of data architecture principles
• Strong analytical and problem solving skills
• Ability to communicate across all levels of the organization and work with diverse project teams
• Experience using cloud-based infrastructure such as Azure and AWS
• Experience in DevOps best practices including CI/CD, process automation and optimization

Nice To Haves

• Experience with designing and implementing real-time pipelines
• Experience with data quality and validation
• Experience working in an Agile environment

Responsibilities

• Partner with data scientists, data analysts, data stewards and product owners to understand data needs and develop solutions
• Design, build, launch and maintain efficient and reliable data pipelines to support data analysis and machine learning models
• Define and manage standards, guidelines and processes to ensure data quality
• Assemble large, complex datasets based on business requirements
• Identify and deploy various methods and techniques for optimal extraction, transformation and loading of data from a wide variety of data sources
• Help build and maintain best practices for our data engineering strategy – identifying and addressing gaps in existing processes and solutions

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level