Lead Data Engineer

Cox Enterprises • Atlanta, GA

1d • $160,056 - $183,326 • Hybrid

About The Position

Cox Automotive Corporate Services, LLC is seeking a Lead Data Engineer to design simple and scalable solutions to complex problems and deliver leading-edge software products. The role involves serving as a technical leader in a collaborative team environment, contributing to the engineering efforts of data scrum teams. The Lead Data Engineer will engineer right-sized solutions for complex business problems, focusing on building patterns for data pipelines, data warehousing, and data transformations. This position requires applying knowledge of modern software design, best practices, design patterns, and frameworks, with an understanding of application performance and maintainability, and utilizing new technologies to develop innovative solutions. Responsibilities include performing data analytics, database design and development, influencing technical solutions, and coaching junior team members. The role involves constructing and managing services for data extraction, transformation, and loading into data warehouses, collaborating on best practices, code reviews, and process improvements, and developing high-performing, scalable, and secure solutions. The Lead Data Engineer will diagnose, design, and implement solutions to key technology or application problems, investigate and evaluate emerging technologies for data solutions and integrations, and mentor other engineers. The position also includes designing and maintaining data pipelines and databases, translating business requirements and data mappings into data integration and ingestion code solutions, and recommending and coding efficient data integration and ingestion solutions. Collaboration with product managers and engineers is key for designing, implementing, testing, and improving scalable data solutions and services on DBT & Snowflake cloud platforms. The role also involves implementing system data integration and ingestion fixes, ensuring root cause resolution, and monitoring and supporting Data Solutions jobs and processes to meet daily SLAs. The Lead Data Engineer will lead the team on Data Integration solutions.

Requirements

• Requires a bachelor’s or foreign equivalent degree in Computer Science, Electronic Engineering, or related field and 6 years of experience working in data engineering.
• Must have 6 years of experience in each of the following: Building and deploying large-scale data processing pipelines; Identifying performance bottlenecks and optimizing ETL processes; Designing and implementing scalable data pipelines; Performing programming and scripting in SQL, PL/SQL, and Python; Automating using Python; and Performing ETL and data warehousing using Informatica PowerCenter for ETL processes, as well as Exadata and on-premise data warehouse solutions.
• In lieu of a bachelor’s degree and 6 years of experience as stated, the employer will accept a master’s or foreign equivalent degree in the aforementioned fields and 4 years of experience as stated, or a Ph.D. or foreign equivalent degree in the aforementioned fields and 1 year of experience as stated.
• Must also have 1 year of experience: Warehousing cloud data in Snowflake; Performing data transformation and modeling in dbt (Data Build Tool) and schema design, including star schema; and, Developing data pipelines, including ETL/ELT pipeline development, using dBT Labs and ELT tool.

Responsibilities

• Design simple and scalable solutions to complex problems and deliver leading edge software products for our customers.
• Serve as a technical leader in a collaborative team environment and contribute to the engineering efforts of data scrum teams.
• Engineer right-sized solutions for complex business problems focused on building patterns to support data pipelines, data warehousing, and data transformations.
• Apply knowledge of modern software design, best practices, design patterns, and frameworks, with an understanding of application performance and maintainability.
• Use new technologies and develop innovative solutions.
• Perform data analytics, database design and development.
• Influence technical solutions while coaching newer or junior members on Scrum team.
• Construct and manage services which extract data from disparate databases, transform the data and load into data warehouse.
• Collaborate with team members on best practices, code reviews, internal tools and process improvements.
• Develop high performing, scalable and secure solutions.
• Diagnose, design, and implement solutions to key technology or application problems.
• Investigate, evaluate, and present new emerging technologies for use with data solutions and integrations.
• Mentor and assist other engineers in area of ownership and expertise.
• Design and maintain data pipelines and databases.
• Translate business requirements, data mappings into data integrations and ingestions code solutions.
• Recommend and code efficient and effective data integration and ingestion solutions for challenging problems.
• Work closely with product managers and engineers to design, implement, test, and continually improve scalable data solutions and services running on DBT & Snowflake cloud platforms.
• Implement system data integration and ingestion fixes for the data platform and environment.
• Ensure root cause resolution to identified problems.
• Monitor and support the Data Solutions jobs and processes to meet the daily SLA.
• Lead team on Data Integration solutions.

Benefits

• health care insurance (medical, dental, vision)
• retirement planning (401(k))
• paid days off (sick leave, parental leave, flexible vacation/wellness days, and/or PTO)
• additional paid time off in the form of bereavement leave, time off to vote, jury duty leave, volunteer time off, military leave, and parental leave.

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Education Level: Ph.D. or professional degree