Lead Data Engineer
About The Position
Cox Automotive Corporate Services, LLC is seeking a Lead Data Engineer in Atlanta, Georgia. This role involves designing simple and scalable solutions to complex problems, delivering leading-edge software products, and serving as a technical leader within collaborative data scrum teams. The engineer will focus on building patterns for data pipelines, data warehousing, and data transformations, applying modern software design principles, best practices, and frameworks with an emphasis on performance and maintainability. Responsibilities include performing data analytics, database design and development, influencing technical solutions, coaching junior team members, constructing and managing services for data extraction, transformation, and loading into data warehouses, collaborating on best practices and process improvements, developing high-performing, scalable, and secure solutions, diagnosing and implementing solutions to technology problems, investigating and evaluating new technologies, mentoring other engineers, designing and maintaining data pipelines and databases, translating business requirements into data integration and ingestion code, recommending and coding efficient data integration solutions, and working closely with product managers and engineers to design, implement, test, and improve scalable data solutions on DBT & Snowflake cloud platforms. The role also includes implementing and resolving issues with system data integration and ingestion, ensuring root cause resolution, and monitoring and supporting Data Solutions jobs and processes to meet daily SLAs. The Lead Data Engineer will lead the team on Data Integration solutions.
Requirements
- Bachelor’s or foreign equivalent degree in Computer Science, Electronic Engineering, or related field and 6 years of experience working in data engineering
- 6 years of experience in building and deploying large-scale data processing pipelines
- 6 years of experience in identifying performance bottlenecks and optimizing ETL processes
- 6 years of experience in designing and implementing scalable data pipelines
- 6 years of experience in performing programming and scripting in SQL, PL/SQL, and Python
- 6 years of experience in automating using Python
- 6 years of experience in performing ETL and data warehousing using Informatica PowerCenter for ETL processes, as well as Exadata and on-premise data warehouse solutions
- 1 year of experience warehousing cloud data in Snowflake
- 1 year of experience performing data transformation and modeling in dbt (Data Build Tool) and schema design, including star schema
- 1 year of experience developing data pipelines, including ETL/ELT pipeline development, using dBT Labs and ELT tool
Nice To Haves
- Master’s or foreign equivalent degree in Computer Science, Electronic Engineering, or related field and 4 years of experience
- Ph.D. or foreign equivalent degree in Computer Science, Electronic Engineering, or related field and 1 year of experience
Responsibilities
- Design simple and scalable solutions to complex problems
- Deliver leading edge software products for customers
- Serve as a technical leader in a collaborative team environment
- Contribute to the engineering efforts of data scrum teams
- Engineer right-sized solutions for complex business problems focused on building patterns to support data pipelines, data warehousing, and data transformations
- Apply knowledge of modern software design, best practices, design patterns, and frameworks, with an understanding of application performance and maintainability
- Use new technologies and develop innovative solutions
- Perform data analytics, database design and development
- Influence technical solutions while coaching newer or junior members on Scrum team
- Construct and manage services which extract data from disparate databases, transform the data and load into data warehouse
- Collaborate with team members on best practices, code reviews, internal tools and process improvements
- Develop high performing, scalable and secure solutions
- Diagnose, design, and implement solutions to key technology or application problems
- Investigate, evaluate, and present new emerging technologies for use with data solutions and integrations
- Mentor and assist other engineers in area of ownership and expertise
- Design and maintain data pipelines and databases
- Translate business requirements, data mappings into data integrations and ingestions code solutions
- Recommend and code efficient and effective data integration and ingestion solutions for challenging problems
- Work closely with product managers and engineers to design, implement, test, and continually improve scalable data solutions and services running on DBT & Snowflake cloud platforms
- Implement system data integration and ingestion fixes for the data platform and environment
- Ensure root cause resolution to identified problems
- Monitor and support the Data Solutions jobs and processes to meet the daily SLA
- Lead team on Data Integration solutions
Benefits
- Flexibility to take as much vacation with pay as they deem consistent with their duties, the company’s needs, and its obligations
- Seven paid holidays throughout the calendar year
- Up to 160 hours of paid wellness annually for their own wellness or that of family members
- Additional paid time off in the form of bereavement leave
- Time off to vote
- Jury duty leave
- Volunteer time off
- Military leave
- Parental leave
- Health care insurance (medical, dental, vision)
- Retirement planning (401(k))
- Paid days off (sick leave, parental leave, flexible vacation/wellness days, and/or PTO)
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
