Director of Data Engineering
About The Position
This role requires a hybrid schedule and will be based in our South Charlotte, NC Headquarters (Tuesday through Thursday) and work fully remotely on Mondays and Fridays each week. The Red Ventures Home and Utility group is looking for a talented Leader and technical mentor. We are hiring a Director of Data Engineering; a senior leadership role responsible for building, scaling, and leading high-performing data engineering teams that deliver reliable, scalable, and business-critical data platforms. This role requires a strong balance of people leadership, technical depth, and business partnership.
Requirements
- 5+ years of experience Spark, working in SparkSQL and/or DataFrames/Datasets API (with emphasis on DataFrames) to query and perform data manipulation
- 5+ years experience functioning as a lead or senior resource on a team.
- Experience building large scale Spark applications, ideally with either Batch processing and/or Streaming processing
- 3+ Python would be ideal but a solid knowledge of Scala is also acceptable
- 4+ Experience with cloud computing platforms, we use AWS (Kinesis, S3, Lambda)
- Has experience with ANSI SQL relational database (Oracle, SQL, Postgres, MySQL)
- Linux common working knowledge, including navigating through the file system and simple bash scripting
- General knowledge of distributed systems and distributed data processing frameworks
- Knowledge about agile software processes
Responsibilities
- Translate business strategy into technical execution, ensuring data platforms enable both real-time and batch analytics at scale.
- Lead, mentor, and grow teams of data engineers and engineering managers with diverse experience levels.
- Acting as a lead/SME to the team building large scale, real time data pipelines with spark on Databricks.
- Working with cross functional teams and analysts to understand business requirements leverage our data.
- Translate complex business requirements into scalable, high-impact data solutions
- Build and align teams through resource planning, team member allocation, and staffing projections
- Define and communicate a forward-looking technical roadmap for Data Engineering spanning multiple quarters to one year
Benefits
- Health Insurance Coverage (medical, dental, and vision)
- Life Insurance
- Short and Long-Term Disability Insurance
- Flexible Spending Accounts
- Holiday Pay
- 401(k) with match
- Employee Assistance Program
- Paid Parental Bonding Benefit Program
- Flexible Paid Time Off (PTO): We believe time to rest and recharge is essential. That’s why we offer a generous and flexible PTO policy. Full-time employees accrue 20 days of PTO for a full calendar year annually, with an increase to 25 days after five years of service.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Director
Education Level
No Education Listed
Number of Employees
1,001-5,000 employees
