Lead Data Engineer
About The Position
NBCUniversal Media, LLC seeks Lead Data Engineer in Universal City, CA Build out data engineering pipelines and optimizations of a cloud-based Data Lake, Data Warehouse, and File System. Help coordinate with Advanced Analytics team, work with other onsite/offshore Data Engineers and own deliverables. Identify pipeline bottlenecks as well as opportunities for optimizations and create implementation plans. Work in an onsite and offshore team model to build out ETLs to support Business Intelligence initiatives, including real-time processing, distributed computing, and containerized solutions. Help in Data QA and ensure required auditing and alerts are implemented for every data engineering pipeline. Create, define, and document processes and help in data governance and estimation initiatives within the organization. Hybrid work schedule (minimum 3 days in office).
Requirements
- Bachelor’s degree in Data Science, Data Engineering, Mathematics, Statistics, Information Systems, or a related quantitative field (or foreign degree equivalent), plus 10 years of experience in the job offered, as a Data Engineer, or in a related occupation.
- Applied experience in Data Engineering, including but not limited to building Data Pipelines, Orchestration, Data Modeling, and Lakehouse.
- Processing large direct to consumer datasets and building code using SQL, Python, pySpark, and Airflow.
- Working on AWS cloud services like S3, EC2, EMR, Kinesis Firehose and Secrets.
- Working on cloud distributed data platforms like Snowflake, Datawarehouse, and Databricks.
- Experience implementing data pipelines using distributed processing frameworks such as Spark or Hadoop using Databricks or similar tools.
- Experience in various data modeling techniques and implementing custom models in accordance with business reporting needs.
- Experience building data pipelines with data sourced from APIs, real-time feeds, structured and semi-structured file formats.
- Implementing CI/CD pipelines for Data Engineering with GIT and/or similar repo tools.
- Experience building and optimizing pipelines on Data bricks or similar platforms.
- Experience with linear and/or digital viewership measurement
Responsibilities
- Build out data engineering pipelines and optimizations of a cloud-based Data Lake, Data Warehouse, and File System.
- Help coordinate with Advanced Analytics team, work with other onsite/offshore Data Engineers and own deliverables.
- Identify pipeline bottlenecks as well as opportunities for optimizations and create implementation plans.
- Work in an onsite and offshore team model to build out ETLs to support Business Intelligence initiatives, including real-time processing, distributed computing, and containerized solutions.
- Help in Data QA and ensure required auditing and alerts are implemented for every data engineering pipeline.
- Create, define, and document processes and help in data governance and estimation initiatives within the organization.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
5,001-10,000 employees
