Lead Software Engineer (Data)-7999
About The Position
FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world. This role provides technical leadership to a team responsible for developing data processing software using Apache Flink. The engineer will design extract transform-load (ETL) data pipelines based on the company’s proprietary ETL development library, using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow. They will store structured data using Hbase and develop business-level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting. The role involves developing streaming data pipelines using Apache Kafka, storing data, running services, monitoring logs, and managing permissions using AWS services including S3, EC2, CloudWatch, and IAM. Automation of tasks in a Unix environment using Linux Command Line Interface (“CLI”) and Bash scripting is also a key responsibility. The engineer will support applications under development, customize current applications, and assist with software update processes and roll-outs. Analysis, testing, and integration of new applications, documentation of all development activity, and research into competitive applications and products are also part of the role. Collaboration with project stakeholders to identify product and technical requirements, analysis to determine integration needs, and working with the Quality Assurance team are expected. Finally, the role includes guiding and mentoring junior-level engineers. This position is eligible to work remotely one or more days per week, per company policy.
Requirements
- Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related technical field
- Seven (7) years of experience developing data processing software using Apache Flink
- Five (5) years of experience designing extract transform-load (ETL) data pipelines using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow
- Five (5) years of experience storing structured data using Hbase
- Five (5) years of experience developing business-level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting
- Three (3) years of experience developing streaming data pipelines using Apache Kafka
- Three (3) years of experience storing data, running services, monitoring logs, and managing permissions using AWS services including S3, EC2, CloudWatch, and IAM
- Three (3) years of experience automating tasks in a Unix environment using Linux Command Line Interface (“CLI”) and Bash scripting
Responsibilities
- Provide technical leadership to a team responsible for developing data processing software using Apache Flink
- Design extract transform-load (ETL) data pipelines based on company’s proprietary ETL development library, using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow
- Store structured data using Hbase
- Develop business-level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting
- Develop streaming data pipelines using Apache Kafka
- Store data, run services, monitor logs, and manage permissions using AWS services including S3, EC2, CloudWatch, and IAM
- Automate tasks in a Unix environment using Linux Command Line Interface (“CLI”) and Bash scripting
- Support applications under development and customize current applications
- Assist with the software update process for existing applications, and roll-outs of software releases
- Analyze, test, and assist with the integration of new applications
- Document all development activity
- Research, write, and edit documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals, and formal recommendations and reports
- Monitor and evaluate competitive applications and products
- Review literature, patents, and current practices relevant to the solution of assigned projects
- Collaborate with project stakeholders to identify product and technical requirements
- Conduct analysis to determine integration needs
- Work with the Quality Assurance team to determine if applications fit specification and technical requirements
- Guide and mentor junior-level engineers
Benefits
- Comprehensive ad platforms for publishers, advertisers, and media buyers
- Premium video content, robust data, and advanced technology
- Global company with offices in nine countries
- Benefits that connect you to the support you need when it matters most
- An array of options, expert guidance and always-on tools that are personalized to meet the needs of your reality—to help support you physically, financially and emotionally through the big milestones and in your everyday life.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
