Engineer II, Data Engineering

Magnite•Los Angeles, CA

1d•$115,000 - $135,000•Hybrid

About The Position

Magnite is seeking thorough and agile software developers for its DV+ Data Engineering team. This role involves working on real-world problems within a big data stack where accuracy and speed are paramount. The engineer will take end-to-end responsibility for their systems and influence the direction of technology impacting global customers. The DV+ Data Engineering team owns the data systems processing hundreds of billions of events daily for the DV+ platform. They are looking for a Data or Software Engineer with conceptual and hands-on experience in big data development, including upstream data ingestion, proprietary and open-source DBMS, and large-scale data warehousing. The ideal candidate is excited about all aspects of big data development, including data transport, processing, warehouse/ETL integration, and is a quick learner and self-starter. This demanding role requires hands-on big data processing development experience on Linux, with responsibility for day-to-day operations and new developments. Skills in software development lifecycle, building data services with Java, Scala, and scripting languages like Python are essential. The team is responsible for technological and operational excellence within its domain.

Requirements

Proficiency and hands-on experience with data engineering related technologies: Hadoop /Spark / Kafka / Druid etc.
Proficiency in Java and script languages (UNIX Shell, Perl, Python etc.).
Familiarity with process, infra, and application management technologies – JIRA, Jenkins, Github, etc.
Ability to follow standard development and engineering practices and understand basic to complex concepts related to computer architecture, data structures, and programming practices.
Experience developing and executing testing/debugging, data quality, and performance tuning applications.
Ability to communicate effectively to end users and work within a team environment.
Bachelor’s degree in CS/EE or related science.

Nice To Haves

Experience working with the ad-tech industry.
Experience working on Massively Parallel Processing architecture.
Experience on MapR Hadoop.
Experience with SQL in association with data transformation, custom reporting & analysis, and data investigation desired.

Responsibilities

Design, develop, and support various big data platforms applications including Hadoop, Kafka, ETL, and data warehouse applications integration.
Develop applications with Java and Spark programming languages and Big Data technology, including scripting languages (Python, shell etc.) to support application execution.
Be involved in the design and implementation of the full cycle of data services, from data transportation, data processing, ETL to data delivery for reporting.
Perform strong data analysis and troubleshooting to support day-to-day production operations.
Proactively identify, troubleshoot, and resolve production data and performance issues.