Data Engineer

Omnicom Media Group • New York City, NY

77d • $50,000 - $95,000

About The Position

Hearts & Science is currently seeking a data engineer to join our technology team. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will work on one or more software and data products in the Engineering Team. You will participate in technical architecture, design, and development of software products as well as research and evaluation of new technical solutions.

Requirements

• Experience designing and managing data flows.
• Experience designing systems and APIs to integrate data into applications.
• 4+ years of Linux, Bash, Python, and SQL experience.
• 2+ years using Spark and other frameworks to process large volumes of data.
• 2+ years using Parquet, ORC, or other columnar file formats.
• 2+ years using AWS/GCP/Azure cloud services, esp. services that are used for data processing e.g. Glue, Dataflow, Data Factory, EMR, Dataproc, HDInsights, Athena, Redshift, BigQuery etc.
• Passion for Technology: Excitement for new technology, bleeding edge applications, and a positive attitude towards solving real world challenges.

Nice To Haves

• BS, MS or PhD in Computer Science, Engineering, or equivalent real-world experience.
• Significant experience with Python, C++, or other popular language.
• Experience with big data and/or infrastructure.
• Understanding of data organization, i.e., partitioning, clustering, file sizes, file formats.
• Data cataloging with Hive/Hive metastore or Glue or something similar.
• Experience working with relational databases.
• Experience with Hadoop, Hive, Spark, or other data processing tools.
• Experience building scalable data pipelines (Airflow experience a plus).
• Significant experience working with AWS and/or GCP.
• Proven ability to independently execute projects from concept to implementation to launch and to maintain a live product.

Responsibilities

• Design, build, test and deploy scalable and reusable systems that handle large amounts of data.
• Collaborate with product owners and data scientists to build new data products.
• Ensure data quality and reliability.

Benefits

• health insurance
• vision insurance
• dental insurance
• 401(k)
• Healthcare Flexible Spending Account
• Dependent Care Flexible Spending Account
• vacation days
• sick days
• personal days
• paid parental leave
• paid medical leave
• STD/LTD insurance benefits

What This Job Offers

• Industry: Professional, Scientific, and Technical Services
• Education Level: Bachelor's degree