Senior Data Engineer
About The Position
Flywheel's suite of digital commerce solutions accelerate growth across all major digital marketplaces for the world's leading brands. We give clients access to near real-time performance measurement and improve sales, share, and profit. With teams across the Americas, Europe and APAC, we offer a career with real impact, endless growth opportunities and the support you need to be the best you can be. Opportunity Omni Platform Group (OPG) is currently seeking a senior data engineer to join our technology team. In this role you will build Omni products which sit atop cloud-based data infrastructure. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will work on one or more software and data products in the Omni Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions. This position is based out of our Jersey City Office.
Requirements
- Experience designing and managing data flows.
- Experience designing systems and APIs to integrate data into applications.
- 8+ years of Linux, Bash, Python, and SQL experience.
- 4+ years using Spark and other Hadoop ecosystem software.
- 4+ years using AWS cloud services, esp. EMR, Glue, Athena, and Redshift.
- Passion for Technology: Excitement for new technology, bleeding edge applications, and a positive attitude towards solving real world challenges.
Nice To Haves
- BS, MS or PhD in Computer Science, Engineering, or equivalent real-world experience (You've learned something to be able to claim you are an engineer).
- Significant experience with Python, C++, or other popular language.
- Experience with big data and/or infrastructure. Bonus for having experience in setting up Petabytes of data so they can be easily accessed. Understanding of data organization, i.e., partitioning, clustering, file sizes, file formats. Data cataloging with Hive/Hive metastore or Glue or something similar.
- Experience working with relational databases.
- Experience with Hadoop, Hive, Spark, or other data processing tools.
- Experience in any of the modern data stack technologies like dbt, airbyte is desired.
- Experience building scalable data pipelines (Airflow experience a plus).
- Significant experience working with AWS and/or GCP.
- Proven ability to independently execute projects from concept to implementation to launch and to maintain a live product.
Responsibilities
- Steward data and compute environments to facilitate usage of data assets.
- Design, build, test and deploy scalable and reusable systems that handle large amounts of data.
- Lead and mentor a small team of developers.
- Perform code reviews and provide leadership and guidance to junior developers.
- Learn and teach new technologies to the team.
Benefits
- Competitive paid time off, including annual leave plus paid public holidays
- Great learning and development opportunities
- Benefits that help you live your best life
- Parental leave and benefits
- Volunteering opportunities
- If you’re looking to connect with teammates on a topic of inclusion and identity, chances are there’s an ERG for that.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
501-1,000 employees
