Data Engineer II

Amazon.com, Inc.•Culver City, CA

36d

About The Position

As a data engineer in the Monetization organization you will work on making Twitch's massive data sets robust and consumable by people around the company. You'll work with a team of other data engineers to build and maintain data pipelines that allow our stakeholders to understand our business.

Requirements

3+ years of data engineering experience
Deep expertise in writing and maintaining robust data pipelines in SQL and Python
Ability to turn data requirements from stakeholders into actionable plans
Extensive experience with cloud computing tools, like AWS, Azure, or Google cloud
Proven experience implementing best practices in data pipelines, ensuring accuracy, consistency, and reliability

Nice To Haves

Bachelor's degree, or Master's degree in computer science, statistics, information systems, or a related, technical field
Experience with a scripting language (e.g., Python, Java, or R)
Familiarity and interest in Twitch

Responsibilities

Work closely with data scientists and engineers to create robust data architectures and pipelines
Develop and manage scalable data pipelines to extract, transform, and load data from various sources
Collaborate with stakeholders to understand business requirements and translate them into data-driven solutions
Automate data processing and reporting workflows to improve efficiency and data integrity
Implement data quality checks and monitor processes to maintain high data accuracy
Simplify and enhance the accessibility, clarity, and usability of large and complex datasets through the development of data cubes and data sharing solutions
Develop and manage scalable, automated, and fault-tolerant data solutions using technologies such as Spark, EMR, Python, Redshift, Glue, and S3