Data Engineer II

Rocket Companies•Seattle, WA

About The Position

As a Data Engineer II, you will share ownership of Redfin’s Data Platform, owning business critical data integrations and operational excellence. You will work closely with Engineering and Analytics teams to create and support data pipelines and transformations. The ideal candidate is a data pipeline builder who enjoys optimizing existing systems as well as building new systems from the ground up. We are also looking for someone who is self-directed and comfortable supporting the data needs of multiple systems and teams. Design, develop, and support complex data pipelines from a wide variety of data sources for Redfin Work with other Engineering teams to design and implement data exchange systems from structured and unstructured data sources Work with end users to gather requirements and design solutions that provide the the data they need in the format they need it in Ensure 100% accuracy in everything you do - make sure that all code and processes are fully tested and verified before running in production Identify and implement internal process improvements by automating manual processes and optimizing for accuracy, performance and coding best practices Support and maintain dev / test / prod environments Serve as part of weekly on call rotation

Requirements

3+ years experience with a modern programming language (Python, Java, etc). Python is preferred
3+ years experience with complex SQL, data modeling and database technologies (Postgres, MySQL, Snowflake, etc). Snowflake is preferred
Experience creating and maintaining complex data pipelines
Experience with batch and streaming data pipelines
Experience with both structured and unstructured data sets
Ability to translate business needs into technical requirements
Ability to structure data to make it accessible, performant, and resilient to change
Ability to handle ambiguity and function in a fast paced, constantly changing environment
Ability to communicate well with both technical and non technical users

Nice To Haves

Experience with Git / Jenkins / Airflow / Docker / Kubernetes / Spark is a plus
Experience with API development is a plus
Experience with cloud services (AWS / Azure / GCP) is a plus. AWS is preferred
Experience with message queuing and stream processing data is a plus

Responsibilities

Design, develop, and support complex data pipelines from a wide variety of data sources for Redfin
Work with other Engineering teams to design and implement data exchange systems from structured and unstructured data sources
Work with end users to gather requirements and design solutions that provide the the data they need in the format they need it in
Ensure 100% accuracy in everything you do - make sure that all code and processes are fully tested and verified before running in production
Identify and implement internal process improvements by automating manual processes and optimizing for accuracy, performance and coding best practices
Support and maintain dev / test / prod environments
Serve as part of weekly on call rotation