Sr Data Engineer
About The Position
The Senior Data Software Engineer will create data ingestion pipelines including workloads and applications inside AWS. Implements, troubleshoots, and optimizes distributed solutions based on big data technologies like SQL, S3, Glue, MSK, Snowflake and Redshift to solve large scale processing problems in a Cloud DW environment. Designs syndicated and curated data views that will be used for reporting, analytics, and advanced applications. Apply technical expertise and mathematical concepts to challenging programming problems. Strong communication, interpersonal, and collaboration skills, including the ability to work effectively in an agile / scrum environment.
Requirements
- Minimum of 5 years of years of experience in data engineering with SQL in a Data Warehouse environment
- Strong knowledge of Python and object-oriented programming concepts.
- Experience building data pipelines and complex data transformations.
- 5+ years of experience with AWS S3, Glue, MSK, Redshift, Spark, and related tools
- Solid working experience with Snowflake native objects like SnowPipe, external/internal stages, external tables, integration objects, stored procedures (Snowflake Scripting), stream & task, data masking, time traveland cloning.
- Working knowledge of Data Build Tool (DBT)
- 5+ years of experience in software development in an agile environment.
- Production experience with DevOps Tools like: Terraform or CDK.
- Strong conceptual understanding of security at rest and in transit for big data pipelines.
- Troubleshooting skills, ability to determine impacts, ability to resolve complex issues, and ability to exercise sound judgment and initiative in complex situations.
- Strong systems and data analysis skills, and experience with testing in data space.
- Strong domain knowledge of ticketing and entitlement systems.
- Hands-on experience with architecture, design, data models, eventing infrastructure, and implementation details
Responsibilities
- Design and develop data pipelines in AWS & Snowflake
- Design and develop data views, assist with architecture decisions, deployment, and feedback.
- Provide data and system analysis needed for feature engineering.
- Product ownership and strong business support in enterprise level theme park related environment.
- Working with a variety of business partner groups across Disney Parks and Resorts to implement optimal technical solutions.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
1,001-5,000 employees
