Sr. Staff Data Engineer
About The Position
Serve as the subject matter expert and/or technical lead for large scale data products. Drive End-to-End solution delivery involving multiple platforms and technologies with medium-to-large complexity or oversee certain parts of very large complex implementations, leveraging ELT solutions to acquire, integrate, and operationalize data. Partner with architects and stakeholders to influence and implement the vision of the pipeline and data product architecture while safeguarding the integrity and scalability of the environment. Articulate risks and tradeoffs of technology solutions to senior leaders with translations as needed for business leaders. Maintain accountability for data pipeline and product physical solution designs across teams as well as tool recommendations. Evaluate and assess open source tools and frameworks. Maintain accountability for Data Engineering Practices across all involved teams. Research, experiment, and utilize leading big data methodologies (AWS, Hadoop/EMR, Spark, Kafka, Snowflake and Talend) with cloud/on premise hybrid hosting solutions, on a multi-team/product level. Regularly conduct market research to maintain understanding and awareness of emerging data and analytics technologies, tools, techniques, and frameworks. Evaluate, recommend, and influence all technology-based decisions for tools and frameworks for effective delivery.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field of study
- 5 years of experience in a software development or data engineering-related occupation
- 5 years of experience in Programming
- 5 years of experience in SDLC practices
- 5 years of experience in Distributed systems
- 5 years of experience in Data warehousing solutions, including SQL and NoSQL
- 5 years of experience in ETL tools
- 3 years of experience in CICD
- 3 years of experience in Bigdata
- 3 years of experience in Cloud Technologies, including AWS and Azure
- 3 years of experience in Python or Spark
- 3 years of experience in Datamesh
- 3 years of experience in Datalake
- 3 years of experience in Snowflake
- 3 years of experience in AWS
- 3 years of experience in Developing and operating production workloads in cloud infrastructure
- 3 years of experience in Software development lifecycle (SDLC), including Agile/iterative methodologies and toolsets
Responsibilities
- Serve as the subject matter expert and/or technical lead for large scale data products.
- Drive End-to-End solution delivery involving multiple platforms and technologies with medium-to-large complexity or oversee certain parts of very large complex implementations, leveraging ELT solutions to acquire, integrate, and operationalize data.
- Partner with architects and stakeholders to influence and implement the vision of the pipeline and data product architecture while safeguarding the integrity and scalability of the environment.
- Articulate risks and tradeoffs of technology solutions to senior leaders with translations as needed for business leaders.
- Maintain accountability for data pipeline and product physical solution designs across teams as well as tool recommendations.
- Evaluate and assess open source tools and frameworks.
- Maintain accountability for Data Engineering Practices across all involved teams.
- Research, experiment, and utilize leading big data methodologies (AWS, Hadoop/EMR, Spark, Kafka, Snowflake and Talend) with cloud/on premise hybrid hosting solutions, on a multi-team/product level.
- Regularly conduct market research to maintain understanding and awareness of emerging data and analytics technologies, tools, techniques, and frameworks.
- Evaluate, recommend, and influence all technology-based decisions for tools and frameworks for effective delivery.
Benefits
- short-term or annual bonuses
- long-term incentives
- on-the-spot recognition
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
