Staff Data Engineer

The job overview for this position is provided in the "Overview" section of the job description. Crisis Text Line is seeking a Staff Data Engineer to partner with product managers and data consumers to meet internal analytics and client data needs. The engineer will oversee the entire lifecycle of data pipeline development and report to an Engineering Manager. The ideal candidate will have a BS in Computer Science or a related technical role, 3+ years of professional work experience on ETL pipeline implementation using AWS services, and experience using real-time streaming systems.

• Design, develop and deploy scalable data pipelines and a scalable and resilient cloud data platform
• Design and build multi-tenant systems capable of loading and transforming large volumes of structured and semi-structured fast moving data
• Partner with Data Scientists and product team to drive agile delivery of both existing and new offerings
• Work with Product and Project Managers to understand the features, do technical assessment, design, code, test and deliver
• Help with team goals including the support of live 24/7 production systems
• Integrate diverse ideas into business frameworks and strategies
• Have an intermediate-knowledge of cultural awareness as well as a baseline for cultural accountability

• Undergraduate degree or equivalent experience
• BS in Computer Science, Engineering or a related technical role or equivalent experience
• 3+ years of professional work experience on ETL pipeline implementation using AWS services such as Glue, Lambda, Athena, S3, SNS, Kinesis, Data-Pipelines, Pyspark, etc.
• 3+ years of professional work experience using real-time streaming systems (Kafka/Kafka Connect, Spark, Flink or AWS Kinesis) is required
• Knowledge or experience in architectural best practices in building data lakes is required
• Strong problem solving and troubleshooting skills with the ability to exercise mature judgment
• Ability to work independently, and provide guidance to junior data engineers
• Interest and ability to learn other coding languages as needed
• Ability to write in English fluently and idiomatically