Engineering Manager, Data Platform

TRM Labs

11d•Remote

About The Position

The Data Platform team collaborates with an experienced group of data scientists, engineers, and product managers to build highly available and scalable data infrastructure for TRM's products and services. As an Engineering Manager, you will guide your team toward executing mission-critical systems and data services that analyze blockchain transaction activity at petabyte scale. Your contributions will play a pivotal role in building a safer financial system for billions of people.

Requirements

A Bachelor's degree (or equivalent) in Computer Science or a related field.
A proven track record with over 5 years of experience in conceiving and implementing distributed system architecture, spanning from ideation to production.
Proficiency in Python programming and adeptness in SQL or SparkSQL.
Versatility across the entire spectrum of data engineering, encompassing areas such as:
Expertise in data stores such as ClickHouse, ElasticSearch, Postgres, Redis, and Neo4j.
Proficiency with data pipeline and workflow orchestration tools like Airflow, DBT, Luigi, Azkaban, and Storm.
Advanced proficiency in data processing technologies and streaming workflows, including Spark, Kafka, and Flink.
Competence in deploying and meticulously monitoring infrastructure within public cloud platforms, using tools such as Docker, Terraform, Kubernetes, and Datadog.
A demonstrated ability to handle the complexities of loading, querying, and transforming extensive and intricate datasets.

Responsibilities

Lead and nurture a team of high-impact engineers, offering guidance in both technical and cultural aspects.
Provide regular coaching and technical mentorship to your immediate team as well as contribute to the broader engineering department's growth.
Assume direct responsibility for ensuring the quality and timely delivery of the team's work, while overseeing the availability and performance of critical services.
Drive projects aligned with well-defined goals and measurable outcomes, accountable to key performance indicators (KPIs).
Foster best practices in design and usability, creating scalable solutions while emphasizing documentation and knowledge sharing.
Resolve operational escalations and collaborate with various teams to address production incidents until resolution.
Collaborate closely with management and product teams to plan, estimate, and prioritize roadmap objectives, identifying opportunities and mitigating risks.
Contribute to the creation of highly reliable data services that seamlessly integrate with numerous blockchains.
Engineer and optimize ETL pipelines that handle real-time transformation and processing of petabytes of structured and unstructured data.
Architect data models to ensure efficient storage and retrieval, maintaining sub-second latency for querying blockchain data.
Oversee the deployment and vigilant monitoring of large-scale database clusters, focusing on performance and high availability.
Collaborate cross-functionally with data scientists, backend engineers, and product managers to design, implement, and refine new data models in support of TRM’s products.