Senior or Staff Software Engineer, Data Platform (Brazil)

TRM Labs

11d • Remote

About The Position

TRM Labs is seeking a Senior or Staff Software Engineer for their Data Platform team. This role involves building highly available and scalable data infrastructure for TRM's products and services. The engineer will be responsible for executing mission-critical systems and data services that analyze blockchain transaction activity at petabyte scale, contributing to a safer financial system. The team collaborates with data scientists, engineers, and product managers to achieve these goals.

Requirements

• Bachelor's degree (or equivalent) in Computer Science or a related field.
• 5+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation through to successful production deployment.
• Exceptional programming skills in Python.
• Adeptness in SQL or SparkSQL.
• In-depth experience with data stores and engines such as Iceberg, Trino, BigQuery, and StarRocks, and Citus.
• Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, etc.
• Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.
• Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools such as Docker, Terraform, Kubernetes, and Datadog.
• Proven ability in loading, querying, and transforming extensive datasets.
• AI fluency: among the top 10 percent of operators in your function in how you apply AI to accelerate repeatable workflows, structure and solve problems, improve output quality, and increase speed and leverage.

Nice To Haves

• Experience with Pgbouncer, scaling disks, scaling/updating of clusters.
• Experience with observability dashboard creation.

Responsibilities

• Build highly reliable data services to integrate with dozens of blockchains.
• Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.
• Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data.
• Oversee the deployment and monitoring of large database clusters with an unwavering focus on performance and high availability.
• Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRM’s products.
• Build a scalable engine to optimize routine scaling and maintenance tasks like create self-serve automation for creating new pgbouncer, scaling disks, scaling/updating of clusters, etc.
• Identify ways to compress timelines using 80/20 principle.
• Identify first version, a.k.a., " skateboards " for projects.

Benefits

• AI-powered intelligence solutions
• AI skills assessment
• Leadership Principles interview
• Case study
• High velocity, high ownership team
• Continuous feedback
• Meaningful problems
• Ambitious goals
• Mission-driven colleagues
• Series C company with $220M in total funding
• Backed by Goldman Sachs, Bessemer, Y Combinator, Thoma Bravo, and others
• Distributed-first company with hubs in Los Angeles, San Francisco, New York, Washington D.C., London, and Singapore.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior