Software Engineer, Data Engineering

VerseSan Francisco, CA
Remote

About The Position

Verse helps organizations manage complex power portfolios by unifying energy data, planning, forecasting, and operations in one tool. Their Energy Cost Intelligence platform, Aria, provides real-time, finance-ready intelligence to energy, finance, and operations teams, replacing traditional methods with precision across the energy lifecycle. The platform is built by an expert team of energy buyers, data scientists, and engineers, enabling faster, smarter energy decisions to reduce risk and lower energy costs. As a member of the technical staff, you will be responsible for designing, building, and maintaining the next generation of data platform tools, pipelines, and orchestration frameworks. This role supports Core Engineering needs and builds upon existing data-focused engineering foundations. As a technical leader with advanced data engineering expertise, you will vet proposals, solutions to internal and customer-facing problems, system designs, and drive their implementation with the highest standards of software-engineering best practices. You will be an integral part of scaling the data platform as the company grows.

Requirements

  • Advanced software development skills in Python, Rust, Java, Scala, or similar data-oriented language ecosystems
  • Deep understanding of databases, data lake,warehouse architectures, and data pipeline solutions across heterogeneous data and workloads in cloud-native environments
  • Proficiency in carefully handling large, complex data and processing them (streaming and batch) in both transactional and analytical settings
  • Commitment to delivering high quality software on time or ahead of schedule while adhering to best software development practices
  • Continuous obsession for staying informed on contemporary technologies, tools, libraries, services, frameworks, or breakthroughs that could benefit the team
  • Discipline using generative AI tools in day-to-day work

Nice To Haves

  • Bachelor’s or master's degree in Computer Science, Data Science, or a related field
  • Senior level software development talent and up
  • Proven track record being a technical leader in high-performing data engineering teams
  • Intimate knowledge of scaling “big data” solutions in cloud-based environments
  • Hands on experience deploying and maintaining software such as Hadoop, Spark, Airflow, DBT, Dagster, Temporal, Presto/Trino, Iceberg, AlloyDB, Postgres, HBase, BigQuery, BigTable, Fabric, Hive, RedShift, S3, GCS, etc.
  • Experience building event-driven architectures with streaming tools such as Kafka, NATS, GCP Pub/Sub, Kinesis, Bufstream, Flink, Beam
  • Knowledge of managed or hosted data solutions such as Databricks, Snowflake, ClickHouse, Tinybird, etc
  • Practical knowledge working with data in formats like Parquet, Avro, Protobuf, time series, text, image, video
  • Working closely to support AI/ML-focused teams (knowledge of MLflow and Ray is a big a plus)
  • Comfort building internal dashboards and data-focused visualizations

Responsibilities

  • Ensure data quality, contracts and integrity with best practices around access, governance, and federation throughout the data lifecycle
  • Implement, maintain, and promote best practices and hygiene in our dataland code repository for others to follow and emulate
  • Write shared libraries and reusable data tools across a variety of data flows, sources, and sinks
  • Partnering closely with our Data Science and data-heavy internal teams to support various analytical and AI/ML workflows
  • Foster a culture and mindset of well-designed systems, test-driven software, and proactive communication with a high degree of transparency, mutual respect, and consideration for teammates
  • Participate in code reviews, maintain technical documentation, and adhere to best software development practices

Benefits

  • Competitive compensation and equity grant at a high-growth start up
  • Comprehensive benefits package including medical, dental and vision insurance, and 401k
  • Flexible hours and unlimited PTO
  • Diverse and inclusive working environment
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service