Senior Data Engineer

Spearmint Energy • Miami, FL

4d • Hybrid

About The Position

Spearmint Energy is seeking an experienced Data Engineer to join their growing team. The role involves owning the data platform and the pipelines that support market research and operations. The current technology stack includes Snowflake, AWS, Airflow, and Python. The successful candidate will be responsible for the architecture and standards of this platform as it scales. This position is part of the Research team and reports to the Engineering Manager.

Requirements

• BS degree in a technical field
• 5+ years building production data pipelines
• Strong experience with Python and SQL, beyond scripts and notebooks
• Strong Snowflake experience or equivalent (clustering, incremental loading, query profiling, cost control)
• Strong experience with Airflow or a comparable orchestrator in production
• Working knowledge of AWS for routine DevOps on own services
• Demonstrated ownership of data modeling and transformation standards
• A track record of raising standards within an existing codebase
• Must have work authorization to work in the United States

Nice To Haves

• Familiarity with power system concepts (load, generation, transmission, MW vs. MWh), energy markets, and energy storage
• Experience with dbt or a comparable transformation framework
• Experience with high-frequency time-series data
• Comfortable owning infrastructure as code (CloudFormation, CDK)
• Deep AWS expertise beyond routine DevOps, especially networking and hybrid connectivity

Responsibilities

• Design, build, and operate the data platform on AWS and Snowflake.
• Ingest data from market, telemetry, and vendor sources using Airflow and Python.
• Implement layered transformations to create trusted, business-ready tables.
• Develop idempotent and replayable pipelines with tests and alerting.
• Manage warehouse performance and cost.
• Establish engineering standards for data work, including architecture and transformation frameworks (e.g., dbt).
• Define conventions for timestamps, naming, typing, and handling late-arriving data.
• Implement backfills, manage schema evolution, track lineage, and ensure data quality.
• Contribute to documentation, code review, CI/CD processes, and mentoring.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior