Data Engineer

Habitat Energy•Austin, TX

2d•Hybrid

About The Position

Habitat Energy is a fast growing technology company focused on the physical and financial optimisation of energy storage and renewable generation assets globally through complex models and trading. By maximising the returns from these assets we aim to drive investment in renewable energy and accelerate the transition to a low carbon world. Our rapidly growing team of 130+ people in Austin, TX, Oxford, UK, and Melbourne, Australia brings together exceptionally talented and passionate people in the domains of energy trading, data science, software engineering and renewable energy management. We have a vacancy for a Data Engineer to join our Austin based team.

Requirements

3+ years of Python experience.
3+ years of working in technical teams, building data pipelines, delivering productionised code, building/maintaining live applications, developing tooling and improving backtesting frameworks.
Experience in applying relational database design.
Proficiency with Orchestration and IaC in AWS (e.g. Terraform, Kubernetes, RabbitMQ, Airflow, Prefect), Git, containerisation (Docker), database management (e.g. Postgres, Alembic).
Fluent in Python and its wider numerical ecosystem (e.g. Pandas, NumPy, Polars, Pydantic).

Nice To Haves

2+ years of orchestrating machine learning workflows.
Experience with OSS data warehousing tooling and management.
Cloud infrastructure experience.
Experience with monitoring frameworks (e.g. Prometheus).
Experience archiving data to Parquet on S3 and creating tools for API/Grafana queries.
Experience centralising diverse datasets for analytics, visualisation and machine learning.
Familiarity with time-series forecasting and/or optimisation.
Experience with data visualisation and dashboards (e.g. Grafana, Superset).
Familiarity with machine learning and associated techniques (feature engineering, boosting methods, LightGBM).

Responsibilities

Contribute to the design, development, implementation and continuous improvement of our data engineering tools, workflows, processes, and platforms. This includes enhancing the architectural foundations and integrating new data management technologies.
Develop clean, maintainable, well-documented code that adheres to best practices. Support best coding practices within Habitat's software, machine-learning, and data science teams.
Improve expertise within the software team and ensure their ability to support and collaborate on the data infrastructure infrastructure.
Continuously enhance data quality across multiple dimensions such as accuracy, availability, performance, and accessibility to ensure a clear understanding of data within the company.
Providing backup/escalation to the tech-on-call team.
Communicating effectively across Software and Data Science teams.