Data Engineer Contract

Omnidian
83d$80 - $100Remote

About The Position

As a Senior Data Engineering Contractor, you will be a pivotal addition to our team, specifically tasked with accelerating our Data Warehouse initiatives and relieving internal resource strain. We are looking for a high-impact professional who can hit the ground running within our Databricks environment. You will be responsible for designing, building, and optimizing robust data pipelines using the Medallion Architecture (Bronze, Silver, Gold), ensuring that our data is scalable, clean, and ready for high-level analytics. This role requires a blend of deep technical expertise and the ability to work autonomously in a fast-paced environment.

Requirements

  • 5+ years of experience in Data Engineering with a focus on large-scale data warehousing.
  • Expert-level proficiency with Databricks and Apache Spark (PySpark or Scala).
  • Proven track record of implementing and managing the Medallion (Bronze/Silver/Gold) data structure.
  • Advanced SQL skills for complex data transformation and analysis.
  • Experience building production-grade ETL/ELT pipelines in a cloud environment (Azure, AWS, or GCP).
  • Solid understanding of Data Lakehouse concepts and Delta Lake technology.

Nice To Haves

  • Prior experience within the renewable energy or solar sector (familiarity with PosiGen-style data).
  • Experience with workflow orchestration tools like Airflow or Azure Data Factory.
  • Familiarity with CI/CD practices and tools (Git, Terraform, or Azure DevOps).
  • Knowledge of dbt (data build tool) for SQL transformations.

Responsibilities

  • Design and implement scalable end-to-end data pipelines within the Databricks Lakehouse platform.
  • Architect and maintain data layers following the Medallion Architecture standards to ensure data quality and lineage.
  • Collaborate with internal stakeholders to understand PosiGen-specific data requirements and translate them into technical solutions.
  • Optimize Spark jobs and SQL queries to improve performance and reduce computational costs.
  • Automate data workflows and implement robust monitoring to ensure pipeline reliability.
  • Document data models and pipeline logic to ensure seamless knowledge transfer to the permanent team.

Benefits

  • We've got you covered with 100% of health insurance monthly premiums for employees, and 50% for dependents.
  • Performance Bonus: Because exceptional work deserves exceptional rewards. Eligibility begins after 90 days.
  • Equity Stake: Join us in shaping the future and be rewarded for your dedication with stock options.
  • Continuous Growth: Up to $500 annual learning reimbursement because investing in your development is investing in our success.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service