Data Engineer II

Careforth
5h$99,165 - $148,746Remote

About The Position

A pioneer in the caregiving space, Careforth supports family caregivers across the United States to confidently care for their loved ones at home. Through a combination of in-person home visits, remote coaching and our proprietary digital collaboration app, we provide caregivers with support, guidance, confidence, and connection to resources they need. The Caregivers and families we support stay with Careforth for many years, building lasting relationships along the way. Join us today and live our values: lead with heart, cultivate trust, go beyond. Position Summary This individual will support the growth of our enterprise DataHub/Delta Lake architecture by building and maintaining cloud-native, Spark-based data pipelines. The ideal candidate has solid hands-on experience with Databricks, AWS Cloud services, and Apache Spark (Python/Scala) and is eager to grow their technical skills while contributing to high-impact projects.

Requirements

  • Bachelor’s degree in Computer Science, Data Engineering, or a related field.
  • 3–5 years of professional data engineering experience, with exposure to cloud-based data environments.
  • Proficiency in Apache Spark (PySpark or Scala) for data processing.
  • Experience working with Databricks or similar data platforms.
  • Familiarity with AWS services (S3, Lambda, Glue) and SQL.
  • Strong working knowledge of Python.
  • Understanding of data modeling concepts and pipeline orchestration (e.g., Airflow).
  • Solid grasp of software engineering fundamentals (version control, testing).
  • Strong problem-solving abilities and effective communication skills to work within a collaborative team environment.

Nice To Haves

  • Experience handling healthcare data such as medical claims, electronic medical records highly desired
  • NOGO experience

Responsibilities

  • Build and Maintain Pipelines: Develop and support scalable and secure data pipelines using Databricks, Apache Spark, and AWS Cloud services (S3, Glue, Lambda).
  • Collaborate on Design: Work with senior engineers and technical leads to implement data models and ETL/ELT workflows based on business requirements.
  • Data Quality & Testing: Write clean, efficient code and participate in peer code reviews to ensure quality, testing coverage, and performance.
  • Operational Support: Monitor and troubleshoot production data workflows to ensure reliability and assist in resolving data issues as they arise.
  • Continuous Improvement: Help identify areas for optimization in existing pipelines to improve cost-efficiency and speed.
  • Cross-Functional Teamwork: Partner with business analys

Benefits

  • At Careforth your well-being matters.
  • With flexible schedules, a remote-first culture, and a nationally recognized wellness program, our benefits are designed to help you thrive, both professionally and personally.
  • Discover how we invest in you: https://careforth.com/careers/#benefits
  • The pay range for this position is $99165- $148746 The actual wage offered may be lower or higher depending on budget and candidate experience, knowledge, skills, qualifications, and geographic location.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service