Senior Data Engineer

Sarah Cannon Research InstituteUsa, TN
21hRemote

About The Position

It’s More Than a Career, It’s a Mission. Our people are the foundation of our success. By joining our growing team at Sarah Cannon Research Institute (SCRI), a subsidiary of McKesson, you will have the opportunity to become part of one of the largest community-based cancer programs to advance oncology treatments and improve outcomes for cancer patients across the globe. We look for mission-driven candidates who have a desire to advance the fight against cancer and make a difference in the lives of patients diagnosed with cancer every day. Our Mission People who live with cancer – those who work to prevent it, fight it, and survive it – are at the heart of every decision we make. Bringing the most innovative medical minds together with the most passionate caregivers in their communities, we are transforming care and personalizing treatment. Through clinical excellence and cutting-edge research, SCRI is redefining cancer care around the world. SCRI’s Data Solutions team is seeking a Senior Data Engineer to address strategic data needs. The Senior Data Engineer is responsible for designing, building, and maintaining data engineering processes. This role involves working with cross-functional teams to develop efficient data pipelines and support data modernization initiatives. The position requires expertise in data engineering principles, experience with cloud technologies, and an ability to deliver reliable data solutions.

Requirements

  • Deep technical expertise in building and optimizing data pipelines and large-scale processing systems.
  • Deep technical expertise with Azure Cloud and Databricks.
  • Experience working with cloud solutions and contributing to data modernization efforts.
  • Strong programming skills ( e.g., SQL , Python, Pyspark or Scala) for data manipulation and transformation.
  • Excellent understanding of data engineering principles, data architecture, and database management.
  • Excellent understanding of data modeling concepts and data structures.
  • Excellent understanding of source to target data mappings.
  • Strong experience building AI/ML data pipelines in Databricks.
  • Proficient in leveraging GenAI and agentic frameworks to develop data engineering solutions .
  • Strong problem-solving skills and attention to detail.
  • Excellent communication skills, with the ability to convey technical concepts to both technical and non-technical stakeholders.
  • Bachelor's degree in a related field (e.g., Computer Science, Information Technology, Data Science).

Nice To Haves

  • Knowledge of healthcare or clinical research industries is a plus.
  • Strong technical aptitude and experience with a wide variety of technologies
  • Ability to rapidly learn and if evaluate a new tool or technology.
  • Strong verbal & written communication skills
  • Demonstrated technical experience.
  • Be an innovative thinker.
  • Must have a strong customer and quality focus.

Responsibilities

  • Design and implement scalable and efficient data pipelines to support various data-driven initiatives.
  • Designs and maintains Databricks Lakehouse pipelines across Bronze/Silver/Gold (Delta) layers, producing governed, ML-ready datasets with built-in data quality checks and lineage.
  • Collaborate with cross-functional teams to understand data requirements and contribute to the development of data architectures.
  • Work on data integration projects, ensuring seamless and optimized data flow between systems.
  • Implement best practices for data engineering, ensuring data quality, reliability, and performance.
  • Contribute to data modernization efforts by leveraging cloud solutions and optimizing data processing workflows.
  • Demonstrate technical leadership by staying abreast of emerging data engineering technologies and implementing industry best practices.
  • Provide technical leadership in enabling AI/ML initiatives by designing scalable, reliable, and well-governed data engineering solutions.
  • Effectively communicate technical concepts to both technical and non-technical stakeholders.
  • Promotions to different environments using GitHub CICD with GitHub Actions / Liquibase
  • Participate in the evaluation and identification of new technologies

Benefits

  • We care about the well-being of the patients and communities we serve, and that starts with caring for our people. That’s why we have a Total Rewards package that includes comprehensive benefits to support physical, mental, and financial well-being.
  • Our Total Rewards offerings serve the different needs of our diverse colleague population and ensure they are the healthiest versions of themselves.
  • As part of Total Rewards, we are proud to offer a competitive compensation package. This is determined by several factors, including performance, experience and skills, equity, regular job market evaluations, and geographical markets.
  • In addition to base pay, other compensation, such as an annual bonus or long-term incentive opportunities may be offered.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service