Sr. Data Engineer

McKesson•Irving, TX

5d•$141,336 - $184,400•Remote

About The Position

McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you and those we serve – we care. What you do at McKesson matters. We foster a culture where you can grow, make an impact, and are empowered to bring new ideas. Together, we thrive as we shape the future of health for patients, our communities, and our people. If you want to be part of tomorrow’s health today, we want to hear from you.

Requirements

Bachelor’s Degree in Computer Science or related field of study and Five (5) years of experience in the job offered or a related occupation.
Experience in data engineering with Databricks and AWS
Experience with Apache Spark, SQL, and Python or Scala
Experience with Delta Lake, Unity Catalog, and cloud data warehouses (e.g., Redshift)
Experience with data modeling, ETL/ELT processes, and data governance
Experience with orchestration tools including Gitlab or Bitbucket and CI/CD practices
Experience in collaborating with cross-functional teams to deliver data solutions using Python and Databricks in Agile environments
Experience with design and optimizing scalable data pipelines with Python and Spark in Databricks
Experience with developing modular, reusable components in Databricks notebooks and workflows
Experience in implementing data validation frameworks to ensure pipeline accuracy and consistency

Responsibilities

Assist and lead the design, development, and maintenance of scalable, high-performance data solutions that support analytics, AI, and business intelligence across the organization.
Assist in designing and documenting technical requirements for data flows between diverse operational systems and the data warehouse and support the end-to-end development of ETL/ELT processes using Apache Spark on Databricks.
Contribute to the ingestion of data into data lakes and warehouses, implement Delta Lake for transactional integrity, and help orchestrate both batch and streaming data pipelines.
Collaborate with cross-functional technology teams, on extract, transform, and load data from a variety of sources, build and optimize data models, and maintain software applications aligned with business needs.
Explore and integrate emerging AWS technologies to enhance data engineering capabilities, write complex SQL queries for data validation and transformation, and manage Databricks workspaces, clusters, and jobs.
Support data quality initiatives, ensure compliance with governance and security policies, and participate in the development and operationalization of machine learning and generative AI applications.
Assist in troubleshooting production workflows, refactoring legacy systems, participating in code reviews, and mentoring junior engineers.
Requires a strong understanding of modern data architecture, a proactive approach to problem-solving, and a passion for building reliable, scalable, and innovative data solutions.