Senior Data Engineer
About The Position
Join the Magnus Lake House team within Optum Insight as a Senior Data Engineer and contribute to a high-profile migration project that transitions the legacy Cornerstone Data Warehouse to a modern cloud-based Lakehouse architecture. The role involves designing data ingestion patterns and developing solutions that efficiently share data with consumers. It is based in a hybrid work environment in either Eden Prairie, Minnesota, or Raleigh, North Carolina. The successful candidate will be a hands-on developer who uses modern AI-assisted tools to support productivity and innovation. The position works with Azure Data Factory, Databricks, dbt, Java, and Python to build and manage ingestion and transformation workflows, while collaborating with cross-functional teams to ensure solutions meet security, scalability, and performance standards. All telecommuters must adhere to UnitedHealth Group’s Telecommuter Policy.
Requirements
- Bachelor’s degree in Computer Science, Mathematics, or a related field; or a high school diploma/GED with at least 4 years of equivalent data engineering experience.
- At least 5 years of experience in data engineering or software development.
- At least 3 years of professional programming expertise in either Python or Java, with the ability to read and modify code in both languages.
- At least 2 years of experience building and orchestrating data pipelines in an Azure environment, including ADF and Databricks.
- At least 1 year of experience using AI-assisted development tools, such as GitHub Copilot or Codex, to enhance development productivity.
Nice To Haves
- Experience with legacy data warehouse migrations and modernizing data architectures.
- Experience designing and implementing data-sharing patterns for downstream consumers.
- Deep understanding of Medallion Architecture and Delta Lake.
- Experience with CI/CD practices and version control in a cloud-native environment, such as Azure DevOps or GitHub.
- Hands-on experience using the dbt framework for data transformation.
- Ability to work effectively in a hybrid team environment, balancing independent development with collaborative design sessions.
Responsibilities
- Use enterprise-approved AI tools and coding assistants to streamline development workflows, automate complex tasks, and improve code quality and efficiency.
- Design and implement data ingestion patterns to migrate legacy Cornerstone Data Warehouse assets into the Magnus Lake House.
- Develop and deploy scalable data-sharing solutions that provide consumers with efficient access to data using various architectural patterns.
- Build and manage automated data pipelines using Azure Data Factory (ADF) to ingest and process files within Databricks.
- Use the dbt framework to execute data transformations following Medallion Architecture (Bronze, Silver, and Gold layers).
- Interpret, maintain, and enhance existing Java and Python codebases to support project requirements.
- Evaluate data engineering and AI-assisted development trends to inform solution design and identify opportunities for innovation.
- Collaborate with cross-functional teams to ensure data pipelines meet security, scalability, and performance standards.
Benefits
- Comprehensive benefits package, subject to eligibility requirements.
- Incentive and recognition programs.
- Equity stock purchase plan.
- 401(k) contribution, subject to eligibility requirements.
- Career development opportunities.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
