Senior Data Engineer
About The Position
As a Senior Data Engineer on the UHC Core Data KTLO team, you will join our dynamic technology organization in Eden Prairie, MN, dedicated to building and optimizing robust data pipelines and systems that power critical healthcare platforms. In this role, you will design and deliver modern data and AI-powered solutions, platforms, and automations for enterprise scale. You will work with state-of-the-art technologies such as Python, Spark, Scala, and Kafka to build scalable, high-performance data processing pipelines and apply data warehousing and modeling best practices. You will play a key role in driving innovation by identifying opportunities to streamline workflows, automate tasks, and leverage advanced tools to address complex business challenges. Focus on KTLO activities, including vulnerability remediation, tool and version upgrades, data security, and platform stability. Additionally, support Azure Data Factory pipelines, Databricks workloads, and cloud components such as Blob Storage and AzCopy. You will have the flexibility to work a hybrid schedule as you take on some tough challenges.
Requirements
- 5+ years of experience in data engineering, software engineering, or related field
- 3+ years of experience building and optimizing data processes and pipelines using Python, SQL,Spark, and Scala
- 3+ years of experience with data warehousing, dimensional data modeling, and database design
- 2+ years of experience supporting streaming data architectures and messaging platforms with Apache Kafka
- 2+ years of experience designing and deploying scalable automated solutions, platforms, or workflows (including integration of automation tools)
- 1+ years of experience with Apache Airflow for workflow orchestration, scheduling, and monitoring of data pipelines
Nice To Haves
- Bachelor's degree in Computer Science, Data Science, Information Technology, or a related field
- Experience working with cloud data platforms (e.g., AWS, Azure, or Snowflake)
- Experience with CI/CD pipelines, containerization (e.g., Docker, Kubernetes), and version control (Git)
- Experience evaluating emerging technology trends and applying modern automation tools to streamline engineering workflows
- Experience with relational and NoSQL databases
- Strong analytical and problem-solving skills, with a track record of applying responsible design standards
- Familiarity with IBM DataStage for legacy ETL development and integration with enterprise data platforms
- Experience working with healthcare data and understanding of compliance, regulatory, and data privacy standards
- Hands-on experience with Teradata for large-scale data warehousing, query optimization, and performance tuning
- Proficiency in Unix/Linux environments with scripting capabilities for automation and operational support
Responsibilities
- Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI
- Evaluate emerging trends to inform solution design and strategic innovation
- Use enterprise-approved AI tools to streamline workflows, automate tasks, and drive continuous improvement
- Build, optimize, and maintain robust, scalable data pipelines and processes using Python, Spark, and Scala
- Support and enhance real-time streaming data applications and messaging systems using Kafka
- Apply and promote data warehousing, data modeling, and database design best practices
- Collaborate with cross-functional teams to understand data requirements and translate them into high-performing technical solutions
- Identify and implement performance tuning and query optimization across large-scale datasets
Benefits
- comprehensive benefits package
- incentive and recognition programs
- equity stock purchase
- 401k contribution
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
Associate degree
