Principal Data Engineer - Remote
About The Position
The Principal Data Engineer will join the Surest/Optum Data Engineering Enablement organization, a team responsible for developing shared frameworks, architectural patterns, standards, and cross plan data capabilities used by all Data Engineering delivery teams. This role requires deep expertise in cloud native engineering, distributed data processing, and healthcare data domains. You will design, build, and optimize scalable data solutions that span the full health plan ecosystem—including eligibility, claims, provider, pharmacy, utilization, pricing, and member experience data. This role plays a critical part in advancing enterprise data modernization, improving platform efficiency, and enabling teams across the organization to develop high quality, governed, secure data solutions. Principal Data Engineers include broad engineering responsibilities across analysis, design, development, testing, standards, tooling, and influencing organizational data strategy.
Requirements
- Undergraduate degree in engineering, mathematics, computer science, software development, or related technical field, or equivalent experience
- 10+ years of solid SQL or NoSQL query experience
- 5+ years designing and implementing efficient, end-to-end, flexible data pipelines
- 5+ years with both batch and near real-time data architectures
- 3+ years of PySpark & Python data development experience
- Experience implementing parallel processing data strategies
- Experience integrating strategies for data pipeline introspection at scale
- Experience working with Data Lake or Delta Lake architecture
- Proven solid analytical thinking, creativity, and willingness to be hands-on
- Proven solid drive to evolve development efficiency, data quality, and pipeline improvements
- Demonstrated excellent problem-solving, documentation, teamwork, and communication skills
- Proven superior attention to detail
- Experience working in Agile Development Framework
Nice To Haves
- Post-graduate degree in engineering, mathematics, computer science, software development, or other technical field
- Experience working with healthcare data
- Experience developing and operating Databricks jobs as data pipelines using pyspark
Responsibilities
- Partner in the design, development and communication of technology patterns and standards needed to manage Surest healthcare data
- Provide technical leadership, guidance and training to team of data engineers on individual and group levels
- Implement data processes and pipelines which incorporate product requirements with data storage, lifecycle, accessibility, performance, and security standards
- Solve complex data development issues within data development software
- Support Agile development practices, including refining user stories and collaborating with product owners and stakeholders
- Develop large scale, flexible data pipelines to efficiently process health care data supporting all aspects of a health plan
- Work with peers across Surest to ensure alignment on data capabilities and software development lifecycle (SDLC)
Benefits
- comprehensive benefits package
- incentive and recognition programs
- equity stock purchase
- 401k contribution
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Principal
Education Level
Associate degree
