Principal Data Engineer

Eye Care Partners•Ballwin, MO

47d•Hybrid

About The Position

We are seeking an experienced professional who will serve as the Principal Data Engineer on our Data Platforms & Insights team. The Principal Data Engineer serves as a senior technical leader within the Data Platforms & Insights team, responsible for architecting, developing, and maintaining scalable data solutions that support enterprise-wide analytics, reporting, and data management initiatives. This role drives the design and implementation of robust data pipelines, ensures data quality and governance, and enables self-service analytics through a "Data as a Service" model. The Principal Data Engineer collaborates closely with cross-functional teams, business stakeholders, and third-party service providers to deliver high-impact data solutions, while also mentoring and supervising Data Engineers to uphold engineering standards and best practices.

Requirements

Demonstrated ability to work efficiently and effectively in a fast-paced, matrixed environment, and ability to execute despite ambiguity
A self-motivated personality with a passion for working in a fast-paced environment
Professional in appearance and actions
Logical and Critical thinking skills with demonstrated problem solving and ability to work with a proactive mindset
Customer-focused with excellent written, listening and verbal communication skills
Enjoys learning new technologies and systems
Detail oriented, professional attitude, reliable
Exhibits a positive attitude and is flexible in accepting work assignments and priorities
Meets attendance and tardiness expectations
Management and organizational skills to support the leadership of this function
Ability to follow or provide verbal & written instructions with sufficient grammar and spelling skills to avoid mistakes or misinterpretations
Interpersonal skills to support customer service, functional, and teammate support need
Able to communicate effectively in English, both verbally and in writing
Ability for basic to intermediate problem solving, including mathematics
Travel to other site locations may be necessary. Thus, those needing to travel for work must have access to dependable transportation, and driving record must meet company liability carrier standards
Knowledge of state and federal regulations for this position; general understanding of HIPAA guidelines
Minimum Required: B.S. or B.A. Preferred in STEM (Science, Technology, Engineering, Math) field
Minimum Required: 10+ years of hands-on-experience in the design, development, and implementation of data solutions
Proficient in Microsoft Excel, Word, PowerPoint, Outlook
Experience working with the following: Snowflake development and support
Advanced SQL knowledge with strong query writing skills
Object-oriented/object function scripting languages: Python, Java, Scala, etc.
AWS cloud services: EC2, EMR, RDS, DMS
Relational databases such as SQL Server and object relational databases such as PostgreSQL
Data analysis, ETL, and workflow automation
Multiple ETL/ELT tools and cloud-based data hubs such as Fivetran
Stream-processing systems: Kafka, Spark-Streaming, etc
Source code management and deployment tools (e.g., Git, Jenkins, dbt, Docker).
Infrastructure as Code (IaC) tools (e.g., Terraform, Ansible, CloudFormation)

Nice To Haves

Previous medical office experience preferred; previous ophthalmic experience strongly preferred.

Responsibilities

Design, develop, and maintain scalable and efficient data pipelines using ETL tools and programming languages
Develop integration solutions leveraging APIs to enable seamless communication between systems.
Analyze data elements from various systems, data flow, dependencies, relationships and assist in designing conceptual physical and logical data models
Implement data solutions across on-prem and cloud environments, ensuring performance, reliability, and scalability
Ensure all data pipelines follow established data governance rules for data quality and completeness
Maintain and evolve existing monitoring, logging, and alerting frameworks for proactively managing and troubleshooting data pipelines
Manage source code repositories and deployment processes using modern tools
Utilize Infrastructure as Code (IaC) tools to automate and manage infrastructure provisioning
Work within Agile development framework to understand and transform business requirements into scalable and manageable solutions
Work with various business and technical stakeholders and assist with data-related technical needs and issues
Partner with leadership to define and evolve the long-term data architecture and engineering strategy, ensuring alignment with business goals
Present solutions and options to leadership, project teams and other stakeholders adapting style to both technical and non-technical audiences
Establish and enforce documentation standards for data pipelines, schemas, and infrastructure
Ensures data engineers and other technical teams adhere to documented design and development patterns and standards
Conduct code reviews and provide guidance to other developers, fostering growth and development within the team
Proactively monitor and resolve on-going production issues data pipelines, databases, and infrastructure
Educate organization on latest trends and technologies in data engineering, APIs, and streaming data
Lead team on establishing industry best practices in data engineering to ensure high-quality deliverables
Adheres to all safety policies and procedures in performing job duties and responsibilities while supporting a culture of high quality and great customer service.
Performs other duties that may be necessary or in the best interest of the organization.