Data Engineer II

Lantern•Dallas, TX

1d•Hybrid

About The Position

Lantern is looking for a Data Engineer II to join our Data Engineering team. The ideal candidate will have solid experience building data pipelines, working with batch processing frameworks, and applying data modeling techniques to support reliable data ingestion and exports. In this role you will collaborate with technology and business stakeholders to deliver data solutions that meet user needs. The candidate should demonstrate an engineering mindset and an interest in developing enterprise-scale solutions using modern cloud platforms, databases, data integration/orchestration tools, and big data technologies.

Requirements

3+ years of experience as a Data Engineer (or related role), building and supporting data pipelines in production.
1+ years of experience with cloud and infrastructure on Azure (preferred), AWS, or GCP.
Hands-on experience with Spark, Python, and SQL to build, test, and maintain data pipelines (including writing clear, maintainable code and queries).
Experience with Microsoft SQL Server (preferred) or other relational databases, including query optimization and performance tuning.
Experience working with big data technologies such as Spark (preferred), Databricks, or similar frameworks.
Experience using Infrastructure as Code tools such as Terraform (or similar) to provision and manage cloud resources.
Experience building data pipelines that are scalable and reliable, with attention to data quality, testing, and operational support.
Experience contributing to data lake or lakehouse solutions to support analytics and downstream consumption.
Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

Nice To Haves

Prior Experience working with Healthcare Information exchange standards like HL7, X12 EDI, FHIR will be helpful.
Experience or knowledge of creating RESTful API’s is a plus.
Experience building Dashboards and visualizations using Power BI or other tools is a plus.

Responsibilities

Design and implement robust, scalable, and high-performance data pipelines
Implement Data Ingestion, transformation, and Data Quality features to support Application Engineering, Analytics, and various Business Verticals across the organization.
Collaborate with Data Engineering Manager, and Product in building data models to improve reliability and interpretability of data for analytical and business needs.
Design, develop, and maintain robust data export solutions to facilitate the efficient transfer of data to external systems and platforms.
Actively contribute to the creation of design documents, assess technologies, and conduct Proof of Concepts (PoCs).
Experience supporting production jobs and mitigate issues in a timely manner.
Write unit, integration, and functional tests for new features.
Contribute to the Technology Roadmap, PR Reviews and formulate standards/best practices.
Bring in a positive attitude and foster a culture that embraces continuous learning and Innovation.