Senior Data Engineer
About The Position
We are a healthcare technology company that provides platforms and solutions to improve the management and access of cost-effective pharmacy benefits. Our technology helps enterprise and partnership clients simplify their businesses and helps consumers save on prescriptions. As a leader in SaaS technology for healthcare, we offer innovative solutions with integrated intelligence on a single enterprise platform that connects the pharmacy ecosystem. With our expertise and modern, modular platform, our partners use real-time data to transform their business performance and optimize their innovative models in the marketplace. Position Summary: We are looking for a Senior Data Engineer to expedite our Data Platform Stack to support our developers, database architects, data analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects in a dynamic environment. The ideal candidate will have 8 plus years of hands-on experience, preferably with Snowflake, SQL Server, AWS and Matillion ETL, to build, optimize, and maintain data pipelines and data integration solutions. This role involves working closely with cross-functional teams to support data-driven initiatives across the organization.
Requirements
- Must be well versed with Data warehousing concepts including design patterns (Star schemas, Snowflake design schemas). Must be aware of data modeling concepts including the data modeling Normal forms.
- Knowledge of AWS Infrastructure including S3, SNS, EC2, CloudWatch and RDS.
- 8+ years working in ETL/Data transformation projects with one or more related products such as Informatica or Talend or Microsoft SSIS.
- Experience in business intelligence, data warehousing initiatives.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases like Oracle or MS SQL Server or Snowflake.
- Strong SQL and Python skills with experience in query optimization and performance.
- Strong analytical, problem-solving, and communication skill.
- Bachelor’s in mathematics, Computer Science or related technical field.
Nice To Haves
- Experience with additional ETL tools, data transformation methods, or cloud platforms is a plus.
- Healthcare and PBM: PBM-specific knowledge and experience with transforming various healthcare data is a plus, but not required.
- Experience with Matillion ELT tool and Snowflake Database is preferred
- Experience in building AWS Data Pipelines using Python or Spark, SparkSQL in any of Cloud Environments (AWS / Azure / Google).
Responsibilities
- Analyze and interpret complex data Ability to identify data anomalies and resolve data issues.
- Understand specific business processes and domain concepts and relate them to data subject domains.
- Optimize SQL queries, scripts, and stored procedures in Snowflake and SQL Server to improve efficiency and reduce processing time.
- Integrate and manage data from various sources, ensuring data quality, reliability, and performance
- Design, develop, and maintain scalable and high-performance ETL pipelines using Matillion ETL to ingest, transform, and load data into Snowflake.
- Monitor data pipeline and ETL performance, identifying bottlenecks and making necessary adjustments to ensure optimal system performance.
- Perform troubleshooting and root cause analysis to resolve data issues and prevent future occurrences.
- Develop and implement data models within Snowflake to support business intelligence and analytics requirements.
- Collaborate with Data Leads, Product Managers and QA Engineers to validate requirements, participate in user requirement sessions.
- Perform tests and validate data flows and prepare ETL processes according to business requirements.
- Perform ETL tuning and SQL tuning.
- Ability to document data flows representing business logic in ETL routines.
- Design and implement data conversion strategy from legacy to new platforms.
- Perform design validation, reconciliation, and error handling in data load processes.
- Design and prepare technical specifications and guidelines including ER diagrams and related documents.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
