Senior Data Engineer

Commonwealth of Massachusetts•Quincy, MA

9d•Hybrid

About The Position

The Executive Office of Health and Human Services (EOHHS) is looking for a highly skilled and experienced candidate to fill the Senior Cloud Data Engineer position within the Enterprise Data Management & Engineering (EDME) department. This role focuses on leading and advancing Mass Health Data Modernization initiatives such as SENDPRO, MassRx Data Integration, Enterprise Data Catalog, Data processing Pipeline optimization, and automation by leveraging AWS Cloud, Snowflake, and other data services. Key responsibilities include supporting SENDPRO and Data Modernization initiatives. The ideal candidate will collaborate across various teams, including data management, engineering, business analysis, quality assurance, and analytics. The goal is to enhance the efficiency, scalability, and overall performance of our cloud data platform. EOHHS is the Commonwealth of Massachusetts agency responsible for administering the Medicaid and Children’s Health Insurance Program (collectively known as MassHealth). MassHealth offers health coverage services to eligible members, including families, individuals with disabilities, children, long-term unemployed adults, and seniors, through various programs, including fee-for-service and managed care. The ideal candidate is an expert in Design and implementation of Data pipelines. You can clearly articulate and implement different data ingestion patterns depending on the use case. In this role, you are comfortable speaking to both business and technical stakeholders to ensure combined understanding and collaborative solutions. This role will be expected to own tasks and follow-up related to cloud data platform Design and development activities, and establish well-documented best practices and processes related to the Data Modernization efforts.

Requirements

Applicants must have (A) at least three (3) years of full-time or equivalent part-time professional or practical experience in the field of information technology application development and support, or (B) any equivalent combination of the required experience and the substitutions below.
I. An Associate’s degree in a related field may substitute for one (1) year of the required experience.
II. A Bachelor’s degree or higher in a related field may substitute for two (2) years of the required experience.
III. A Master’s degree or higher in a related field may substitute for the required experience.

Nice To Haves

5+ years of experience in Cloud Data Architecture, data warehousing, data modeling, ETL, enterprise and business information system architectures, and system engineering
Thorough knowledge and Implementation experience of data warehouse and Enterprise Data architecture principles, specifically Decentralized data architectures like Data Mesh.
3-5 years of experience developing Cloud-based (AWS) data solutions.
5+ years of Cloud database platform experience, such as Snowflake.
Experience in creating and maintaining end-to-end data pipelines.
Strong communication skills. Comfortable explaining/proposing solutions to technical stakeholders, vendors, and business consumers.
Proficiency with Unix, Linux, and shell scripting
Experience working with a large, multi-terabyte enterprise data platform in Cloud.
Clear understanding on system administration, database administration, storage architectures, backup & recovery, and networking.
3-5 years of experience in Informatica (IICS) ETL, Snowflake Data Warehousing, and Airflow (Orchestration) experience.
Experience working with highly sensitive health care information and familiar with HIPAA and other data privacy controls.

Responsibilities

Involve in Design and development of cloud-based data management systems.
Proficiency and practical experience in Design and implementation of data pipelines in a decentralized data architecture like Data Mesh.
Ensure established data security policies and standards are followed while designing data solution for cloud-based platforms.
Collaborates with cross-functional teams to architect highly scalable, highly available, and highly performant cloud data solutions.
Evaluates and recommends new cloud products and services for efficient data curation, storage, and processing.
Monitors the performance of cloud data solutions and strategizes optimization measures.
Ensures compliance with data governance policies and best practices in the cloud.
Implements data management and data governance processes for cloud data.
Conducts thorough analysis and documentation of cloud data engineering strategies and designs.
Establish regular overall system performance assessment processes and action plans.
Expertise in Data Integration leveraging Informatica (IICS), Snowflake, SQL, and Python code to solve complex use cases
Provide directions for the design and development of the data layers, including review of ETL requirements.
Capable of leading team design sessions and facilitating decisions.
Ensure timely delivery of solutions meeting requirements and expectations