Data Engineer, Bureau of Data Technology & Strategy

City of New York • Long Island City, NY

2d • Hybrid

About The Position

The Data Engineer will support the Center for Population Health Data Science (CPHDS), launched in October 2023 to advance data modernization and enable the New York City Department of Health and Mental Hygiene to link public health, healthcare, and social service data for timely and effective public action. CPHDS works to make data more accessible, timely, equitable, meaningfully usable, protected, and actively used to improve the health and wellbeing of New Yorkers. The Center strengthens agency-wide data capabilities through workforce development, improved intra- and inter-agency data sharing, and modern technology that produces trusted, integrated data and insights.

The role provides data engineering and infrastructure support for complex Python applications; helps migrate applications from on-premise environments to Azure and adapt them to cloud-native architecture; and develops automated data pipelines and scalable hybrid technology architecture. It also contributes to open-source technology, statistical and machine-learning models, and improvements to the department’s data science infrastructure and processes.

The NYC Department of Health and Mental Hygiene is a large public health agency serving New York City residents. Its mission is to safeguard the health of every resident and cultivate a city where everyone can achieve optimal health. Appointments are subject to a minimum one-year probationary period.

Requirements

• At least 5 years of experience performing data science tasks using cloud-based technologies.
• At least 5 years of hands-on experience in Python.
• At least 3 years of experience building applications with Python web frameworks such as FastAPI, Django, or Flask.
• At least 3 years of experience using ETL platforms such as Azure Data Factory or Airflow.
• Meet the stated City Research Scientist qualification requirements for the applicable assignment level. The posting specifies a master's degree for Assignment Level I in certain fields and additional education and experience requirements for Assignment Level II and above.
• Appointments are subject to a minimum probationary period of one year.

Nice To Haves

• Graduate degree in Data Science, Mathematics, Applied Mathematics, Statistics, Applied Statistics, Computer Science, Computer Engineering, Electrical Engineering, Physics, or a similar field of study.

Responsibilities

• Provide data engineering and infrastructure configuration support for complex Python applications.
• Assist with migrating complex Python applications from on-premise environments to Azure, including transforming applications to cloud-native architecture.
• Build and oversee automated data extraction, transfer, and load processes to support analytics databases.
• Design, build, and document scalable hybrid technology architecture using on-premise and Azure cloud resources.
• Identify, explore, and help build emerging free and open-source technologies.
• Design, implement, test, deploy, update, and document statistical, machine-learning, and deep-learning models.
• Propose and implement improvements to the DOHMH data science infrastructure and processes.

Benefits

• Potential eligibility for federal or state loan forgiveness and repayment assistance programs.
• Premium-free health insurance plan.
• Additional health, fitness, and financial benefits may be available depending on the position’s union or benefit fund.
• Public sector defined-benefit pension plan.
• Tax-deferred savings program.
• Worksite Wellness Program.
• Depending on the position, the ability to work from home up to two days during the week.
• Job security.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level