Data Engineer, Bureau of Data Technology & Strategy

City of New York • New York, NY

1d • $109,565 - $130,000 • Hybrid

About The Position

The Data Engineer will support the Center for Population Health Data Science’s data modernization work at the New York City Department of Health and Mental Hygiene. The role focuses on data engineering and infrastructure for complex Python applications, migrating applications from on-premise environments to Azure and transforming them into cloud-native architectures, and building scalable hybrid technology architecture using on-premise and Azure resources. The position also supports the agency’s goal of making public health, healthcare, and social service data more accessible, timely, equitable, usable, and protected.

The role includes building and overseeing automated data extraction, transfer, and load processes for analytics databases; exploring and helping build emerging free and open-source technologies; and designing, implementing, testing, deploying, updating, and documenting statistical, machine learning, and deep learning models. The Data Engineer will also propose and implement improvements to the department’s data science infrastructure and processes.

Requirements

• At least 5 years of experience performing data science tasks using cloud-based technologies.
• At least 5 years of hands-on experience in Python.
• At least 3 years of experience building applications in Python web frameworks such as FastAPI, Django, or Flask.
• At least 3 years of experience using ETL platforms such as Azure Data Factory or Airflow.
• The posted City Research Scientist qualifications require a master's degree in an appropriate field and qualifying research experience; the specific experience and degree provisions vary by assignment level.

Nice To Haves

• Graduate degree in Data Science, Mathematics, Applied Mathematics, Statistics, Applied Statistics, Computer Science, Computer Engineering, Electrical Engineering, Physics, or a similar field of study.

Responsibilities

• Provide data engineering and infrastructure configuration support for complex Python applications.
• Assist with migrating complex Python applications from on-premise environments to Azure, including transforming applications to cloud-native architecture.
• Build and oversee automated data extraction, transfer, and load processes to support analytics databases.
• Design, build, and document scalable hybrid technology architecture using on-premise and Azure resources.
• Identify, explore, and help build emerging free and open-source technologies.
• Design, implement, test, deploy, update, and document statistical, machine learning, and deep learning models.
• Propose and implement improvements to DOHMH data science infrastructure and processes.

Benefits

• Potential eligibility for federal or state loan forgiveness and repayment assistance programs.
• Premium-free health insurance plan; the posting states this saves employees over $10,000 annually, based on a 2024 assessment.
• Additional health, fitness, and financial benefits may be available depending on the position’s associated union or benefit fund.
• Public-sector defined-benefit pension plan with steady monthly payments in retirement.
• Tax-deferred savings program.
• Worksite Wellness Program.
• Depending on the position, the ability to work from home up to two days during the week.
• Job security compared with private-sector employment.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level