Data Engineer-Integration Specialist

City of Philadelphia • Philadelphia, PA

12h

About The Position

The Data Engineer-Integration Specialist will join the City of Philadelphia’s Office of Innovation & Technology (OIT), working on a diverse team of engineers, analysts, and GIS specialists. The role contributes to developing, maintaining, and optimizing data pipelines and integration strategies that help City departments innovate and improve services for residents. The successful candidate will develop an in-depth understanding of the City’s diverse data and help improve its data engineering infrastructure, pipelines, models, and integrations.

The team uses open-source, custom-developed, and commercial technologies, including Python, Bash, SQL, DBT, GIS, Docker, Terraform, Apache Airflow, Jenkins, Postgres, PostGIS, AWS, GitHub and GitHub Actions, MuleSoft, and APIs from providers such as ArcGIS Online and CARTO. The team supports services including DataBridge, the City’s enterprise data warehouse; AIS, the City’s address information system; and Databridge-Airflow, a workflow generator and orchestrator for departmental integrations and open data publishing. The work supports public-facing services and data resources across the City.

The City is seeking someone technically skilled and interested in using data to improve City operations and community life. The successful candidate must become a City of Philadelphia resident within six months of hire. Applications must include a resume and cover letter; applications without a cover letter will not be considered. Salary cannot exceed $95,605.

Requirements

• Bachelor’s degree in Computer Science, Data Science, Information Systems, Geography/GIS, or a related field; equivalent work experience may be considered.
• Demonstrated experience in data engineering or a similar role, focused on data management, integration, ETL, or ELT.
• Proven experience with Python, SQL, and database management.
• Experience working with a modern data engineering technology stack.
• Familiarity with developing custom ETL/CI/CD tools and ability to learn and adapt to new technologies.
• Proficiency in Python.
• Strong SQL skills and experience with databases.
• Familiarity with Docker, Bash, and minimal Linux server administration.
• Understanding of Git/GitHub for version control and CI/CD pipelines.
• Ability to reason about, model, and manipulate complex datasets; maintain clean and secure data environments; work in a hybrid on-premises and cloud environment; communicate technical concepts clearly; and evaluate tools and practices in a public service context.
• Clear writing and communication, creative problem-solving and critical thinking, ability to work with data from diverse domains, effective time management across multiple workflows, and curiosity and willingness to learn.
• Must become a City of Philadelphia resident within six months of hire.
• Resume and cover letter are required; applications without a cover letter will not be considered.

Nice To Haves

• Familiarity with modern Python development practices, such as type annotations, data validation, and automated testing.
• Previous work in a public sector or large organization setting.
• Experience working with spatial datasets.
• Experience with Postgres.
• Experience with AWS.
• Experience with or ability to learn Airflow, DBT, Terraform, Kubernetes, and MuleSoft.
• Experience using command-line interfaces.

Responsibilities

• Work with business partners of varying technical ability to understand how their data is produced, stored, and updated.
• Design enhancements that optimize enterprise integrations and public data accessibility.
• Design and develop new data pipelines and expand or refine existing ones using Apache Airflow, custom Python-based software, and other tools.
• Connect diverse systems of record, centralized databases, and SaaS environments.
• Improve data platform components, data governance, master data management, data standardization, data enrichment, and quality assurance.
• Develop and support enterprise integration and open data initiatives and critical systems, including DataBridge, Databridge-Airflow, and AIS.
• Write clear, descriptive technical documentation for systems and applications.
• Partner with data stewards at varying technical levels and communicate technical details to non-technical stakeholders.
• Contribute to team discussions on coding standards and participate in knowledge sharing.

Benefits

• Public Service Loan Forgiveness Program qualified employer.
• 25% tuition discount program for City employees, and sometimes spouses and dependents, through partnerships with area colleges and universities.
• Comprehensive health coverage for employees and eligible dependents.
• Wellness program with eligibility for a discounted medical plan.
• Paid vacation, sick leave, and holidays.
• Generous retirement savings options.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level