Data Integration System Engineer

City of Philadelphia • Philadelphia, PA

8h

About The Position

The Data Integration System Engineer is part of CityGeo, a diverse team of engineers, analysts, and GIS specialists in the City of Philadelphia’s Office of Innovation & Technology. The role supports and enhances existing infrastructure while helping deploy and streamline server stacks and automations that host the City’s data engineering infrastructure, pipelines, models, and integrations. The engineer works closely with a senior Systems Engineer and data engineers to maintain systems that support City departments, agencies, residents, and public-facing open-data services.

The team uses open-source, custom-developed, and commercial tools including Kubernetes, Docker, OpenTofu (Terraform), Python, Bash, DBT, GIS, Apache Airflow, Jenkins, Postgres, PostGIS, AWS, GitHub and GitHub Actions, MuleSoft, ArcGIS Online, and CARTO. Systems and services supported include DataBridge, the City’s enterprise data warehouse; AIS, the City’s address information system; and Airflow workflows for departmental integrations and open-data publishing. The work contributes to services and applications that use City data to support residents and improve City operations.

The successful candidate must become a City of Philadelphia resident within six months of hire. Applicants must include a resume and cover letter; applications without a cover letter will not be considered. Salary cannot exceed $87,550.

Requirements

• Previous work experience in a DevOps or related role managing systems or software stacks in a production environment with appropriate testing and deployment practices.
• Bachelor’s or advanced degree in Computer Science, Information Systems, a related field, or equivalent work experience.
• Proficiency in systems administration; Linux is preferred, and the role also works with Windows.
• Proficiency with Linux CLI, PowerShell, Bash, and Python.
• Proficiency with Kubernetes and Docker.
• Understanding of Git/GitHub for version control and CI/CD pipelines.
• Ability to troubleshoot system health and understand the basics of deploying maintainable systems.
• Ability to maintain clean and secure data environments and work effectively in a hybrid on-premises and cloud environment.
• Clear and concise writing and communication skills, creative problem-solving and critical thinking, and efficient time management with the ability to manage multiple workflows.
• Dedication to making Philadelphia municipal government more robust, efficient, and equitable.
• Must become a City of Philadelphia resident within six months of hire.
• Must submit a resume and cover letter; applications without a cover letter will not be considered.

Nice To Haves

• Previous work in a public-sector or large-organization setting.
• Familiarity with, or ability to learn, GitHub Actions, Terraform, Jenkins, and Airflow.
• Experience with database administration, preferably Postgres, and SQL proficiency.
• Experience with cloud technologies, containers, and orchestration tools such as AWS Batch, ECS, EKS, and CloudWatch.
• Experience working with spatial datasets.

Responsibilities

• Design and implement deployment and automation strategies for maintaining and updating server stacks in AWS (primarily) and Azure on Linux and Windows servers, using infrastructure as code and other best practices.
• Configure system health monitoring using Grafana, AlertManager, Prometheus, AWS CloudWatch, and SNS.
• Work with data engineers to support integration and open-data initiatives and develop and maintain systems including DataBridge, Airflow, MuleSoft, and AIS.
• Design, develop, expand, and refine data pipelines using Apache Airflow, custom Python-based software, and other tools.
• Write clear, descriptive technical documentation for systems and applications.
• Partner with data stewards at different technical levels and explain technical details to non-technical stakeholders.
• Help deploy and streamline server stacks and automations supporting the City’s data engineering infrastructure, pipelines, models, and integrations.

Benefits

• Public Service Loan Forgiveness Program qualified employer.
• Tuition discount program of 25% for City employees, and sometimes spouses and dependents, through partnerships with area colleges and universities.
• Comprehensive health coverage for employees and eligible dependents.
• Wellness program eligibility for a discounted medical plan.
• Paid vacation, sick leave, and holidays.
• Generous retirement savings options.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level