Data Integration System Engineer

City of Philadelphia • Philadelphia, PA

1d • $87,550

About The Position

The Data Integration System Engineer will support the City of Philadelphia’s Office of Innovation & Technology and its CityGeo team. Working closely with a senior Systems Engineer, this role helps support and enhance existing infrastructure, deploy and streamline server stacks and automations, and host the City’s data engineering infrastructure, pipelines, models, and integrations. The team uses open-source, custom-developed, and commercial tools, including Kubernetes, Docker, OpenTofu (Terraform), Python, Bash, DBT, GIS, Apache Airflow, Jenkins, Postgres, PostGIS, AWS, GitHub, GitHub Actions, MuleSoft, ArcGIS Online, and CARTO.

The engineer will contribute to systems and services such as DataBridge, the City’s enterprise data warehouse; AIS, the City’s address information system; and Airflow, used for departmental integrations and open-data publishing. The role supports data integration and open-data initiatives that help improve City operations and services for residents. It calls for technical skills, clear communication and documentation, creative problem-solving, and an interest in public service.

Requirements

• Previous experience in a DevOps or related role managing systems or software stacks in a production environment with appropriate testing and deployment practices.
• A bachelor’s or advanced degree in Computer Science, Information Systems, or a related field, or equivalent work experience.
• Proficiency in systems administration; Linux is preferred, and the role also works with Windows.
• Proficiency with Linux command-line tools, PowerShell, Bash, and Python.
• Proficiency with Kubernetes and Docker.
• Understanding of Git and GitHub for version control and CI/CD pipelines.
• Experience with cloud technologies, containers, and orchestration tools, including AWS Batch, ECS, EKS, and CloudWatch, or ability to work with these technologies.
• Ability to troubleshoot system health and understand the basics of deploying maintainable systems.
• Ability to maintain clean and secure data environments.
• Ability to work effectively in a hybrid on-premises and cloud environment.
• Ability to communicate complex technical concepts in understandable terms.
• Clear and concise writing and communication skills, with a documentation-driven approach.
• Creative problem-solving and critical-thinking skills.
• Efficient time management and ability to manage multiple workflows simultaneously.
• Dedication to making Philadelphia municipal government more robust, efficient, and equitable.
• Must become a City of Philadelphia resident within six months of hire.

Nice To Haves

• Previous work in a public-sector or large-organization setting.
• Familiarity with, or ability to learn, GitHub Actions, Terraform, Jenkins, and Airflow.
• Experience with database administration, preferably Postgres, and SQL; SQL proficiency is a plus.
• Experience working with spatial datasets.

Responsibilities

• Design and implement deployment and automation strategies for maintaining and updating server stacks in AWS and Azure cloud environments on Linux and Windows servers, using Infrastructure as Code and other best practices.
• Configure system health monitoring using Grafana, AlertManager, Prometheus, AWS CloudWatch, and SNS.
• Work with data engineers to support data integration and open-data initiatives, including maintaining systems such as DataBridge, Airflow, MuleSoft, and AIS.
• Design, develop, expand, and refine data pipelines using Apache Airflow, custom Python-based software, and other tools.
• Write clear, descriptive technical documentation for systems and applications.
• Partner with data stewards at different technical levels and explain technical details to non-technical stakeholders.
• Troubleshoot system health, deploy maintainable systems, and maintain clean and secure data environments.

Benefits

• Public Service Loan Forgiveness Program qualified employer.
• Tuition discount program for City employees and, in some cases, their spouses and dependents, in partnership with area colleges and universities.
• Comprehensive health coverage for employees and eligible dependents.
• Wellness program with eligibility for a discounted medical plan.
• Paid vacation, sick leave, and holidays.
• Retirement savings options.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level