Data and Evaluation Manager

City of Philadelphia • Philadelphia, PA

6d • $87,000 - $97,000

About The Position

Position Summary: This posting is with the Philadelphia Office of Children and Families (OCF) Division of Performance Management and Technology (PMT). OCF supports Philadelphia’s most vulnerable children and families and prioritizes safe children, strong families, and supported schools. OCF administers a number of City-supported programs, including Adult Education, Out-of-School Time, Career Connected Learning, Community Schools, and PHLpreK. OCF also oversees the Department of Human Services (DHS), which provides child welfare services, delinquent services, and child welfare prevention programs to promote safety, permanency, and well-being for children and youth at risk of abuse, neglect and delinquency.
The Division of Performance Management and Technology supports the core missions of OCF and DHS in the following ways: Evaluating service quality and consistency, identifying needed improvements, and tracking these improvements over time; Building a world class data and information technology infrastructure; Developing and maintaining integrated information systems and data analytics so that practitioners can easily access and utilize quality and accurate data in their day-to-day decisions; Strengthening how the child welfare system utilizes data to make informed decisions about the children and families we serve; and Conducting short- and long-term research to evaluate the effectiveness of programs and system-wide initiatives in order to continually inform child welfare policy and practice.
The focus areas of responsibility of the Data and Evaluation Manager are to: 1) lead the strategy and design for data collection and program implementation, including rigorous mixed methods program and agency evaluations (integrating qualitative and quantitative data); 2) design program data collection tools, including for monitoring and evaluation that measure program compliance and quality; 3) monitor programs’ quality and compliance; 4) oversee reporting of administrative, compliance, and quality data; 4) design, stakeholder surveys; 5) develop and communicate recommendations to OCF leadership and other stakeholders regarding improving program quality and compliance; 6) lead a team of Data and Evaluation Associates.

Requirements

• Qualitative: Ability to lead evaluation and monitoring tool development, including conducting literature reviews for existing tools and using stakeholder input to update existing tools
• Prior experience conducting interviews, focus groups, and observations
• Prior experience analyzing qualitative data, including coding interviews, focus groups, and observations and conducting document reviews
• Quantitative: Prior experience using statistical and survey software such as R, STATA, or Python, and Qualtrics. Cognito, or Other data collection instrument platforms.
• Knowledge of basic statistics including descriptive, exploratory, and inferential statistics.
• Knowledge of research principles and the data lifecycle
• Basic knowledge of relational databases, experience using SQL based BI layers preferred
• Prior experience creating basic data visualizations such as charts and tables.
• Prior experience leading survey design, programming, and administration
• General: Strong project management abilities, including at least 2 years of project management experience
• Experience supervising staff
• Demonstrated ability to monitor and evaluate programs
• Proven strong research, analysis, and writing skills
• Clear and concise communication of ideas, program scopes, and findings – orally and in writing
• Ability to problem solve and identify several courses of action to make informed decisions about project development and implementation
• Ability to maintain strong working relationships with coworkers, leadership, and service providers
• Ability to work on multiple projects at once while still meeting project deadlines
• Ability to quickly pivot to emergent tasks and project needs
• Master’s Degree in Social Policy, Government Administration, and/or other relevant Social Science preferred
• At least 5 years of data analytics, research and evaluation design, and/or other related experience
• At least 2 years of project management experience
• Ability to physically perform the duties and to work in the environmental conditions required such as maneuvering in office space – reaching file cabinets, fax and copier machines when necessary.
• Must be able to sit for up to 2 hours while looking at and using a computer.
• Must possess the ability to use a keyboard and mouse for typing or performing data entry functions.
• Must be able to travel locally and attend conferences out of the City if necessary.

Responsibilities

• Lead the design and implementation of research and evaluation projects that advance program and system performance improvements.
• Partner with OCF and MOE leadership to strategize and support with program implementation, including development or refinement of logic models, data tools, and data systems.
• Work with OCF and MOE staff to develop accountability strategies, including integrating data into continuous quality improvement plans and providers’ plans of improvement when necessary.
• Oversee data from key system sources to produce short and long-term outcome analyses.
• Generate graphs, tables, and other data visuals.
• Lead the design and analysis of survey questions.
• Administer surveys to various population groups receiving OCF and MOE services.
• Lead development of qualitative data collection tools and processes for OCF/MOE programs, such as observation protocols, surveys, interviews, and focus groups.
• Organize and lead convenings of OCF/MOE and service provider leadership to gather feedback on evaluation initiatives.
• Work collaboratively with PMT team members to ensure quality implementation of performance management activities and processes.
• Write and present project reports, briefs, and/or presentations for system leaders and stakeholders using clear, concise language.
• Perform related research, evaluation, and supervision duties as assigned.
• Lead and supervise Data and Evaluation Associates.

Benefits

• City employees get unlimited FREE public transportation all year long through SEPTA’s Key Advantage program. Employees can ride on SEPTA buses, subways, trolleys, and regional rail for their daily commute and more.
• The City offers its employees 8 weeks of paid parental leave.
• We offer Comprehensive health coverage for employees and their eligible dependents.
• Our wellness program offers eligibility into the discounted medical plan
• Employees receive paid vacation, sick leave, and holidays
• Generous retirement savings options are available
• As a qualifying employer, City of Philadelphia employees are eligible to participate in the Public Service Loan Forgiveness program.
• The City of Philadelphia has forged partnerships with over a dozen esteemed colleges and universities in the area, ensuring that our employees have access to a wide range of tuition discounts and scholarships.
• Experience savings of 10% to 40% on your educational expenses, extending not only to City employees but in some cases, spouse and dependents too!

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees