Director of Evaluation Services

San Diego State University Research Foundation • San Diego, CA

4d • $11,069 - $12,320 • Hybrid

About The Position

The Academy for Professional Excellence, a project of San Diego State University School of Social Work, was established in 1996 with the goal of revolutionizing the way people work to ensure the world is a healthier place. Our services integrate culturally responsive and recovery-oriented practices into our daily work to promote healing and healthy relationships. Providing approximately 50,000 learning experiences to health and human service and justice system professionals annually, the Academy provides a variety of workforce development solutions in Southern California and beyond. With seven programs, three divisions and over 100 staff, the Academy’s mission is to provide exceptional learning and development experiences for the transformation of individuals, organizations, and communities. As a member of the Academy team you will be engaging in communal development of heart, mind, and practice. You are expected to foster culturally responsive practice behaviors to promote well-being and a culture that focuses on healing, healthy relationships and changed behaviors. The Strategy, Development, and Organizational Advancement (SDOA) division brings together several functional areas under one structure to support the Academy's vision. Using data and research, SDOA designs learning experiences, develops products, and creates systems that strengthen organizational culture and reinforce the Academy's brand. The division leads the implementation of the Academy's strategic plan and provides insights and recommendations to improve the Academy's products, services, staff development, and partnerships with service providers. The Evaluation Services team (within SDOA) provides evaluation design and instrument creation, logic modeling, analysis, and actionable insights through reporting and dashboards. Evaluation data infrastructure support, including programming/distribution of survey instruments and data collection processes and practices rooted in the Data Equity Framework to ensure equity, fairness, and justice within evaluation and data projects.

Requirements

• Bachelor's degree and/or equivalent training and relevant work experience involving study, analysis, and/or evaluation leading to the development or improvement of administrative policies, procedures, practices, or programs.
• 8 years of progressively responsible experience in an office or administrative environment
• Candidate must reside in California and live within a commutable distance from SDSU at time of hire.
• Job offer is contingent upon satisfactory clearance based on background check results (including a criminal record check).

Nice To Haves

• Experience partnering with California Department of Social Services, California Regional Academies, CalEval and Health and Human Services agencies in Southern California.
• Expertise with Qualtrics and related programming.
• Knowledge of SPSS and the Sum Total and CACWT Learning Management Systems
• Familiarity with Human Services including Public Child Welfare, Adult Protective Services, and Behavioral Health Services.
• Minimum of ten years' experience with applied research and evaluation including conducting statistical analyses and maintaining and developing databases.
• Master’s degree or equivalent years of experience.
• Two years contributing to organizational strategic planning.
• Three years leading strategic planning at the team level.

Responsibilities

• Under the general direction of the Senior Director of Strategy, Development, & Organizational Advancement, the Director of Evaluation Services is responsible for the strategic direction and oversight of the Evaluation Services team.
• The Director will lead the creation and management of the Academy's evaluation infrastructure, systems, and protocols.
• The Director will guide the Evaluation Services team, Academy programs and divisions, and external partners in meeting evaluation needs, including participating in and overseeing the development, revision, and implementation of evaluation procedures; overseeing the design and testing of evaluation methodology and tools for data collection; development and maintenance of internal and external data systems, analysis of evaluation data, and production of evaluation reports.
• The Director of Evaluation Services is responsible for overseeing progress to meet yearly strategic priorities related to evaluation and to meet State, regional, and individual program goals and evaluation deliverables.
• Serves as a program administrator for evaluation, provides strategic leadership in planning evaluation to determine the broad impact of the Academy for Professional Excellence programs and deliverables.
• The Director of Evaluation Services will make decisions and oversee recommendations and actions regarding the use of evaluation systems and will create, develop, innovate, maintain, and monitor databases that house training and evaluation data; train support staff on evaluation and tracking procedures; and conduct and oversee statistical analyses of evaluation data.
• This position will plan, organize, and direct the work of 10+ employees; and participate in and/or make effective recommendations on hiring, retaining, performance management, and staff development.
• Oversee evaluation management for each Academy for Professional Excellence program (APSWI, CWDS, CRS, LIA, SACHS, Tribal STAR, WI and Academy), inclusive of strategic planning, conceptualizing, developing, implementing, and analyzing evaluation data.
• Oversee work with each Program Manager to develop tailored evaluation plans for each program for each fiscal year, inclusive of: a working logic model, action plan, identified goals, strategies, and development of new measures.
• Oversee and design evaluation methodology to determine feasibility of transfer of learning and intent to use to improved outcomes for Academy programs and associated workforce development projects.
• Oversee and contribute to the development of data collection procedures, protocols, and practices for Academy evaluation.
• Oversee preparation of quarterly, ad hoc, and annual evaluation analyses and the writing and presentation of state and county evaluation reports.
• Serve as a liaison between CACWT Administration, CalEval, and systems partners to ensure data needs, reporting requirements, data governance, and system enhancements are aligned with statewide workforce development goals.
• Determine and implement methods of use of evaluation data systems (including but not limited to SPSS, Qualtrics, NVIVO, Excel, SumTotal Learning Management System, SQL/Access databases).
• Determine and oversee production and maintenance of data quality, data collection, and analysis processes.
• Oversee team strategic planning, ensuring alignment to the Academy strategic plan, with an emphasis on how evaluation can support organizational growth, efficiency, and innovation.
• Collaborate with Program Managers and the Senior Director of Finance and Business Services to provide infrastructure, scopes of work, evaluation workflow, technology, and contract direction specific to evaluation staff resource allocation and budget, and work to ensure all contract deliverables are resourced and met.
• Act as a consultant and subject matter expert in key statewide workgroups, upholding and contributing to the CalWise Evaluation charter and promoting key strategies to advance statewide evaluation and data systems capabilities.
• Interface with a variety of partners across the state, including but not limited to CDSS partners, staff from other Regional Training Academies, SDSU School of Social Work, Division of Research and Innovation, and SDSU Research Foundation.
• Anticipate, forecast, and plan for changes in evaluation practices, understanding trends to recommend and integrate innovations and systems efficiencies.
• Act as internal consultant and subject matter expert for the Academy, providing guidance, recommendations, and making decisions on evaluation practice, systems, data use, data storage, and integration.
• Provide day-to-day oversight for Evaluation Services strategy and operations.
• Provide personnel management to direct report(s) including: monitoring performance, providing feedback, holding regular supervision conferences, and facilitating professional development for direct reports.
• Participate in recruitment and onboarding of new staff as directed by Organizational Development and SDSURF Human Resources.
• Conduct annual performance evaluations of direct report(s).
• Address performance concerns of direct report(s) in conjunction with SDSURF Human Resources, Organizational Development, and appropriate line of supervision.
• Convene monthly Evaluation Team meetings – revisit/track progress on action plan, facilitate communication re: workloads, current projects underway, communicate decisions from management teams (and any other updates that impact evaluation).
• Communicate with staff regularly to keep them apprised of decisions made at Leadership Team meetings (or other venues) that impact them.
• Advocate on behalf of the evaluation services team at all staffing levels, when working collaboratively, and in various meetings; always be thinking of implications for staff and be proactive in terms of planning for resource needs to complete deliverables.
• Establish a workflow via project management software for direct reports and other evaluation staff.
• Train support staff on evaluation systems, technology, and procedures.
• Assist in planning, organizing, and implementing evaluation activities outside of database/dashboard needs.
• Develop and monitor evaluation protocols for collecting and processing evaluation data.
• Advise and collaborate with the evaluation team in determining the best course of action for any given evaluation project that will utilize a data system.
• Advise and assist in determining methodology, techniques, systems, and procedures for meeting the evaluation needs of Academy programs.
• Assist in conducting statistical analyses of evaluation data and produce data and evaluation reports.
• Perform other duties as assigned which are in the best interests of the Academy for Professional Excellence.
• Travel to off-site locations for Academy and Program meetings (primarily in Riverside and San Diego).
• Participate on the Academy's Shared Leadership Team.
• Engage in strategic planning and decision-making regarding issues impacting organizational culture, growth, and expansion.

Benefits

• San Diego State University Research Foundation is an equal opportunity employer. Consistent with California law and federal civil rights laws, SDSU Research Foundation provides equal opportunity in employment without unlawful discrimination or preferential treatment based on race, sex, color, ethnicity, or national origin or any other categories protected by federal or state law.
• Employment decisions are based on an individual’s qualifications as they relate to the job under consideration.
• Our commitment to equal opportunity means ensuring that every employee has equal access to resources and support.
• SDSU Research Foundation complies with Titles VI and VII of the Civil Rights Act of 1964, Title IX of the Education Amendments of 1972, the Americans with Disabilities Act (ADA), Section 504 of the Rehabilitation Act, the California Equity in Higher Education Act, California’s Proposition 209 (Art. I, Section 31 of the California Constitution), and other applicable state and federal anti-discrimination laws including grant or contract terms and conditions related to funded program activities.
• Further the SDSU Research Foundation maintains a Nondiscrimination Policy that prohibits discriminatory preferential treatment, segregation based on race or any other protected status, and all forms of unlawful discrimination, harassment, and retaliation in all programs, policies, and practices.
• SDSU Research Foundation makes all employment decisions including, but not limited to, applicant screening, hiring, promotion, demotion, compensation, benefits, disciplinary actions, and terminations on the basis of merit.

What This Job Offers

• Job Type: Full-time
• Career Level: Director