|
Homepage >The QSA Tool: Get Started with Your Self-Assessment! >Program Sustainability/Growth
Measuring Outcomes/Evaluation
A quality program has a system for measuring outcomes and using that information for ongoing program planning, improvement, and evaluation.
MORE ON MEASURING OUTCOMES AND EVALUATION
A quality program has clearly defined goals and has identified specific outcomes to measure progress towards its goals. Goals and outcomes are aligned with the essential elements of a quality program and the program has a plan for regularly gathering data and evaluating performance against its chosen outcomes. Evaluations should include assessment of program activities, staff performance, and student engagement. Evaluations should be based on quantitative data collection as well as qualitative feedback from staff, youth, families, and other key stakeholders. Evaluation findings should be used to shape plans for future program improvement and staff professional development.
Click here to fill out the Measuring Outcomes/Evaluation section of the QSA Tool electronically.
Zooming In
For definitions of what each quality indicator might look like at performance levels 1-4, click here.
Taking Action
Program Element |
Quality Indicator |
Perf.
Level |
Timeline for Improvement and Improvement Steps |
Person(s) Responsible |
Res. Needed |
Measuring Outcomes/ Evaluation |
#1 Has measurable program goals and objectives that are aligned with the organizational mission and identified needs. |
1 |
Right Now |
1. Hold meeting to revisit the organization’s vision and goals, assess how activities are aligned with the goals, and determine what evidence of success is currently available.
2. Prepare this information for a stakeholder meeting for input and approval. |
1. Site Director: Anne Johnson
2. Staff Members: Eddie Rivera and Jessica Rubenstein
|
1. Harvard Family Research Project guide on collecting data
|
This Year |
1. Hold meeting for Site Director and staff members to clarify program goals and to begin to define how they will be measured.
2. Develop internal methods of assessing program success and staff performance.
3. Share findings with staff and stakeholders to inform a group planning process for continuous program improvement. |
Next Year |
1. Hold meeting with staff members and stakeholders to develop a process for to gather and use information to encourage continuous learning and improvement of programming.
2. Train staff in evaluation methods (such as data collection, program observations, or interviews) and involve staff in designing the evaluation questions.
3. Identify an external evaluator and share key findings from the self-assessment process with them.
4. Meet periodically with the evaluator to receive feedback and ask questions. |
 Tips for Success
Being Prepared for Evaluation
Having your programs evaluated is less daunting when you make an ongoing effort to be prepared. Here are tips to easing the burden when its time to measure your success.
1. Have a Plan
You can’t measure performance if your goals aren’t clear from the beginning. All of your program’s stakeholders should be clear on what you’re aiming to achieve and how you plan to meet your objectives. There shouldn’t be any surprises when your programs are being evaluated!
2. Create a Logic Model
A logic model is a visual representation of your goals. Logic models have four main parts: inputs, activities, outputs, and outcomes. Inputs are what you need to provide services or create products, such as staff and time. Activities are actions taken, which require inputs, with the goal of fulfilling the objectives set out in your mission statement. Outputs are the direct results of your activities. Outputs are often numerical; for example, 10 families attended a program. Outcomes are the goals you plan to achieve. They should link directly to your outputs. For example, if 10 families attended a program, the outcome is that those families’ literacy has increased. When evaluating your programs, a logic model will provide the outcomes to be measured.
3. Collect Data (everyday!)
While it sounds obvious, collecting data year-round should be viewed as a priority to your program’s success. Investing time in collecting key information, such as daily attendance records, will save you from feeling pressured when it comes time to report statistics. By having records organized and centrally located, you will always be ready for a program evaluation.
|
 Try This!
Try This!
The following activity can help your team suggest priority issues for evaluation and contribute to the evaluation design and/or data collection. You will need plenty of chart paper, markers, and copies of your organization’s mission and goals. Allow about 1½ to 2 hours for this exercise.
-
As a full group, review your organization’s mission and goals.
-
In small groups, have participants brainstorm a list of key aspects of the program to be evaluated. Ask the groups to also think of possible evaluation methods for each program aspect, and ways in which various stakeholders (e.g. youth, school administrators, parents, etc.) could be involved in the evaluation process.
-
Record the responses and post each group’s answers. Conduct a gallery walk so participants can read each other’s responses and add ideas. Return to the full group and finalize the lists by eliminating duplicate ideas. Ask the group to prioritize the most important aspects of the program to be evaluated.
-
Debrief the exercise and determine next steps for implementing an evaluation. 9
9 Developing and Implementing an Evaluation Plan, Innovation Center for Community and Youth Development
|
Research, Tools and Templates, and Resources
Research
Out-of-School Time Evaluation Snapshot: Detangling Data: Methods for Gathering Data, Harvard Family Research Project
Research brief on commonly used methods for collecting program performance data
Tools and Templates
Afterschool Program Quality Surveys, Institute for Educational Research
Sample surveys to assess programs
Resources
A Continuum of Youth Involvement in Evaluation, The Innovation Center
Chart on moving toward using youth-friendly evaluation methods
Learning from Logic Models in Out-of-School Time, Harvard Family Research Project
Article on how to create and use logic models
Measuring Youth Program Quality: A Guide to Assessment Tools, Forum for Youth Investment
Article that describes different assessment tools and strategies and helps program providers select an assessment method
Out-of-School Time Research and Evaluation Database, Harvard Family Research Project
Database including searchable profiles about research and evaluation work on both large and small OST programs to support the development of high quality evaluations in the out-of-school time field
Publications on Non-Profit Management, TCC Group
Several publications to assist non-profit managers with strategic planning and evaluation
Reframing Expectations of Afterschool Website, Partnership for After School Education (PASE)
Website dedicated to reviewing afterschool goals, establishing appropriate outcomes for programs, and developing effective tools to measure those outcomes
|
