![]() |
Multicultural Healthcare
Alliance Tool Kit TOOL KIT - STRATEGIES FOR PROGRAM EVALUATION |
|
|
Alliance Home Page
Strategies for program evaluations
Our Story
Tips
For Success
Links |
INTRODUCTION
Program evaluation (Acrobat Reader required) is the systematic collection, analysis, and reporting of information about a program to demonstrate impact and assist with decision-making for program revisions to improve services. However, it is more then just collecting information. For a successful evaluation, the design must be focused and this requires careful thought and planning. The discussion should focus on three basic questions:
To make the best use of data, it is important to incorporate the evaluation into the program planning process. As mentioned earlier, when establishing the design for a program it is necessary to consider all the pieces and how they work together to accomplish the program objectives. These pieces include:
Laying out these program pieces in the form of a program logic model & (logic model review.doc) helps to describe the program in a concise manner and provides the framework for evaluation. The logic model is a simple visual graphic that outlines the inputs, outputs, and outcomes (immediate-intermediate-long term). The immediate outcomes are those most closely associated with program participation and typically include knowledge, beliefs and skills that are directly linked to the ultimate long term outcome. Describing the program’s underlying program philosophy about why the program works or the theory of change (Acrobat Reader required) is also an important part of the logic model. Using a group process to develop the logic model (program staff, program participants, community partners, funders, evaluators) will produce a more useful tool and will help to refine and clarify program concepts and strategies in the process. Once the program with its intended outcomes are clearly described in the form of the logic model, indicators and measures (Acrobat Reader required) are identified. A variety of factors influence the selection of indicators including the resources available, and the environment in which the program operates. Limited staff and funding, data privacy, workload issues, time limitations and the state of the art of “human measurement” are all pertinent factors to consider when selecting indicators for the evaluation. The key is to make sure that the indicator selected is a reasonable and meaningful measure of the intended client outcome. Using evaluation and the program logic model results in effective programming, better documentation of outcomes, and shared knowledge about what works and why.
|