Module 5: Evaluation
Module 5: Evaluation walks participants through the steps needed to evaluate a public health program or policy. It provides a foundation for understanding the evaluation process and its importance, and allows participants to gain practical, hands-on experience in completing each step of an evaluation plan. This module uses examples related to tobacco control, yet application of the concepts are universal to program and policy evaluation.
Module 5: Evaluation – Training Materials – Downloadable Files
|Trainer Guide||Trainer Guide|
|Participant Guide||Participant Guide|
|PowerPoint Slides||PowerPoint Slides|
|Certificate of Completion|
Getting Started with Evaluation
The first section of this training provides background information on the importance and purpose of evaluation and the process of evaluation planning. Participants discuss why evaluations are conducted and how findings may be used to the benefit of programs and policies. An overview of the five-step evaluation plan is presented, along with a discussion of the importance of having a plan to guide each step of the process. Finally, the evaluation planning template and case study that participants will use throughout the training will be introduced and briefly discussed.
Section 1: Program Description
Program description is the first step of evaluation planning. During this step the program goal and the logic model are discussed. Participants will learn about the components, purpose, and importance of the program goal and logic model, and review completed versions that have been created for the case study. These items will guide participants through the evaluation planning process presented throughout the training.
Section 2: Evaluation Design
In Section 2 the focus of evaluation planning turns to defining the purpose and scope of the evaluation. This involves defining program objectives, identifying stakeholders, establishing the purpose of the evaluation, differentiating between process and outcome evaluation, writing evaluation questions, and identifying indicators.
Section 3: Data Collection
Section 3 covers the general process of data collection, including methods (quantitative and qualitative), tools (interviews, questionnaires, focus groups, and observation), and sample population(simple random sample, convenience sample, and cluster sample). Definitions are provided and the advantages and disadvantages of several of the techniques are discussed.
Section 4: Data Analysis
In Section 4 data analysis is defined, and strategies for qualitative and quantitative analysis are differentiated. Basic steps for qualitative data analysis are discussed, as are several techniques for quantitative analysis (including averages, frequencies, ratios, percentages, and proportions). Interpretation of findings, a key part of data analysis, is also discussed.
Section 5: Evaluation Reports
Evaluation reports involve establishing report goal(s), identifying the target audience, anddetermining the most appropriate and effective report type. Participants discuss why evaluation reports are important and how they may be used. The standard parts of a written evaluation report are discussed (including executive summary, introduction, background, program description, methodology, results, conclusions, and recommendations).