|
|
- Info
Program Evaluation
Competency 9: Design and conduct program evaluations
- Describe the significance of program evaluation
- List the reasons for evaluating a program (to determine program
performance; to determine whether a program should continue, be
discontinued, or changed; compare different programs or versions of a
program, etc.)
- Define the different roles an evaluator can take (participatory, objective, advocate)
- Describe ethical issues in program evaluation and list the five key
principles from the American Evaluation Association: systematic
inquiry, competence, integrity/honesty, respect for people, and
responsibilities for general and public welfare
- Formulate the question(s) the evaluation will answer
- Apply program theory and program objectives to form questions
- Recognize how to work with the organization’s decision makers to refine questions
- Recognize how the age of the program may influence results
- Develop plans for budget, staff and logistical needs
- Design the best evaluation for a particular program
- Distinguish when it is best to use an outcome evaluation, process (or implementation) evaluation or a combination of both
- Contrast the types of questions used in outcome and process evaluations
- Compare and contrast quantitative designs (“pre-experimental”, experimental, quasi-experimental)
- Identify external and internal validity threats present in each of the quantitative designs
- List the features of a qualitative design
- Conduct the evaluation
- Identify the target population
- Determine whether sampling should be random or non-random
- Select the sampling design and calculate sample size requirements
- Identify measures to be collected
- Assess reliability, validity and responsiveness of measures
- Determine appropriate data sources for each measure
- Prepare and execute a data collection plan
- Analyze evaluation data
- Disseminate results of the evaluation
- Translate results back into policy and develop recommendations
- Design a dissemination plan for policy recommendations
|