Please enable JavaScript.
Coggle requires JavaScript to display documents.
Program Evaluation (PRE, MHPE) - Coggle Diagram
Program Evaluation (PRE, MHPE)
- Fundamental Concepts of Evaluation
Definition: Program evaluation is the systematic collection and analysis of information about a program's design, implementation, and outcomes so it can be improved (AMEE 67)
-
Definition of "Program": A program can be anything organized—such as a session, a course, a whole curriculum, a service, or a policy.
key Distinctions
Evaluation, assessment and appraisal are not the same
-
Evaluation - judging the program, not the individual
-
Evaluation vs research
Evaluation answers questions stakeholders need answered, in their own local setting
-
-
-
-
-
By timing
Formative - during the program, to improve it
Summative - at the end, looking back at outcomes
-
By approach
-
-
Expertise-oriented - an outside expert judges the program, e.g. accreditation
-
-
Models
-
NW Kirkpatrick's levels
-
Level 2 Learning - did they gain knowledge, skills, attitudes?
-
-
New World Kirkpatrick - levels as a chain of evidence, not a causal chain
Logic model
-
-
-
-
Outcomes - short, medium and long term
Impact - wider, longer-term change
-
-
- Key Steps in Planning an Evaluation
-
-
Data Collection Methods
Tools
Questionnaires - validated or adapted, Likert scales, open and closed questions
Interviews, including key informant interviews
-
-
-
-
-
-
-
-
-
-
Design
Qualitative - for people's experiences, the "how" and "what"
-
-
-
-
-
-
-
-
-
-
-
Keep data confidential, remove identifiers, report in aggregate
-
-
-
-
-
-
-
-
-
Feedback for faculty, appraisal and promotion
-
-
- Report and use of findings
-
Clear, actionable recommendations
-
-
-
-
-
- Program Evaluation Standards (Joint Committee)
-
-
-
-
-
-