Please enable JavaScript.
Coggle requires JavaScript to display documents.
CHAPTER 8: IMPLEMENTATION EVALUATION: MEASURING & OUTPUTS - Coggle…
CHAPTER 8: IMPLEMENTATION EVALUATION: MEASURING & OUTPUTS
3 Levels of Implementation
Implementation assessments
Provide managerial guidance, oversight of implementation program
Program monitoring
Set of process of objectives, focus on achieving the objectives
Process monitoring
Ongoing, real time assessment of the implementation of program
Lead to favorable subsequent implementation evaluation
Timely data collection to make corrections to the process theory during implementation
Program / process monitoring
Implementation evaluation
Retrospective determination of whether the program was implemented as designed
Known as process evaluation
Process evaluation
Implementation documentation
Collecting the data specified in the process objectives
Accurate, complete, timely implementation
Tallying the activities & processes of the program implementation
Efficacy, Effectiveness & Efficiency
Effectiveness
Realistic potential under real life conditions
Degree of effectiveness can be reflected in several different statistics
Efficiency
Amount of output achieved from the inputs
Calculated as cost per unit of output
Efficacy
Maximum potential effect under ideal conditions
Ideas conditions are difficult to create the efficacy of an intervention is determined through rigorous studies
Data Collected Method
Organizational records
Client records
Checklist
Observation
Questionnaire
Interview
Case study
Activity log
Quantifying Inputs to the Organizational Plan
Both inputs, outputs of organization include in implementation evaluation
Examples of measures of inputs & outputs of service utilization plan
Participants
Queuing & program logistics
Program reach
Interventions
Mazlan program based on social marketing efforts
Specific organizational resources are being keys to implement the health program
Expand internationally
Quantifying Outputs of the Service Utilization Plan
Units of Service
To distinguish between the number of the program participants & the number of contacts
Predetermined unit
Number of unit
Number of contact hour
Number of education session
Participant related issue
Dosage monitoring
Satisfaction measurement
Coverage
Program logistics
Documentation, monitoring & evaluation are method used to track program coverage
Quantifying Inputs to the Service Utilization Plan
Participants & recipients
Simple count of how many individuals inquired about the program or were served
Worth to collect: demographic profile
Intervention delivery & fidelity
Indicates whether the intervention was provided as designed
Process objectives serve as a guide for deciding which possible inputs & outputs are crucial to evaluate
Often compromised in 3 ways
Not run as per designed. Different program provided ( activities &/ dosage)
Inconsistent program provided
Intervention fail due to lack of program
Process evaluation often equated with elements that are included in an evaluation of the services utilization plan
Challenges in Measuring Satisfaction
Measure must capture participants' expectations & experiences
Discrepancies between paper & pencil questionnaire responses & interview responses
Measure must be culturally sensitive
Scope can be difficult to define
Ceiling effect