Please enable JavaScript.
Coggle requires JavaScript to display documents.
Evaluating Teaching and Learning at a Distance
Simonson, M., Smaldino, S.…
Evaluating Teaching and Learning at a Distance
Simonson, M., Smaldino, S., and Zvacek, S. (2014). Teaching and Learning at a Distance: Foundations of Distance Education, 6th Edition. Information Age Publishing.
Quote: "Evaluation, as contrasted to research, is the systematic investigation of the worth or merit of an object. Program evaluation is the systematic investigation of the worth of an ongoing or continuing distance education activity", (Simonson et al. (2015). 
Reflection: The chapter discusses several methods of evaluating distance education programs. I found the contrast between using a traditional strategy, with its emphasis on an experimental design, and a more naturalistic methodology which uses focus groups and interviews very interesting. Personally, I am inclined to favor Kirkpatrick and Kirkpatrick's (2006) approach with four levels, supplemented by Philips(2003) which adds return on investment.
Five Steps to Evaluating Distance Education
Level 3- Transfer
Transferred to Workplace
To Other Learner Activities
Level 4- Results
Improved Quality
Lower Costs
Productivity
Mission Accomplishment
Enrollment in Additional Couurses
Educational Achievement
Level 2- Learning
Objective Testing
Team Assessment
Self Assessment
Level 5- Return on Investment (ROI)
5.1 Collect Level 4 (Results) Data
5.2 Identify Training That Contributed to Change in Performance
5.3 Convert Results of Training or Education into Monetary Values
5.4 Determine the Total Cost of Training
5.5 Determine ROI by Comparing Monetary Benefits to Costs
Level 1- Reactions (Did They Like It) **
Checklists
Student Responses
Traditional Approach
Quantitative Methodology
Includes an Experiment
-
-
AEIOU Approach
I. Impact: Did It Make A Difference?
O. Organizational Context: Structures, Policies, or Environments Which Helped or Hindered :
E. Effectiveness: How Well Was It Done? !
Use Standard Measures of Achievement
Surveys
Attitude Measures
Focus Groups
U. Unanticipated Consequences
Positive or Negative
Use for Continuous Improvement
A. Accountability: Doing What You Said You Were Going to Do
Collect Project Administrative Records
Document Level of Project Goal Attainment
Document Activities