Please enable JavaScript.
Coggle requires JavaScript to display documents.
Evaluation of an E-Learning Program, By: Julissa Arauz - Coggle Diagram
Evaluation of an E-Learning Program
Evaluation of Profitability and Return on Investment (ROI)
Concept of profitability in virtual education
Broad definition
Relationship between invested resources and generated benefits
Includes economic, educational, social, and organizational benefits
More than just direct monetary return
Results and benefits
Number of trained students and skill improvement
Practical application of knowledge and workplace productivity
Strengthening institutional reputation
Intangible benefits
Expanded access and reduction of geographic gaps
Development of digital skills and autonomous learning
Personal and collective value difficult to quantify
Medium- and long-term projection
Significant initial investment in technology and design
Replicability and updates with low marginal costs
Scalability and increased profitability over time
Strategic use
Investment justification and accountability
Informed decisions on continuity and expansion
Responsible management focused on social value and efficiency
Economic indicators applied to evaluation
Return on Investment (ROI)
Formula: ROI = (Income – Costs) / Costs
Includes indirect benefits: performance, productivity, error reduction
Positive ROI indicates profitability; negative indicates losses or low impact
Cost-Income Ratio (CIR)
Direct comparison between income and costs
CIR > 1 means income exceeds costs
Useful for budget justification and commercial purposes
Amortization time
Period to recover initial investment
Calculated by dividing total investment by estimated monthly income
Shorter time indicates higher financial efficiency
Other indicators
Cost per student
Cost per training hour
Cost per student-hour
Cost/Benefit ratio and educational ROI
Cost/Benefit ratio
Comparison between total investment and economic and educational benefits
Benefits include income, cost reduction, productivity, and educational quality
Favorable ratio strengthens program sustainability
Educational ROI
Adaptation of traditional ROI to educational context
Considers skill improvements, talent retention, decision-making improvement
Measures learning value beyond money
Use of control groups and comparative analysis
Internal comparative analysis
Pretest and posttest comparison within the same group
Measures changes in knowledge, skills, and attitudes
Use of learning analytics for real-time tracking
Control groups
Similar people not participating in the program
Allows attributing changes to the training program
Controls external variables (experience, motivation, environment)
Impact Analysis and Program Sustainability
Evaluation of organizational and social impact
Organizational impact
Improved employee performance
Optimization of internal processes
Strengthening organizational climate
Social impact
Contribution to equity and inclusion
Community development and empowerment
Social change projects and activities
Evaluation methods
Follow-up surveys and interviews
Case studies and performance reports
Continuous evaluation and feedback
Hard and soft formative impact indicators
Hard indicators
Quantifiable data: performance, productivity, cost reduction
Examples: pass rates, sales, efficiency
Enable evidence-based comparisons and decisions
Soft indicatorS
Subjective aspects: motivation, satisfaction, commitment
Evaluated through surveys, interviews, and observations
Capture deep cultural and human transformations
Complementarity
Hard and soft indicators complement each other
Integral evaluation to understand total impact
Proper instrument design for both types
Impact estimates from different actors
Participants
Perception of developed skills
Valuation of applicability and performance changes
Collected via surveys and reflective journals
Tutors and facilitators
Pedagogical evaluation of progress and participation
Identification of metacognitive skills and collaboration
Assessment of learning processes, not just outcomes
Supervisors and direct managers
Observation of workplace application
Changes in performance and professional attitude
Valuation of learning transfer and institutional return
Technical and administrative teams
Evaluation of system efficiency and accessibility
Incident management and user experience
Impact on logistical and operational quality
Conversion of Results into Economic Value
Methodology to quantify educational benefits
Identification of benefits
Development of specific competencies
Improvement in work performance
Error reduction and equitable access
Direct result and indirect impact indicators
Number of employees applying learning
Improvement of organizational climate
Reduction of staff turnover
Economic equivalence techniques
Calculation of time-saving cost
Monetary estimation of avoided errors
Use of assumptions and reasonable approximations
Establishment of unit and total values
Definition of benefit units
Time saved on work tasks
Number of successful interactions
Increase in process completion rates
Calculation of unit values
Economic value based on institutional costs
Example: cost per hour saved
Estimates based on real or reasonable data
Calculation of total values
Multiplying unit value by total units achieved
Projection of benefits over evaluation periods
Estimation of future benefits and scalability
Calculation of ROI, CIR, and amortization time
Return on Investment (ROI)
Formula: (Net benefit / Total cost) × 100
Monetary and convertible non-monetary benefits
Practical example and significance
Cost-Income Ratio (CIR)
Formula: Income generated / Total costs
Interpretation of values above or below 1
Use for program comparison
Cost Evaluation and Resource Optimization
Categorization and analysis of direct and indirect costs
Direct costs
Payment to instructional designers and virtual tutors
Software licenses and multimedia content production
Technical support and videoconference platforms
Indirect costs
eneral maintenance of virtual campus and technology updates
Institutional administration and administrative salaries
Continuous teacher training and accreditation processes
nalysis and management
Clear identification and justification of each cost
Distinction between fixed and variable costs
Comparison between programs and detection of savings areas
Cost/Hour, Cost/Participant, Cost/Hour/Participant
Cost per hour
Calculation: total cost divided by training hours
Comparison between short and long courses
Efficiency evaluation based on time invested
Cost per participant
Calculation: total cost divided by number of enrollees
Financial equity assessment and cost distribution
Identification of overcosts due to low enrollment
Cost per hour per participant
ntegration of time and student number variables
Comparison among modalities and training formats
Scalability and efficiency projection with increased participants
Strategies to reduce costs without lowering quality
Reuse of digital content
Design of scalable and updateable resources
Creation of reusable learning objects
Curation and continuous updating
Process automation
Enrollment, material distribution, and objective evaluations
Use of LMS platforms with integrated analytics
Reduction of manual work and optimized follow-up
Tutor training
Training in active methodologies and tech resources
Efficient use of forums, feedback, and automated rubrics
Coverage expansion while maintaining pedagogical quality
By:
Julissa Arauz