Please enable JavaScript.
Coggle requires JavaScript to display documents.
Evaluation - Coggle Diagram
Evaluation
Challenges
Usability (usable) vs Utility (useful) - real key
require domain knowledge
no standard benchmarks
defining tasks is critical
individual differences of participants
insight is important but hard to measure
exploration - how to measure if don't know goal
Methods
Comparative user study with benchmark tasks
measure performance, accuracy, time, errors
quantitative
e.g. Treemap vs. Sunburst
Treemap: compare file sizes
Sunburst: search files, understand structure
insight-based
problem
complex
deep
qualitative
unexpected
relevant
MILC
multi-dimensional: observations, interviews, surveys, logging
in-depth: domain experts
long-term
case-study
interview -> train -> early use -> mature use -> outcome
detailed usage scenarios
ICE-T
Value = Time + Insights + Essence + Confidence
hierarchical value framework, 21 total heuristics
domain experts
Storytelling Aspects of vis
memorable
engagement
credible
clear
Scenarios
user performance
user experience
Reasons
Notable vis evaluation approaches