Evaluating Interactive Systems (Expert evaluations (Expert reviews (What…
Evaluating Interactive Systems
What is it?
evals done without users
identification of usability problems
predicting problems they think will be experienced by users
sometimes report quantitative assessments
rely on expert judgment
impossible/undesirable to use users (confidentiality, practicality)
Who is an "expert"?
easy, fast, cheap
tend to get the big usability issues
difficult to eval from perspective of real users
depends on experts' knowledge
often yield lots of minor problems
quantifying the UX
Purdue Usability Testing Q
no longer widely used
experts walk through a task with the design
at each action, the expert answers 4 Qs
does the user have the right conceptual model?
is the action visible?
is the labeling signifying?
will the user get good feedback?
good for testing learnability (atm)
systems you should be able to learn by exploratory browsing
group problems across evaluators
see examples online
Madame Tussauds example
What to prepare
How to do it
first find issues
then rate the severity and combine answers with other experts