Please enable JavaScript.
Coggle requires JavaScript to display documents.
Evaluation Techniques (Evaluation (Goals (Assess extent of system…
Why involve humans?
-
Presence of images, animations, and interaction that will influence behaviour
-
Evaluating designs
Cognitive walkthrough
-
-
-
-
-
Analysis focuses on goals and knowledge: does the design lead the user to generate the correct goals?
-
-
Observational methods
Think Aloud
-
User asked to describe what he is doing and why, what he thinks is happening
-
-
-
Post-task walkthroughs
-
-
-
-
Transcript played back to participants: seek comment; can be immediately (fresh in mind) or delayed (evaluator has time to identify questions
-
Recording data
Paper and pencil: cheap, limited to writing speed
Audio: good for think aloud, difficult to match with other protocols
Video: accurate and realistic, needs special equipment, obstrusive
Computer logging: automatic and unobtrusive, large amounts of data difficult to analyse
User notebooks: course and subjective, useful insights, good for longitudinal studies
-
Physiological methods
Eye tracking
-
-
Measurements
Fixations: eye maintains a stable position. Number and duration indicate level of difficulty wtih display
-
-
If seen more often, make it bigger, more central
-
Query techniques
Interviews
-
Informal, subjective, relatively cheap
-
-
-
-
Questionnaires
-
-
-
Needs careful design
Information required e.g. usability, mental effort required, user experience
-
-
E.g. System Usability Scale (SUS): Scalar type questionnaire, with instructions on how to calculate total score (0-100)
Evaluation
Occurs in lab, field and/or in collaboration with users
-
-
-
-
Lab studies
Advantages: specialist equipment available, uninterrupted environment
Disadvantages: lack of context (used to their own machines), difficult to observe several users cooperating
Appropriate: system location is dangerous / impractical for constrained single user systems to allow controlled manipulation of use
Field studies
Advantages: natural environment, context retained (though observation may alter it), longitudinal studies possible
Disadvantages: distractions, noise
-
-