Please enable JavaScript.
Coggle requires JavaScript to display documents.
Introduction to evaluation (influence of the interpretation of the data…
Introduction to evaluation
What to evaluate
ranges from low-tech prototypes to complete systems
Depends on what is being evaluated
Case studies
provide examples of how different evaluation methods are used in a variety of physical settings that involve users in different ways
they demostrate how evaluator exercise control in different settings
informing participants about their rights
making sure that you tke account of biases and other influences that impact how you describe your evaluation findings
Types of evaluation
Natural settings involving users
online communities and products used in public spaces
there is little to no control of users activities in order to determine how the product would be used in the real world
the data takes the form of events and conversations and is used to help identify opportunities for new technology, establish requirements etc
A goal is to be unobtrusive and not to affect what people do during the evaluation
Methods are typically used are observation and focus groups
The downsides is that makes it dificult to anticipate what is going to happen and to be present when something interesting happen
Any setting not involving userss
consultants and researchers critique, predict and model aspects of the interface in order to identify the most obvious usability problems
Controlled setting involving users
User activities are controlled in order to test hypotheses and measure or observe certain behaviors. the main methods are usability and experiments
Laboratories and living labs
Enable to control what users do, when do they do it and for how long
Usabililty testing
Collecting data through interviews, questionnaires, observation etc. to determine if an interface is usable by the intended user population
influence of the interpretation of the data
reliability
Validity
ecological validity
biases
scope