Please enable JavaScript.
Coggle requires JavaScript to display documents.
Usability testing (UT plan (Methodology (What, Where, How long), Title…
Usability testing
UT plan
Title
What is studied
Type of test
Author and stakeholders
Date
Goals
Research questions
Question we hope to answer with the study
Methodology
What
Where
How long
Participants
Schedule
Script placeholer
UT goals
Categories
Resource information
History
Future
Users
Which users are using the resource
Which new users so we want to target?
Success of the resource
Definition/Criteria
Competitors
Timing and scope
Type of feedback
Verbal response
Spoken answers
Multiple choice
Categorical responses
Nominal (cat/dog)
Dichotomous (yes/no)
Ordinal (agree/disagree)
Rating scale
Ordinal variable
Written response
Post-study analysis
Metrics
Success rate
Error rate
Critical
Not critical
Time to completion
Subjective measures
Satisfaction
Ease of use
Availability of information
Useful especially for
Tracking progress btw releases
Assessing competitive position
Stop/Go decision before launch
Most important phase in UT
Choosing the tests and participants
Pilot test
Always
Test your test
No analysis of data
Target users
Most likely to use the resource
Recruiting users
Existing users
Promotion on the website
User support
Tools
UserTesting
Mechanical Turk
Craigslist
Panel agencies
Market research recruiter
Hallway testing
Co-workers
Friends
Family
People on the street
Statistical significance
Qualitative
5
Quantitative
20
Types of tests
Scripted
Most controlled
For specific usage aspects
Quantitative
Qualitative
Examples
Tree testing
Strips out visual elements
Labelling / hierarchy of the content
To be used early in the design process
Tools
Treejack
For navigation testing
Usability benchmarking testing
Overall usability
To be used when...
The resource is stable
After a major update
Before a major update
High number of participants
Hallway usability testing
Bare minimum for UT
low-cost
Simple
5 people is enough
High output
Popular
Tips
Choose the right place and time
Come prepared
Reward the participants
Natural and near-natural
Conducted remotely
Unmoderated
Types
A/B testing
2 choices or variation of an element
Cheap
Highly scalable
High statistical significance
Tools
Optimizely
Unbounced
Guidelines
Both variations at the same time
Enough people for statistical significance
Test new users
First Click Testing
Tools
Chalkmark
To be used when...
Finished website
Functional prototype
Wireframe
Guidelines
Write clear task scenarios
Define the best paths to success
Time each task
Measure user confidence
Open-ended question afterward
Field and Diary Studies
Field study
Observe users in their own environment
Diary study
Users are asked to keep a diary
Eye Tracking Test
F-pattern
Z-pattern
Beta-testing (User Acceptance Testing)
Filter your users
Set apart 8-10 weeks
Last usability test
Hybrid
Incorporates elements of
scripted tests
Decontectualized tests
Natural tests
Types
Desirability Testing
Triading
3 related concepts or ideas
How/why one differs from the others
Qualitative Questionnaires
Statements
Answer based on the degree on which users agree/disagree
Quick Exposure Memory test
Expose the user to a UI on for a moment
The user is asked to recall what stood out most and why
Adjective Cards
Show the design
Have the user interact w/ the resource
Pick 3-5 cards that best capture their feelings
Concept Testing
Testing for the viability of an idea
Examples
Survey
Interview
Landing page
Concept Testing Questionnaire
Rate hypothetical products in categories...
Interest
Frequency
Value
Uniqueness
Likability
Believability
Confusion
Brand fit
Participatory Design
Narration
Creation
Priotorization
Contextual
User-centered design
Sessions
Conversations
Recorded
Data capture tools
Notes
Photos
Video
User sketches
Clear problem space and scenarios
At least 5 users
Guidelines
Select the users
Create the goals
Define what you konw
Identify methods to use
Decontextualized Tests and Heuristic Reviews
Don't involve the resource
Types
Card sorting
Open sorting
User creates categories
Closed sorting
Pre-defined categories
Guidelines
Distinguish btw parent and child categories
Provide blank cards and pens
Don't intervene
Accept that sometimes users don't group everything
Set time limits
User interviews
What are the 5 resources you use on a daily/weekly basis?
How do you proceed to find/evaluate a resource?
What do you like/dislike about the internet in general?
How do you describe an ideal exp. with a resource like ours?
Tasks
Direct
Instructional
Find this and that
Scenario
Real-life example
Closed
Defined success and failure
Open-ended
To be completed in several ways
Why UT?
support design decisions
Understand how human works
Checkbox on a list of product requirement
Devices
Website
Guidelines
Encourage users to behave naturally
Let the user complete their tasks the way they want
Test competitors or peer websites
Hide which site you are testing
Criteria
Task success
Navigability
UX design
Readability
Tools
Read-Able
WordsCount
CheckMyColours
Accessibility
Speed
Mobile
Moderated vs unmoderated
Moderated
Early stages in the development process
An advanced, complicated, high-level resource
Products w/ strict security concerns
Can be done remotely
Example: Evernote
Unmoderated
Benefits
Time savings
More natural usage
Cost savings
Simpler coordination
How
Recording of the on-screen interactions