Please enable JavaScript.
Coggle requires JavaScript to display documents.
Research Methods M2 (Survey Research (Developing a Good Questionnaire…
Research Methods M2
Survey Research
-
Describes characteristics of a population, different populations, or groups within populations
-
-
Tests hypotheses, theories, and models
-
-
Item Order: Earlier items may affect answers on later items, avoid this by pretesting and writing new items separated by many other items to minimize the effect, if necessary. Filler items work too, and maybe give 2 different surveys with different item orders
Item Format
Open-Ended: Items that allow participants to answer questions in any way they see fit, guarantees high freedom of response
- great for preliminary/pilot research
- BUT May have off-topic responses, can be difficult to code
Close-Ended: Provide specific answers within the questions
- No off-topic answers
- BUT Answers are constrained
Multiple Choice
-
Multiple Response: Ask to select all answers that apply, or rank them in some way (more freedom)
Force Choice: Participants pick a single response that reflects their priority/belief/attitude out of a set of options
-
Scenarios: Can be any of the 3 above where participants read a paragraph about a situation and answer questions about how they would feel/react
Semantic Differential: Participants describe their feelings on a scale
- Not every number is labelled
Visual Analogue: Uses a straight line/slider with each end labelled that can be marked anywhere along it
Administering Survey
Internet Survey
- Self-selected samples; only participants interested in these do them
Face to Face Interview
- Personable interviews make participants more open
- Sensitive questions will still be difficult for people to answer
Paper & Pencil
- Can be tricky when asking sensitive questions
- Have to use anonymity because of this
Telephone Survey
- Popular before but people don't have house phones anymore
Response Sets: When respondents are cognitively lazy or feel uncomfortable answering truthfully, destroying construct validity
Fence Sitting: Participants consistently answer "neutral"
- Threatens construct validity because participants don't share their opinions
- Take away neutral options (forced choice) and maybe add an "I don't know box"
Socially Desirable Responding: Responding in a way that makes them appear good, avoiding judgement
- Solution: Social desirability test (ask questions where a certain answer might suggest dishonesty
- Also unconscious cues, like response times
Acquiescent Response Set: Participants consistently agree (yea-saying) or disagree (nay-saying) with little thought
- Solution: Reverse Scoring (Reversing item wording, causing participants to pay more attention; allows us to detect response sets)
Ask Questions people CAN answer
- People know what, not why
- Our memory isn't always accurate
- Basically, be careful with what you ask
Measurement: The process of systematically assigning values to represent attributes of organisms/events/objects
-
-
-
-
-
-
The process of measurement: Make a conceptual definition, concretize it, operationalize it, find a measurement method
Correlational research: Research that produces correlations in which we are interested in the associations between 2 variables
-
Pattern and Parsimony: Come up with a mechanism that could be responsible for a link between X and Y
- Specify a causal mechanism
- Test predictions
- pattern of results will support or fail to support the mechanism
often useful for when you have human correlational research (but no causation) or animal causal research (but generalization is questionable)
If you find consistent results, you can make a causal claim MUST SPECIFY THAT IT IS ONLY A CLAIM, NOT PROVEN
-
-
Types of Associations
-
-
Between Personal & Environmental Characteristics: Associations between personal and environmental characteristics of the same people
-
-
Measurement II
Reliability: The consistency of measures
- Must be established empirically
Inter-Rater: For behavioural measures where someone other than the participant observes behaviour and make judgments
- Might be low due to poor training/operationalization or bias
Internal: All items on a survey/questionnaire measure the same construct based on some form of self-report
Test-Retest: Measuring the same thing at two different times and correlating the scores
- Not necessarily a bad thing
-
-
-
Observational Research
-
-
Data Collection
Focal Sampling: Predetermined order in which you'll focus on each member of the sample - useful for many samples
Scan Sampling: Scan every person at predetermined intervals of time for something simple - useful for small/simple variables
-
-
Pitfalls
Causation: There's no random assignment and observations do not have temporal precedence, internal validity, or a high degree of association. Therefore, causation cannot be inferrred.
-
-