Research Ch 17 - Validity & Reliability (Types of Reliability (Inter…
Research Ch 17 - Validity & Reliability
Explain reliability in the context of quantitative studies
Linked to the findings of research
ask whether the same results would be produced if research were to be repeated by different researcher at a different time using same method/ instrument
Is about the credibility of your research & it demands consistency.
Refers to the fact that different research participants being tested by the same instrument at different times should respond identically to the instrument.
Generalizability- reliability can be seen as the extent to which the results can be generalised and similar results obtained if the research was conducted again.
Types of Reliability
Inter-Rater or Inter-Coder:
-A measure of agreement.
-Different participants, but the same method, tool or instrument is administered.
-Measure of stability.
-Same participants but method/tool/instrument is administered at different times.
-Measure of equivalence
-Different participants, different method, tool or instrument is administered at the same time.
-Measure of equivalence
-Method, tool, instrument and split it into 2 equivalent halves. We correlate those scores together.
-Measure of how consistently each item measures the same thing.
-Correlate the performance on each item with the performance across participants.
:red_cross: All about determining whether the research measured what it was supposed to measure.
:red_cross: The extent to which the instrument that was selected actually reflected the reality of the constructs that were being measured.
-> Whether the research method or design will answer your question.
-> Ability to generalise findings from a specific sample to a larger population
Type of Validity
Content validity, sampling validity
-> Is the test representative?
-> Does the measurement represent the specific content?
-> Does the test look like what it is supposed to?
-> Is it well designed?
-> Does the test correspond to other variables? Does it measure what it is meant to?
-> Is there agreement between a theoretical concept & a specific measuring device or procedure?
Criterion-Related Validity; Instrumental Validity
-> Does the test accurately predict future behavior?
-> How accurate is the measurement or procedure when compared to another?
Participants' answers are not objectively measurable, since they are unique to each individual's experience.
Trustworthiness can be further divided into:
Accuracy with which the researcher interpreted the data.
Increased when researcher spends a long time with the participants.
Increased by making use of triangulation.
Increased when your findings are believable from the participants' perspectives.
Ability of findings to be applied to a similar situation and delivering similar results.
Degree to which results and analysis can be applied beyond a specific research project.
Quality of the process of integration that takes place between the data collection method, data analysis & the theory generated from data
How well data collected support the findings & interpretation of researcher.
How well findings flow from data
Other who look must come to similar conclusions as the researcher did.