Please enable JavaScript.
Coggle requires JavaScript to display documents.
TASK 9 (Dawes (Actuarial/statistical method: human judge is eliminated and…
TASK 9
Dawes
Actuarial/statistical method: human judge is eliminated and conclusions rest solely on empirically established relations between data and the condition/ even of interest, other method is CLINICAL METHOD OF JUDGMENT
Combination: assume that the 2 methods work together harmoniously and often overlook the many situations which require dichotomous choices (if they agree, there is no need to combine them, if they disagree, one must choose one or the other)
-
-
Factors underlying actuarial superiority
Actuarial procedures (in contrast to human judges) always lead to the same conclusion for a given data set
When properly derived, the mathematical features of actuarial methods ensure that variables contribute to conclusions based on their actual predictive power and relation to the criterion of interest
random fluctuations in humans which decrease reliability and accuracy
Clinical judgements can produce ‘self-fulfilling prophecies’
-
Lack of impact: research on the differences between methods had little impact on everyday decision making
Goldberg Rule: distinction between neurosis and psychosis based on MMPI, decision rules through statistical analyses score below 45, neurotic patient; above 45, psychotic patient
- Compare accuracy of the rule to 29 judges who analysed same material (N=861)
o Judges: 62% correct decisions
o Decision rules: exceeded judges’ mean accuracy level
o Goldberg rule: similar to judges in 3/7 settings and modest to substantial advantage in 4/7 settings 70% correct decisions
-
Kleinmuntz
-
-
3 authors: Kleinmutz (pro combination of methods), Dawes (was only pro-actuarial method, but with exceptions), Meehl said that hybrid sucks
Streiner
2 different traditions:
- Statistical and psychometric reasons: psychologists prefer to measure phenomena along a continuum
- Many decisions are dichotomous in nature often use scales which lead to dichotomous outcome
-
-
Swets
-
-
- Construct ROC curve by plotting, for each potential threshold, the rate of true positives against rate of false positives
-
-
Arkes
Meehl’s controversy: statistical vs clinical, studies found that reliability of clinical judgements was low
-
Preconceived notions: drawing false relations due to prior associations - warp perception of correlation and impede accurate processing of an individual datum
- Implicit personality theory: most people think aggressive people are not likely to be friendly inferences about other traits from the one observed
when drawings were randomly paired with personality traits presumably characteristic of the person who did the drawing, subjects fabricated illusory correlations between drawing features and personality traits
Lack of awareness: attempts to eliminate bias are fostered by awareness of the own judgement process we do not really have awareness of the factors influencing our judgements
Overconfidence: of diagnosis, most confident diagnosticians tend to be the least accurate
- Treatment effects: as long as a group/ patient improves in performance for any reason, the therapist may attribute the improvement to the treatment administered (Hawthorne effect)
- Confirmation bias: people selectively seek evidence that confirms their hypothesis - People disregard information that contradicts their current judgement
- Providing more information to a judge as found to increase their confidence in the decision without necessarily increasing the accuracy of the decision
Hindsight bias: there is always enough evidence in a rich data source to nurture all but the most outlandish diagnosis
REDUCE
- Present people with 2 alternative questions have to make pro and con list for each of the 2 possible options then they chose one of the answers and stated confidence in correctness of choice (Koriat et al.) (eliminate overconfidence
- Reduce hindsight bias: ask subjects to explain why outcome A might have been expected from prior events and how alternative outcome B might be explained if it had occurred instead of A forcing one to consider B reduced the hindsight bias toward A
Reduce biases by entertaining alternative hypotheses for a long period of time active consideration of alternative
Decrease reliance on memory: fallibility of recall without access to list of symptoms actually occurring, one tends to remember the facts supportive of the hypothesis and forget the facts inconsistent with it
-
Grove
Meehl: focused on practical contexts in which predictions must be made immediately, based on then-available information argued that psychologists must choose between clinical and statistical methods and they should choose whichever method yields the most accurate prediction in long run
- There are various ways of gathering predictive data, such as interviews, direct observation, and psychometric tests. No matter how gathered, such data can be encoded or quantified
o These are mutually exclusive and exhaustive classes of ways to combine data; the relative value of these 2 classes is a meaningful question, whether the data to be combined come from interviews, Rorschach protocols, Minnesota Multiphasic Personality Inventory-2 (MMPI-2) profiles, or behaviour counts
- There is no true hybrid of these data combination methods
o Clinician can be given the output of a statistical formula or a formula can include a variable representing quantified clinician judgement the final prediction depends on trained judgement in former situation and not in latter
-
- When both clinical and statistical predictions are available for a given individual, they will not always agree, and then one cannot follow both
- Which data combination method is most accurate, for a given prediction problem, is a pragmatic question empirically answerable by running appropriate studies
Key features of the book
- Refuted the claim that it is not necessary to choose between the 2 approaches because the clinical-statistical antithesis is artificial
- Subtle analysis of clinical judgement: sympathetic to clinician’s potential for creative insight
o Example: broken-leg case
- Distinguished between data gathering and data combination focused on accuracy of methods for combining data
o Statistical predictions: actuarial, mechanical, formal, algorithmic
o Clinical predictions: informal, impressionistic, intuitive
- Box score: favouring strongly statistical methods instead of clinical prediction many only know this part of the book
Meadow
Bayes theorem might be easier for clinical if instead of quantitative probabilities, you use categorical
-
-