Please enable JavaScript.

Coggle requires JavaScript to display documents.

testing and assessment - Coggle Diagram

- - - - Domain-Sampling Model
        
        Generalisbility theory
      - Observed Score = True Score + Error
    - - Standard Deviation
      - Reliability Coefficient
        
        Pearson's r
        
        The proportion of variance that is due to true score variance
    - - Calculating Reliability
        
        Split-half reliability
        
        Odd-Even
        
        Cronbach's Alpha (Coefficient Alpha)
        
        For Continuous Scale Measures (i.e Likert-Type Data)
        
        Equivalent forms
        
        Kuder-Richardson 20 & 21
        
        For Dichotomous Data
      - Spearman-Brown Prophecy Formula
        
        Gives number of items needed to bring a test up to a specified level of reliability
    - - Idiosyncratic Individual Characteristics
        
        State
        
        Trait
        
        General
        
        Specific
      - External factors
        
        Lighting
        
        Computer internet connection
      - Systematic Errors
        
        Affect validity but not reliability
        
        Idnetifiable
        
        Skew test scores
      - Unsystematic Errors
        
        Inconsistent effect on test scores
  - - - Factor Analysis
        
        Rotation
        
        Orthogonal
        
        Oblique
        
        Exploratory Factor Analysis
        
        Principal Components Analysis (PCA)
        
        Principal Axes Factor Analysis (PAF)
        
        Confirmatory Factor Analysis
    - - Convergent Validity
      - Divergent/Discriminant Validity
      - MultiTrait-MultiMethod (MTMM) Approach
    - - Concurrent
      - Predictive Validity
        
        Incremental Validity
      - Regression Analysis
        
        Least Squares Solution
        
        Standard Error of Estimate
        
        Estimation of accuracy of any predictions
      - Decision Theory
        
        Cutting Point
        
        Valid Positive
        
        Valid Negative
        
        False Positive
        
        False Negative
        
        Base Rate
        
        Selection Ratio
      - Considerations
        
        Temporal Stability
        
        History Events
        
        Confounding Variables
- - - - Diagnostic
      - Used to identify skills or problems
    - - Linear Transformation
        
        Z Transformation
        
        Z-score
        
        ( x - mean )/SD
        
        Z distribution
        
        M = 0, SD = 1.0
        
        IF (+)Z, x is above average
        
        IF (-)Z, x is below average
      - Nonlinear Transformation
        
        Percentiles
        
        Advantages
        
        easy to calculate and understand
        
        Universally applicable
        
        Disadvantages
        
        Marked inequality toward extremes
        
        Specific to sample/population used
        
        Nontransformative
        
        The specific scores within a distribution, below which a defined percentage of scores fall
        
        Percentile Rank
        
        Percentage of cases below the percentile
        
        Quartiles, Deciles, Stanines
  - - - Random Sampling
        
        Stratified
        
        Proportional
      - Nonrandom Sampling
    - - Within-group Norms
      - Developmental Norms
        
        Relative Group Norms
        
        Grade Level Equivalents
        
        Grade Norms
- - - - Written Statement of the Attribute or Construct in Question
        
        Information about the Conditions under which the test shall be applicable
    - - NOIR
    - - Plan For Item Writing
        
        Plan of the Number and Type of Items that are Required for the Test, As Indicated by the Specification
      - Item Writing
        
        Length
        
        Vocabulary
        
        Wording
      - Empirical Approach
        
        Cattell 16PF
        
        MMPI
      - Rational-Empirical Approach
        
        A way of constructing psychological tests that relies on both reasoning from what is known about the psychological construct to be measured in the test, and collecting and evaluating data about how the test and the items that comprise it actually behaves when administered to a sample of respondents.
      - Item Content
    - - Factor Analysis
  - - - Test Construction
        
        Item Writing
        
        Scale Construction
        
        Response Sets
        
        Selection of Test Format
    - - Standardisation of Test
        
        Norming
        
        Reliability
        
        Validity
    - - Revision of Test
        
        Available Norms
        
        Item Content
- - - - Frequency
        
        Behavioural Observation Scale (BOS)
      - Magnitude
        
        Graphic Rating Scale (GRS)
        
        Behaviourally Anchored Rating Scale (BARS)
  - - - Self-Directed Search (SDS)
      - Strong Interest Inventory
      - Low predictive validity for Job Performance
  - - - Wonderlic Personnel Test
      - ACER
        
        General Select Test
        
        Professional Select Test
        
        Short Clerical Test
    - - Knowledge
      - Skills
      - Abilities
      - Other characteristics
    - - Structured
      - Unstructured
    - - Past Activites, Interests, Hobbies, Achievements
    - - General Mental Ability
      - Reasonable Predictor
      - Poor Predictor
        
        Education
        
        Possible Selection Bias (Job Requirements create Artificial Restriction)
      - Combination
        
        GMA + Integrity Test
        
        Composite Validity .65
        
        GMA + Structured Interview
        
        Composite Validity .63
- - - - Factor Analytic Theories
        
        Multifactor Theories
        
        Thorndike
        
        Multifactor Theory (1927)
        
        Social
        
        Concrete
        
        Abstract
        
        Thurstone
        
        Group Factors Theory
        
        Verbal Comprehension
        
        Word Fluency
        
        Number
        
        Space
        
        Associative Memory
        
        Perceptual Speed
        
        Reasoning
        
        Primary Mental Abilities
        
        Guildford
        
        Structure of Intellect
        
        Operations
        
        Cognition
        
        Memory
        
        Divergent Production
        
        Convergent Production
        
        Evaluation
        
        Contents
        
        Products
        
        Cattell & Horn
        
        Two-factor Theory of Intelligence
        
        Fluid Intelligence (Gf)
        
        Crystallised Intelligence (Gc)
        
        Theory of Broad Factors
        
        Theories Delineating General and Specific Factors
        
        Spearman
        
        General Mental Ability (g)
        
        Specific ability (s)
        
        Measurement Errors (e)
        
        Vernon
        
        Hierarchical Model
        
        General Factor
        
        Verbal-Education
        
        3 more items...
        
        Spatial-Motor
        
        3 more items...
        
        Carroll
        
        Three Strata Hierarchical Model of Intelligence
      - Kevin McGrew's Cattell-Horn-Carroll (CHC) Theory of Intelligence
        
        General Ability g
        
        Domain-Independent General Capacities
        
        Fluid Reasoning
        
        Memory
        
        Speed of Processing
        
        Acquired Knowledge System
        
        General Knowledge
        
        Reading and Writing
        
        Quantitative Knowledge
        
        Sensory/Motor Linked Abilities
        
        Visual Processing
        
        Auditory Processing
        
        Olfactory
        
        Tactile and Motor Abilities
    - - PASS Cognitive Processing Theory
        
        Planning
        
        Executive Functioning
        
        Planning and Monitoring Behaviour
        
        Self-regulation
        
        Attentional-Arousal
        
        Maintaining sustained attention
        
        Resisting Distraction
        
        Simultaneous Processing
        
        Integrating Stimuli into a Coherent Whole
        
        Successive Processing
        
        Dealing with Information that is Sequentially Ordered
    - - Sternberg''s Triarchic Theory of Intelligence
        
        Componential Intelligence (Analytic Abilities)
        
        Metacomponents
        
        Performance Components
        
        Knowledge-Acquisition Components
        
        Experiential Intelligence (Creative Abilities)
        
        Handling Novel Situations
        
        Generating Novel Ideas
        
        Contextual Intelligence (Practical Abilities)
        
        Adaptation to Environment
        
        Shaping Environment
        
        Selecting Environment
    - - Schema Development
        
        Assimilation
        
        Accommodation
      - Cognitive Development Theory
        
        Sensorimotor (Birth-2yr)
        
        Pre-operational (2-6)
        
        Concrete Operational (7-12)
        
        Formal Operational (12+)
      - Concept Assessment Kit - Conservation Ability Test
  - - - Binet-Henri (1895)
        
        Binet-Simon (1908)
        
        Stanford-Binet (1916)
        
        5th Ed. (2003)
        
        Reintroduced Age Scales
        
        Balance of Verbal and Non-Verbal Items
        
        1 more item...
        
        Stanford-Binet 1937 Weaknesses
        
        Emphasises single score reflecting intelligence
        
        Ignores role of non-intellectual factors
        
        Item bias towards children
        
        Overemphasis on speed
        
        Mental Age norms ill-applicable to adults
        
        Did not consider performance deteriorated with age
    - - Weschler-Bellevue (1939)
        
        Variants
        
        Weschler Preschool and Primary Scale of Intelligence (WPPSI-III)
        
        Ages 2-6
        
        Unique Subtests
        
        New Composites
        
        Compatible with Adaptive Behaviour Assessment System, WIAT-II, and Differential Abilities Scale
        
        Weschler Intelligence Scale for Children (WISC-V)
      - View of Intelligence
        
        Aggregate or Global Capacity of the Individual to Act Purposefully, to Think Rationally, and to Deal Effectively with Their Environment
        
        Aggregate
        
        Composed of different elements or abilities that are qualitatively different
        
        Global
        
        Characterises individual's behaviour as a whole
    - - Test Bias
        
        Systematically favouring one group over another
      - Flynn Effect
        
        Observed steady increase in scores on IQ tests since about the 1930s
        
        Use up-to-date test
      - Age Differences
        
        Use correct scale for age
      - Cultural Differences
        
        May also be affected by SES
      - Controversy
        
        Attempting to use tests to infer genetic makeup
        
        Eugenics
- - - - Rorschach Inkblot Test
        
        Low Interrater Reliability
        
        Low Predictive Validity
        
        Exner Rating System
  - - - Early Relationship with Signficant Others
        
        Dynamisms
    - - Agency
        
        Dominance
        
        Submission
      - Communion
        
        Warmth
        
        Coldness
      - Measured in circumplex
        
        Wiggin's Interpersonal Adjective Scales (IAS)
  - - - Needs
        
        Conscious
        
        Unconscious
        
        Thematic Apperception Test (TAT)
      - Presses
  - - - Person Variables
        
        Competencies
        
        Skills and Abilities
        
        Encoding Strategies
        
        Expectancies
        
        Self-efficacy
        
        Values
        
        Self-Regulatory Systems and Plans
  - - - Openness
      - Conscientiousness
      - Agreeableness
      - Extraversion
      - Neuroticism
    - - Allport and Odbert 4.5k item pool
        
        Raymond Cattell
        
        16PF
        
        16PF5e (1993)
    - - Eysenck Personality Questionnaire (EPQ)
        
        Neuroticism
        
        Psychoticism
        
        Extraversion
      - Markon et al 2005
    - - NEO
        
        Neuroticism
        
        Extraversion
        
        Openness
        
        NEO-PI-3 (2005)
    - - IPIP-NEO
  - - - Minnesota Multiphasic Personality Inventory (MMPI)
        
        Criterion Keying
        
        MMPI2-RF (2008)
        
        Validity Scales
        
        Random/Inconsistent
        
        Faking Good
        
        Faking Bad
  - - - What Do We Know When We Know Someone?
        
        Level 1
        
        Dispositions
        
        Level 2
        
        Characteristic Adaptations, Desires, Beliefs, Concerns, Coping Mechanisms
        
        Level 3
        
        Life Stories (Narrative Identity)
  - - - Flow
        
        The Flow Questionnaire
    - - Q-sort
    - - Values in Action Inventory of Strengths
- - - - Diagnosis and Treatment of Psychological Conditions
      - Client-Focused
      - Psychologist and Client Share Goal of Therapeutic Change
      - Client Information Assumed to be Reliable
    - - Assist Decision Makers in Legal/Criminal Justice System
      - Objective or Quasi-Objective Focus
        
        May serve an individual client, a lawyer, or the court
      - Client Information Not Assumed to be Reliable
  - - - MacArthur Competence Assessment Tool - Criminal Adjudication (MacCAT-CA)
        
        Alpha = .81 - ,88
        
        Interrater = .75 - .90
        
        Not for use on people under IQ 60
      - Limitation
        
        Different legal systems have different standards for competency
        
        A test designed to mirror US legal standards may not be transferable to Australian context
      - Competency Screening Test
    - - Clinical Judgement
        
        Interview
        
        Structured
        
        Unstructured
      - Actuarial methods
        
        Generally perform better than clinical methods
        
        Assessing risk based on tests developed specifically to predict future criminal behaviour of offenders
      - Static-99
        
        Developed by Hanson & Thornton, 2000
        
        Designed for use on male sex offenders
        
        Reeves, 2018
        
        Scoring high on static risk factors may prompt further investigation
        
        Stable-2007
        
        Acute-2007
      - Hare's Psychopath Checklist - Revised (PCL-R)
        
        Alpha = .85
        
        Interrater = .84 - .97
      - Violence Risk Appraisal Guide
        
        For predicting violent recidivism among adult males
      - Youth Level of Service Inventory / Case Management Inventory / Juveline Sex Offender Assessment Protocol Verse II
  - - - Crimes against the Public or the Crown
    - - Conflicts between Individuals and/or Organisations
    - - Conflicts within Families or between Partners in Married or De Facto Relationships
      - Predominantly Evaluations related to Child Custody
        
        Custody Evaluation
        
        Clinical Interviewing
        
        Formal Tests
        
        Ackerman-Schoendorf Scales of Parental Evaluation of Custody Test (ASPECT)
        
        Interrater = .96
- - - - Verbal Comprehension
        
        Core
        
        Similarities
        
        Vocabulary
        
        Information
        
        Supplementary
        
        Comprehension
      - Processing Speed
        
        Core
        
        Symbol Search
        
        Coding
        
        Supplementary
        
        Cancellation
      - Perceptual Reasoning
        
        Core
        
        Block Design
        
        Matrix Reasoning
        
        Visual Puzzles
        
        Supplementary
        
        Figure Weights
        
        Picture Completion
      - Working Memory
        
        Core
        
        Digit Span
        
        Arithmetic
        
        Supplementary
        
        Letter-Number Sequencing
- - - - AD
    - - Ischemic
      - Hemorrhagic
    - - Open
      - Closed
    - - Primary
      - Secondary
    - - Focal
      - Generalised
      - Symptomatic
      - Idiopathic
    - - Meningitis
      - Encephalitis
  - - - Neuroimaging
      - Neuropsychological Battery
        
        Halstead-Reitan (HRNB)
        
        Luria-Nebraska
        
        269 Items
        
        11 Subsections
        
        Pathognomonic Scale
        
        Left-Hemisphere Dysfunction
        
        Right-Hemisphere Dysfunction
    - - Sensorium
        
        HRNB
      - Attention
        
        Attention Span
        
        WAIS-IV Digit Span
        
        Focused Attention
        
        Trail Making Task
        
        Selective Attention
        
        Stroop Colour-Word Interference Test
      - Memory and Learning
        
        HRNB
        
        Luria-Nebraska
        
        Weschler Memory Scale
        
        RANDT Memory Test
        
        California Verbal Learning Test (CVLT)
      - Language
        
        HRNB
        
        Western Aphasia Battery Revised (WAB-R)
      - Visuospatial Function
        
        Hooper Visual Organisation Test
        
        WAIS-IV
      - Executive Functions
        
        Tower Tests
        
        Delis-Kaplan Executive Function System (D-KEFS)
        
        Qualitative Observations
        
        Strategy Use
        
        Perseverations
        
        Slowing
      - Motor Functioning