Please enable JavaScript.

Coggle requires JavaScript to display documents.

Validity - Coggle Diagram

- - - - judged by multiple expert raters
    - - scores are influenced by irrelevant factors
      - construct-irrelevant difficulty
      - construct-irrelevant easiness
  - - - correlation between test and relevant criterion
      - .3 - .4 are seen as being adequate
      - squared - percentage of vacation in criterion that we can know based on test scores
      - how to evaluate validity coefficients
        
        changes in the test-criterion relationship?
        
        reliability and validity of the criterion?
        
        subject population in the validity study?
        
        sample size?
        
        not confuse criterion with predictor
        
        restricted range on predictor and criterion (correlation requires variability)
        
        can the evidence be generalized?
        
        differential prediction
  - - - measures of the same construct converge
    - - low correlation with unrelated constructs
    - - generalizability aspect
      - external aspect
        
        convergent or discriminant correlation with external variables
      - structural aspect
        
        internal structure of the assessment should match to what is known about the internal structure of the construct domain
      - consequential aspect
        
        what are the consequences?
        
        primary concern is to avoid any negative impact due to an assessment being invalid
      - substantive aspect
        
        process models, process engagement
        
        process representation of the construct
      - content aspect
        
        relevance and representativeness