Please enable JavaScript.
Coggle requires JavaScript to display documents.
AI Evaluation Criteria - Coggle Diagram
AI Evaluation Criteria
Risk
Internal risk to organization
Loss of control
incorrect decisions/assistance
Risk external to organization
Societal harm
Loss of control
Technical Requirements (mgmt not quite governance)
Performance outcomes achievability
Operational expectations
Reliability
Sustainabillity
Maintainability
Cost
To purchase/acquire
Cost to operate
Cost to maintain/sustain operations
Data storage/training/SME costs
Human in the Loop
Full autonomy - no human intervention enabled
Opt-in human intervention potential
Assistive capability (human in full control)
Bias
Biases in application
Bias in data collection
Bias in training data
Gender Skin Type Bias
Ethics
Whistleblower protections
What Got Timit Fired
Whistleblower capability
Discourse on Ethics
Accountability
Second Order Effects
Overseer obligations
Legal/Compliance
See Lessig stuff form Fred