Please enable JavaScript.
Coggle requires JavaScript to display documents.
Ch. 7 Decision Analytic Think I (Evaluating Classifiers (Classifier…
Ch. 7 Decision Analytic Think I
Evaluating Classifiers
To note
Harmless Negatives
uninteresting or benign
Bad positives
worthy of attention
Classifier Accuracy
Problems with Unequal Costs and Benefits
False negatives
costly mistake
pos. instance classified as neg.
False Positives
neg. instance classified as pos.
may dominate, less costly
cost benefit of each classifier
expected profit of classifier
measure of classifier performance
too simplistic
well known issues
Problems with unbalanced data
class distribution
unusual class can skew data
breaks down accuracy
Confusion Matrix
contingency table
shows how one class is confused for another
Expected Value
Framework for analytics
decompose data-analytic thinking
structure of a problem
elements of analysis that can be extracted
elements that need to be acquired
want value > 0
class priors
factor out the probabilities
Baseline performance
majority classifier
consider what is required from data mining results
regression problems
baseline: avg value over population
mean or median
decision stump
single most informative piece of info
base all decisions on it