Model Evaluation
What is confusion matrix?
The confusion matrix is a useful tool for determining how well your classifier recognizes tuples of various classes.
TP and TN indicate when the classifier is correct, whereas FP and FN indicate when the classifier is incorrect.
Accuracy & Error Rate
Error rate = FP + FN / TP + TN + FP + FN
Sensitivity & Specificity
Example of confusion matrix
Used for: Medical data, fraud detection
Significant majority of the negative class and minority of the
positive class
Classifier Accuracy = TP + TN / TP + TN + FP + FN
Precision and Recall
Precision: exactness
Recall: completeness
Precision = TP/(TP + FP)
= TP/P'
Sensitivity
F and Fß measures
Specificity
True Positive recognition rate: sensitivity = TP/P
F = 2 x precision x recall / precision + recall
Fß = (1 + ß^2) x precision x recall / ß^2 x precision + recall
True Negative recognition rate: sensitivity = TN/N
Recall TP/(TP+FN) = TP/P
MUHAMAD FARIS FARHAN BIN FAUZI - 2019579545
MUHAMMAD ISLAH HAKIMI BIN MOHD IDRIS - 2019361521
MUHAMMAD HAIKAL BIN MUHAMMAD JOHAN - 2019322189