Model Evaluation

What is confusion matrix?

The confusion matrix is a useful tool for determining how well your classifier recognizes tuples of various classes.

TP and TN indicate when the classifier is correct, whereas FP and FN indicate when the classifier is incorrect.

Accuracy & Error Rate

Error rate = FP + FN / TP + TN + FP + FN

Sensitivity & Specificity

Example of confusion matrix

Screenshot 2021-12-08 092105

Used for: Medical data, fraud detection

Significant majority of the negative class and minority of the
positive class

Classifier Accuracy = TP + TN / TP + TN + FP + FN

Precision and Recall

Precision: exactness

Recall: completeness


Precision = TP/(TP + FP)
= TP/P'

Sensitivity

F and Fß measures

Specificity

True Positive recognition rate: sensitivity = TP/P

F = 2 x precision x recall / precision + recall

Fß = (1 + ß^2) x precision x recall / ß^2 x precision + recall

True Negative recognition rate: sensitivity = TN/N

Screenshot 2021-12-08 091927

Recall TP/(TP+FN) = TP/P

MUHAMAD FARIS FARHAN BIN FAUZI - 2019579545

MUHAMMAD ISLAH HAKIMI BIN MOHD IDRIS - 2019361521

MUHAMMAD HAIKAL BIN MUHAMMAD JOHAN - 2019322189