Please enable JavaScript.
Coggle requires JavaScript to display documents.
Chapter 18: comparing model pairs (Model Comparison (Dual Lift Chart…
Chapter 18: comparing model pairs
Model Comparison
Select two models from leaderboard, as well as, automaticaly select top model
Compares charts of two models
Subsequent chart orders are each algoithms predictions by probablity from high to low. 15 bins
cut off bins by % you need correct
In perfect chart there is dimmisioning returns
This means most algorithms will never be perfect,
chart random line does inded extend from the bottom left to the top right conner
Dual Lift Chart
calculated by subtracting the predictions made by the two models
differance is orderded lowest to highest and grouped into 15 buns with the smallest numbers to the left
blur color predicts the highest likelihood of readmission
model criteria
Predictive Accuracy
Prediction speed
speed to build model
familiarity with model
insights
decide what measuere is best for model case
accuracy comes at a cost of other criteria
find the optimizatio of the critera