Please enable JavaScript.
Coggle requires JavaScript to display documents.
Larsen Ch. 20 & 22 (Unlocking Holdout (it is first important to check…
Larsen Ch. 20 & 22
-
Unlocking Holdout
it is first important to check that there haven’t been any mistakes made in the model creation process. This is done by releasing the holdout data
The holdout sample provides an opportunity to check whether problems may have occurred. To release the holdout data, return to the leaderboard and click Unlock Holdout
click on the holdout column to re-sort the leaderboard by those scores. Observe the ranking differences between the Cross Validation and Holdout scores (it may be necessary to click between the two options a few times to see the patterns emerge). The best outcome would be one in which the order of models did not change between the two sorts
-
-
-
-
-