Please enable JavaScript.
Coggle requires JavaScript to display documents.
Chapters 22 & 23 (Create Model Monitoring and Maintenance Plan…
Chapters 22 & 23
Create Model Monitoring and Maintenance Plan
Potential problems
tell others what to do in case circumstances change and hurt the model's performance
detect when the model has deteriorated and how to retrain
example the data changes
Strategies
DR will fail telling you that something is wrong (rather than running with bad data)
avoid model failures by rerunning the model once new data is available
early detection is important
find declining performances by running the train vs test data again
this approach doesn't require waiting for target data
Document Modeling Process for Reproducibility: Model Documentation
part where projects most often fail
documentation is important for others to understand your process and give the project justification
make careful notes about the business purpose
document where data came from
know exact queries and any access codes needed
specify all steps taken
record business rules for use of the model