Please enable JavaScript.
Coggle requires JavaScript to display documents.
Machine Learning - Coggle Diagram
Machine Learning
Cross Validation
N-Fold Cross Validation
10 Fold Cross Validation is commonly used
Leave One Out Cross Validation
Methods
Regression
Linear Regression
Ridge Regression
Lasso Regression
L1 Regression.
Can be useful while eliminating useless variables.
Elastic Net Regression
Starts with least squares method
Lasso and Ridge Regression are added later
Trees
Random Forest
Decision Trees
Impure
Measurements
Genie Impurity Test
1 - (probability of yes)^2 - (probability of no)^2
Weighted Average
Types of Data
Boolean
Numeric
Ranked
Multiple-Choice
Regression Tree
Parition
Calculate Average on both sides
Select partition which minimizes the sum of square errors wrt. the average on both sides
Each leaf represents a numeric value