Please enable JavaScript.
Coggle requires JavaScript to display documents.
Regression - Coggle Diagram
Regression
Regression Tree
-
Leaf Nodes' Class
-
- Take the Y values of all observation in the leaf node
-
- Divide the sum by the # of observations in the leaf node
Split Rule
Splits are made using the sum of squared deviations (SSD) from the average outcome value at that node
-
- Calculate the avg. of the outcome values of all the data points in the node aka miu
- Take the Y value of each observation and subtract miu
-
-
-
-
-
-
-
k-NN
Basics
for a given observation, find the k-nearest neighbors
-
-
-
might use a weighted avg, with weight decreasing with distance
Steps
-
- pick the distance measure + should we normalize?
if yes, normalize first, compute distance second
-
-
- Compute the pairwise distance between new observation & all the rest
- Pick the k-nearest neighbor (shortest distance)
-
-
-
-