Please enable JavaScript.
Coggle requires JavaScript to display documents.
[Glance] Neural Network: Backpropagation - Coggle Diagram
[Glance] Neural Network:
Backpropagation
introduction to backpropagation
what is it
algorithm
training
Feedforward Neural Networks
why is it important
core foundation of common ANN
the main learning process is here
what it does
updates
weight & bias
How Backpropagation Works
Do
Feed-Forwarding
algorithm to calculate output vector given input vector
after it's done
calculate
Loss Function
backpropagates!
use
optimizer
to optimize
Loss Functions
what is it
function to calculate how much loss
MAE, etc
how it helps backpropagation
knows which weight/bias should be increased/reduced
we're interested only in 1 input, not all the others.
Optimizer
what is it
algorithm
a part of backpropagation
what is it used for
change attributes of ANN
changes weight and bias
example
Gradient Descent
Adam
Adagrad
AdaDelta
Nesterov Accelerated Gradient