Please enable JavaScript.
Coggle requires JavaScript to display documents.
week8 - Coggle Diagram
week8
neural network in 5 miutes
neural network
propagation
back
forward
applications
forecasting
music composition
facial recognition
layers
input
hidden
output
concept
inspired by the structure of the human brain
machine learning>deep learning >neural network
big names
AMAZON
GOOGLE
NVIDIA
activation functions in a neural network explained
activation functions
function
S(x)=e^x/e^(x+1)
f(x)=max(0,x)
code
concept
defines the output of that neuron given a set of inputs
biologically inspired by activity in our brain
what is backpropagation really doing?
backpropagation
adjustment
increase the weights (wi)
change the activations (ai)
increase the bias (b)
Hebbian theory
neurons that fire together wire together
concept
algorithm for computing that crazy complicated gradient
step
mini-batches
compute gradient descent step(using backprop)
database
MNIST
