Please enable JavaScript.
Coggle requires JavaScript to display documents.
Optimization (Convexity (Set (Intersection Rule), Function (Convex…
Optimization
Convexity
Set
Intersection Rule
Function
Convex Operations
Vertices & Convex Hull
Solution at Gradient=0
Problems
Examples
Matrix Factorization
Clustering
K-Means
Classification
SVM
Types
Unconstrained
Optimization
First-Order
Optimization
Gradient
Descent
Standard
Line
Search
Exact
Backtracking
Learning Rate
High =>
Oscillations,
No convergence
Low =>
Slow convergence
Adaption
Distributed
MapReduce
1D Problems =>
Interval Bisection
Momentum
AdaGrad
Adam
Higher-Order
Optimization
Newton Method
Constrained
Optimization
Projected
Gradient Descent
Task:
min/max
Objective Function
Parameters/Variables
Domain/Constraints