Quasi-newton optimizationCovers gradient line search methods and optimization techniques with an emphasis on Wolfe conditions and positive definiteness.
Optimization MethodsCovers optimization methods without constraints, including gradient and line search in the quadratic case.
Matrix CalculusCovers matrix calculus, including determinants, matrix inversion, and solutions to systems of linear equations.
Nonlinear OptimizationCovers line search, Newton's method, BFGS, and conjugate gradient in nonlinear optimization.
Optimization MethodsCovers unconstrained and constrained optimization, optimal control, neural networks, and global optimization methods.
Vectors: Coordinate CalculationsCovers calculations in coordinates for vectors, including bases, scalar product, and determinants, with geometric interpretations and examples.
Numerical analysisCovers advanced numerical analysis topics including deep neural networks and optimization methods.
