Lecture

The Conjugate Gradients Method (CG)

Related lectures (28)

Manopt: Optimization Toolbox for Manifolds

Introduces Manopt, a toolbox for optimization on manifolds, focusing on solving optimization problems on smooth manifolds using the Matlab version.

Optimization on Manifolds

Covers optimization on manifolds, focusing on smooth manifolds and functions, and the process of gradient descent.

RTR practical aspects + tCG

Explores practical aspects of Riemannian trust-region optimization and introduces the truncated conjugate gradient method.

Riemannian connections

Explores Riemannian connections on manifolds, emphasizing smoothness and compatibility with the metric.

Truncated Conjugate Gradients for Trust-Region Subproblem

Explores truncated conjugate gradients for solving the trust-region subproblem in optimization on manifolds efficiently.

Vectorization in Python: Efficient Computation with Numpy

Covers vectorization in Python using Numpy for efficient scientific computing, emphasizing the benefits of avoiding for loops and demonstrating practical applications.

Iterative Methods: Linear Systems

Covers iterative methods for solving linear systems and discusses convergence criteria and spectral radius.

Conjugate Gradient Method

Covers the Conjugate Gradient method for solving linear systems efficiently.

Linear Systems: Convergence and Methods

Explores linear systems, convergence, and solving methods with a focus on CPU time and memory requirements.

Jacobi and Gauss-Seidel methods

Explains the Jacobi and Gauss-Seidel methods for solving linear systems iteratively.

Differential Forms on Manifolds

Introduces differential forms on manifolds, covering tangent bundles and intersection pairings.

Vector Spaces and Linear Applications

Covers vector spaces, subspaces, kernel, image, linear independence, and bases in linear algebra.

Linear Transformations: Polynomials and Bases

Covers linear transformations between polynomial spaces and explores examples of linear independence and bases.

Linear Systems: Iterative Methods

Covers iterative methods for solving linear systems, including Jacobi and Gauss-Seidel methods.

Nonlinearity: Methods and Examples

Explores nonlinearity in numerical flow simulation, covering linearization methods and practical examples.

Computing the Newton Step: GD as a Matrix-Free Way

Explores matrix-based and matrix-free approaches for computing the Newton step in optimization on manifolds.

Linear Systems: Iterative Methods

Explores linear systems and iterative methods like gradient descent and conjugate gradient for efficient solutions.

Momentum methods and nonlinear CG

Explores gradient descent with memory, momentum methods, conjugate gradients, and nonlinear CG on manifolds.

Linear Independence and Basis

Explains linear independence, basis, and matrix rank with examples and exercises.

Regression & Systemed Lineaires

Covers the principles of regression and linear systems, focusing on iterative methods.