Concept

Sigmoid function

Related lectures (19)

Neural Networks: Learning Features & Linear Prediction

Explores neural networks' ability to learn features and make linear predictions, emphasizing the importance of data quantity for effective performance.

Advanced Triangulation: Gradient Maximization

Covers advanced triangulation problems related to gradient maximization.

Feedforward Neural Networks: Activation Functions and Backpropagation

Introduces feedforward neural networks, activation functions, and backpropagation for training, addressing challenges and powerful methods.

Logistic Regression: Cost Functions & Optimization

Explores logistic regression, cost functions, gradient descent, and probability modeling using the logistic sigmoid function.

Neural Networks: Multi-layers

Explains the learning process in multi-layer neural networks, including back-propagation, activation functions, weights update, and error backpropagation.

Monotonicity Criteria in Differentiable Functions

Explores monotonicity criteria, L'Hopital's rule, and Lipschitz continuity in differentiable functions and deep neural networks.

Vanishing Gradient Problem: Deep Learning

Discusses the vanishing gradient problem in deep neural networks and its solutions.

Linear Models for Classification

Explores linear models for classification, logistic regression, and gradient descent in machine learning.

Linear Classification: Signed Distance and Perceptron

Explores signed distance, perceptron, logistic regression, cross entropy, and multi-class classification.

Adversarial Training: Optimization and Applications

Explores adversarial training optimization, practical implementation, interpretability, fairness, Wasserstein distance, and Wasserstein GANs.

Linear Binary Classification

Covers the extension of the 0-1 loss to real-valued score functions and logistic regression.

Linear Models for Classification

Explores linear models for classification, logistic regression, decision boundaries, SVM, multi-class classification, and practical applications.

Linear Models for Classification: Part 3

Explores linear models for classification, including binary classification, logistic regression, decision boundaries, and support vector machines.

Neural Integral Equations: Modeling Real-World Systems

Explores Neural Integral Equations for modeling real-world systems using non-local functional equations and deep neural networks.

Gradient Descent: Optimization

Explains gradient descent for optimization and how to find the direction towards the solution by minimizing distances.

Generalized Linear Regression

Explores generalized linear regression, logistic regression, and multiclass classification in machine learning.

Neural Network Training

Covers the training process of a neural network, including feedforward, cost function, gradient checking, and visualization of hidden layers.

Feed-forward Networks

Introduces feed-forward networks, covering neural network structure, training, activation functions, and optimization, with applications in forecasting and finance.

Supervised Learning: Classification and Regression

Covers supervised learning, classification, regression, decision boundaries, overfitting, Perceptron, SVM, and logistic regression.