Lecture

Self-Supervised Learning: State of the Art

Related lectures (30)

Landscape and Generalisation in Deep Learning

Explores the challenges and insights of deep learning, focusing on loss landscape, generalization, and feature learning.

Introduction to Machine Learning

Provides an overview of Machine Learning, including historical context, key tasks, and real-world applications.

Nonlinear Supervised Learning

Explores the inductive bias of different nonlinear supervised learning methods and the challenges of hyper-parameter tuning.

Supervised Learning Overview

Covers CNNs, RNNs, SVMs, and supervised learning methods, emphasizing the importance of tuning regularization and making informed decisions in machine learning.

Perception: Data-Driven Approaches

Explores perception in deep learning for autonomous vehicles, covering image classification, optimization methods, and the role of representation in machine learning.

Improving Models of the Ventral Visual Pathway

Explores computational models of the ventral visual system, focusing on optimizing networks for real-world tasks and comparing to brain data.

Unsupervised Learning: Clustering

Explores unsupervised learning through clustering techniques, algorithms, applications, and challenges in various fields.

Statistical Learning Theory: Conclusions on Deep Learning

Covers the conclusions on deep learning and an introduction to statistical learning theory.

Supervised Learning: Regression Methods

Explores supervised learning with a focus on regression methods, including model fitting, regularization, model selection, and performance evaluation.

Machine Learning Biases

Covers the basics of machine learning, challenges in deployment, adversarial attacks, and privacy concerns.

Deep Learning: Dimensionality and Data Representation

Delves into deep learning's dimensionality, data representation, and performance in classifying large-dimensional data, exploring the curse of dimensionality and the neural tangent kernel.

Self-supervised Learning for Autonomous Vehicles

Explores self-supervised learning for autonomous vehicles, deriving labels from data itself and discussing its applications and challenges.

Machine Learning: Supervised and Unsupervised Learning Techniques

Covers supervised and unsupervised learning techniques in machine learning, highlighting their applications in finance and environmental analysis.

Image Representation Insights

Explores the evolution of image representation, challenges in supervised learning, benefits of self-supervised learning, and recent advancements in SSL.

Brain Intelligence: Continual Learning of Representational Models

Delves into the continual learning of representational models in brain intelligence, emphasizing rapid adaptation to unstructured environments.

Machine Learning at the Atomic Scale

Explores simple models, electronic structure evaluation, and machine learning at the atomic scale.

Statistical Learning: Fundamentals

Introduces the fundamentals of statistical learning, covering supervised learning, decision theory, risk minimization, and overfitting.

Learning Sparse Features: Overfitting in Neural Networks

Discusses how learning sparse features can lead to overfitting in neural networks despite empirical evidence of generalization.

Deep Learning Modus Operandi

Explores the benefits of deeper networks in deep learning and the importance of over-parameterization and generalization.

Non-Conceptual Knowledge Systems: Style Transfer and Image Translation

Explores style transfer, image translation, self-supervised learning, video prediction, and image description generation using deep learning techniques.