Lecture

Exploration Bias

Related lectures (30)

Covers stochastic gradient descent, linear regression, regularization, supervised learning, and the iterative nature of gradient descent.

Construction of Solutions by Dirichlet-Laplace

Explores the construction of solutions by Dirichlet-Laplace in general domains.

Supervised Learning with kNN: Regression Model

Covers a simple mathematical model for supervised learning with k-nearest neighbors in regression.

Financial Decision Making: Cost-Benefit Analysis in Projects

Covers financial decision making through cost-benefit analysis in public projects, focusing on investment viability and the implications of interest rates.

Gradient Descent on Two-Layer ReLU Neural Networks

Analyzes gradient descent on two-layer ReLU neural networks, exploring global convergence, regularization, implicit bias, and statistical efficiency.

Proximal Gradient Descent: Optimization Techniques in Machine Learning

Discusses proximal gradient descent and its applications in optimizing machine learning algorithms.

Generalized Linear Regression

Explores generalized linear regression, logistic regression, and multiclass classification in machine learning.

Architectural Processes: Non-linearity and Iteration

Covers the non-linear nature of architectural processes and the importance of iteration in project development.

Generalization Error

Explores generalization error in machine learning, focusing on data distribution and hypothesis impact.

Untitled

Linear Regression: Statistical Inference and Regularization

Covers the probabilistic model for linear regression and the importance of regularization techniques.

Regularization in Machine Learning

Introduces regularization techniques to prevent overfitting in machine learning models.

Gradient Descent: Linear Regression

Covers the concept of gradient descent for linear regression, explaining the iterative process of updating parameters.

Statistical Learning: Fundamentals

Introduces the fundamentals of statistical learning, covering supervised learning, decision theory, risk minimization, and overfitting.

Learning-aided Program Reasoning

Explores bug-finding, verification, and the use of learning-aided approaches in program reasoning, showcasing examples like the Heartbleed bug and differential Bayesian reasoning.

Gradient Descent

Covers the concept of gradient descent, a universal algorithm used to find the minimum of a function.

Machine Learning Fundamentals

Introduces machine learning basics, performance metrics, optimization techniques, and model evaluation.

Supervised Learning in Financial Econometrics

Explores supervised learning in financial econometrics, covering linear regression, model fitting, potential problems, basis functions, subset selection, cross-validation, regularization, and random forests.

Pizza Making Process

Covers the process of making pizza, sampling, averages, dispersion, residuals, and normal distribution.

Optimization in Machine Learning: Gradient Descent

Covers optimization in machine learning, focusing on gradient descent for linear and logistic regression, stochastic gradient descent, and practical considerations.