Lecture

Bayesian Parameter Estimation

Related lectures (31)

Linear Regression: Statistical Inference and Regularization

Covers the probabilistic model for linear regression and the importance of regularization techniques.

Probabilistic Models for Linear Regression

Covers the probabilistic model for linear regression and its applications in nuclear magnetic resonance and X-ray imaging.

Sparse Regression

Covers the concept of sparse regression and the use of Gaussian additive noise in the context of MAP estimator and regularization.

Maximum Likelihood: Inference and Model Comparison

Explores maximum likelihood inference, model selection, and comparing models using likelihood ratios.

Bayesian Inference: Optimal Estimation

Explores optimal Bayesian inference, denoising, scalar estimation, and phase transitions.

Model Selection: AIC and BIC

Explores model selection using AIC and BIC criteria, addressing different questions and the importance of sparsity in selecting the best model.

Spin Glasses and Bayesian Estimation

Covers the concepts of spin glasses and Bayesian estimation, focusing on observing and inferring information from a system closely.

Maximum Likelihood Inference

Explores maximum likelihood inference, comparing models based on likelihood ratios and demonstrating with a coin example.

Bayesian Inference: Gaussian Prior for Mean

Discusses Bayesian inference for the mean of a Gaussian distribution with known variance, covering posterior mean, variance, and MAP estimator.

Dirichlet-Multinomial Model

Discusses the Dirichlet distribution, Bayesian inference, posterior mean and variance, conjugate priors, and predictive distribution in the Dirichlet-Multinomial model.

Probability and Estimation in Statistics

Introduces probability, estimation methods, linear models, testing, and advanced regression techniques.

Gaussian Process Regression: Probabilistic Linear Regression

Explores Probabilistic Linear Regression and Gaussian Process Regression, emphasizing kernel selection and hyperparameter tuning for accurate predictions.

Bayesian Estimation

Covers the fundamentals of Bayesian estimation, focusing on the application of Bayes' Theorem in scalar estimation.

Estimation, Shrinkage and Penalization

Covers estimation, shrinkage, and penalization in statistics for data science, emphasizing the importance of balancing bias and variance in model estimation.

Bayesian Inference: Beta-Bernoulli Model

Explores the Beta distribution, Bayesian inference, and posterior calculation in the Beta-Bernoulli model.

Linear Regression: Basics and Estimation

Covers the basics of linear regression and how to solve estimation problems using least squares and matrix notation.

Risk Estimation: Mallows' CL and Cp

Discusses optimism in risk estimation, effective degrees of freedom, and Mallows' CL and Cp for linear estimators.

Nonparametric Statistics: Bayesian Approach

Explores non-parametric statistics, Bayesian methods, and linear regression with a focus on kernel density estimation and posterior distribution.

Monte Carlo: Markov Chains

Covers unsupervised learning, dimensionality reduction, SVD, low-rank estimation, PCA, and Monte Carlo Markov Chains.

Machine Learning Fundamentals: Regularization and Cross-validation

Explores overfitting, regularization, and cross-validation in machine learning, emphasizing the importance of feature expansion and kernel methods.