Concept

Conjugate prior

Related lectures (32)

Exponential Family: Maximum Entropy Distribution

Covers exponential families, maximum entropy, and Moxwell-Boltzmann distribution properties.

Discusses the Dirichlet distribution, Bayesian inference, posterior mean and variance, conjugate priors, and predictive distribution in the Dirichlet-Multinomial model.

Bayesian Estimation: Overview and Examples

Introduces Bayesian estimation, covering classical versus Bayesian inference, conjugate priors, MCMC methods, and practical examples like temperature estimation and choice modeling.

Bayesian Inference: Precision in Gaussian Model

Explores Bayesian inference for precision in the Gaussian model with known mean, using a Gamma prior and discussing subjective vs objective priors.

Sexing Guppy Fish: Bayesian Inference and Decision Rules

Covers the sexing of guppy fish using Bayesian inference and decision rules.

Linear Regression: Regularization

Covers linear regression, regularization, and probabilistic models in generating labels.

Gaussian Naive Bayes & K-NN

Covers Gaussian Naive Bayes, K-nearest neighbors, and hyperparameter tuning in machine learning.

Natural Cubic Splines: Optimization and Penalization

Explores the optimization and penalization of natural cubic splines, including roughness penalties and Bayesian inference.

Relevance Vector Machine: Addressing SVM Shortcomings

Introduces the Relevance Vector Machine as a sparse solution to SVM shortcomings.

Inference Problems & Spin Glass Game

Covers inference problems related to the Spin Glass Game and the challenges of making mistakes with preb P.

Bayesian Statistics: Hypothesis Testing and Estimation

Covers hypothesis testing, p-values, significance levels, and Bayesian estimation.

Bayesian Inference: Beta-Bernoulli Model

Explores the Beta distribution, Bayesian inference, and posterior calculation in the Beta-Bernoulli model.

Exponential Family: Properties and Estimation

Explores exponential families, Bernoulli distributions, parameter estimation, and maximum entropy distributions in statistical modeling.

Bayes Estimator: Definition and Application

Introduces the Bayes estimator, explaining its definition, application in quadratic cost scenarios, and importance in probabilistic reasoning.

Bayesian Inference: Optimal Decisions

Explores Bayesian inference for optimal decision-making in hypothesis testing scenarios.

Bayesian Inference: Gaussian Prior for Mean

Discusses Bayesian inference for the mean of a Gaussian distribution with known variance, covering posterior mean, variance, and MAP estimator.

Predictive Consistency: Sequential Forecasting Systems

Explores predictive consistency in sequential forecasting systems, emphasizing the utility of prediction over estimation and the significance of prequential approaches.

Bayesian Extremes: Markov Chain Monte Carlo

Explores Bayesian techniques for extreme value problems, including Markov Chain Monte Carlo and Bayesian inference, emphasizing the importance of prior information and the use of graphs.

Maximum Likelihood Estimation: Theory and Examples

Covers maximum likelihood estimation, including the Rao-Blackwell Theorem proof and practical examples of deriving estimators.

Gaussian Denoising: Statistical Physics Connection

Explores deriving key identities for statistical physics and their application in Gaussian denoising problems.