Introducing Bayes factors and marginal likelihoods

Introducing Bayes factors and marginal likelihoods

🎙 Ben Lambert 👥 148K 📅 May 17, 2018 ⏱ 13 min 👁 37K 📄 tutorial 🧭 2026-08-17
Available in: English (current) Français

Keywords

Bayes factormarginal likelihoodBayesian model comparisonposterior oddsprior sensitivity

Summary

This video by Ben Lambert introduces Bayes factors and marginal likelihoods for Bayesian model comparison. It begins by framing model comparison as calculating posterior probabilities of models given data, using Bayes’ rule. The marginal likelihood of a model is defined as the denominator of Bayes’ rule for parameter inference, obtained by integrating the likelihood times the prior over parameters. The video explains that this integral is often high-dimensional and difficult to compute. The posterior odds of two models is expressed as the product of the Bayes factor (ratio of marginal likelihoods) and the prior odds. Lambert discusses several issues: computational difficulty of marginal likelihoods, their sensitivity to prior choices even when posteriors are unaffected, and the challenge of assigning prior probabilities to models. He also questions the arbitrary thresholds for interpreting Bayes factors. He concludes by echoing Andrew Gelman’s recommendation to use predictive accuracy measures like WAIC and cross-validation for model comparison, as they offer more nuance. The video is part of a lecture course and is suitable for those with basic Bayesian knowledge.

174 words

Critical Evaluation

Value of the Information & Strength of the Argument

The video provides a solid introduction to Bayes factors and marginal likelihoods, clearly explaining their role in Bayesian model comparison. It highlights key computational and conceptual challenges, such as the difficulty of high-dimensional integration and sensitivity to priors. The argumentation is coherent and well-structured, building from basic Bayes’ rule to the definition of Bayes factors. Lambert’s critical perspective, referencing Andrew Gelman, adds value by presenting alternative approaches like WAIC and cross-validation. However, the video does not delve into advanced methods for computing marginal likelihoods (e.g., bridge sampling, nested sampling), which could be a limitation for viewers seeking deeper technical insight. Overall, the content is informative and thought-provoking, but it remains at an introductory level.

Scientific Rigor, Source Quality, Title Accuracy

The video is scientifically rigorous in its explanations, but it lacks explicit citations to academic sources. The presenter, Ben Lambert, is an academic and author of a Bayesian statistics textbook, which lends credibility. The description includes links to his website and a lecture playlist, but no direct references to specific papers. The title accurately reflects the content. There are no comments provided to analyze.

193 words

Title / Content Match

The title accurately reflects the content, which introduces Bayes factors and marginal likelihoods.

Quality & Reliability

8/10

The video is a clear, well-structured tutorial by an academic (Ben Lambert) with a book on Bayesian statistics. It explains concepts accurately, but lacks formal citations and does not provide references to peer-reviewed sources.

Key Moments

Cited Sources

Concurring Sources

Contribution & Novelties

This video provides a clear and accessible introduction to Bayes factors and marginal likelihoods, emphasizing their computational challenges and sensitivity to priors. It offers a critical perspective by suggesting alternative model comparison methods like WAIC and cross-validation, aligning with modern Bayesian practice. The video is valuable for students and practitioners seeking to understand the foundations of Bayesian model comparison.

Pour aller plus loin :

119 words

Radar Profile

The radar profile shows high scores in information quantity, quality, and reliability, with a slightly lower technical level. This indicates a well-balanced introductory tutorial that is both informative and trustworthy, though not highly advanced.

Reliability 8/10