What is a posterior predictive check and why is it useful?

What is a posterior predictive check and why is it useful?

🎙 Ben Lambert 👥 148K 📅 May 15, 2018 ⏱ 11 min 👁 17K 📄 tutorial 🧭 2026-08-17
Available in: English (current) Français

Keywords

posterior predictive distributionBayesian p-valuemodel fitPoisson distributionnegative binomial

Summary

This video explains the concept of posterior predictive checks (PPCs) in Bayesian statistics. The presenter, Ben Lambert, starts by defining the posterior predictive distribution, which is the distribution of new data given observed data. He then describes how to approximate this distribution by sampling from the posterior and then from the likelihood. The core idea of PPCs is to compare the observed data with simulated data from the posterior predictive distribution to assess model fit. He illustrates this with a simple example: counting cars passing a point over time, modeled with a Poisson distribution and a gamma prior. Using Mathematica simulations, he shows how to compute a Bayesian p-value, which quantifies how often a summary statistic (like the maximum) from simulated data exceeds that from observed data. In his example, the maximum is replicated only 5% of the time, indicating poor fit for extreme values. He suggests that a negative binomial distribution might be more appropriate due to overdispersion. He concludes that PPCs are essential for model validation and should be tailored to the specific use of the model.

179 words

Critical Evaluation

Value of the Information & Strength of the Argument

The video provides a clear and practical introduction to posterior predictive checks, a crucial tool in Bayesian model validation. The value lies in its pedagogical approach: it explains the concept step-by-step, from the definition of the posterior predictive distribution to the computation of a Bayesian p-value. The argumentation is solid, as it uses a concrete example (car counts) and simulations to illustrate the process. The presenter correctly emphasizes that the choice of summary statistic for comparison depends on the model’s intended use, and he demonstrates how a poor fit can be detected. The explanation of why a Poisson model might fail (independence assumption) and the suggestion of a negative binomial alternative is theoretically sound. Overall, the video is informative and well-structured, making it a valuable resource for students and practitioners.

Scientific Rigor, Source Quality, Title Accuracy

The scientific rigor is high: the content is accurate and aligns with standard Bayesian methodology. The presenter is an academic, and the video is part of a lecture course based on his book. However, no external sources are cited in the video itself, and the description only provides links to the author’s website and a playlist. The title accurately reflects the content. The video is a tutorial, and the explanations are clear and precise. The use of simulation to illustrate the concept is appropriate and enhances understanding. The only minor weakness is the lack of explicit references to literature, but this is common in educational videos and does not detract from the overall quality.

259 words

Title / Content Match

The title accurately reflects the content, which explains posterior predictive checks and their utility.

Quality & Reliability

8/10

Clear explanation of a core Bayesian concept, with a concrete example and simulation. The presenter is an academic (Ben Lambert, lecturer in econometrics/statistics) and the content aligns with standard Bayesian methodology. No citations to external sources are given, but the material is well-established and accurately presented.

Key Moments

Cited Sources

Concurring Sources

Contribution & Novelties

The video provides a clear and accessible explanation of posterior predictive checks, a fundamental tool in Bayesian model checking. It emphasizes the practical importance of PPCs and demonstrates their application with a simple example, making the concept tangible. The novelty lies in its pedagogical clarity and the use of simulation to illustrate the Bayesian p-value.

Pour aller plus loin :

104 words

Radar Profile

The radar profile shows high scores in quality and reliability, with slightly lower scores in quantity and technical depth. This indicates a focused, well-explained tutorial that may not cover all advanced aspects but is solid for its purpose.

Reliability 8/10