[ИАД, осень 2025] Байесовский выбор моделей. Лекция 2: Наивный Байес, Экспоненциальное семейство

[ИАД, осень 2025] Байесовский выбор моделей. Лекция 2: Наивный Байес, Экспоненциальное семейство

🎙 Machine Learning – Intelligent Systems 👥 8K 📅 September 21, 2025 ⏱ 85 min 👁 176 📄 lecture 🧭 2026-08-16
Available in: English (current) Français

Keywords

Bayesian inferenceNaive Bayes classifierKendall rank correlationmultiple testingexponential family

Summary

This is the second lecture in a course on Bayesian model selection, taught in Russian. The instructor begins by revisiting hypothesis testing, using a synthetic example about ham consumption to illustrate the concept of monotonic dependence and introduce Kendall’s rank correlation coefficient. He explains the derivation of the test statistic, its distribution under the null hypothesis, and the importance of using exact distributions for small sample sizes. The lecture then reviews multiple hypothesis testing, discussing the Family-Wise Error Rate and False Discovery Rate, and corrections like Bonferroni and Benjamini-Hochberg. The main focus shifts to the Naive Bayes classifier. The instructor derives it from Bayes’ theorem, emphasizing that the ’naive’ assumption is conditional independence of features given the class. He discusses practical issues such as estimating prior probabilities and the philosophical problem of using the same data for both prior and likelihood, suggesting solutions like data splitting or a full Bayesian treatment. Finally, he hints at the exponential family as a topic for future lectures.

164 words

Critical Evaluation

Value of the Information & Strength of the Argument

The lecture provides a solid theoretical foundation for Bayesian methods, with clear derivations and intuitive explanations. The instructor emphasizes understanding the assumptions behind methods, such as the conditional independence in Naive Bayes, and discusses the implications of violating these assumptions. The argumentation is rigorous, with mathematical proofs and references to statistical theory. The use of a synthetic example effectively illustrates the concepts, and the interactive Q&A format helps clarify potential misunderstandings.

Scientific Rigor, Source Quality, Title Accuracy

The lecture is scientifically rigorous, with accurate mathematical derivations and references to established statistical methods. The instructor mentions articles and papers, though specific citations are not provided in the video description. The title accurately reflects the content, as the lecture covers Bayesian model selection, Naive Bayes, and exponential family. The content is well-structured and appropriate for an advanced audience.

145 words

Title / Content Match

The title accurately reflects the content: a lecture on Bayesian model selection, covering Naive Bayes and exponential family, as part of a course on probabilistic methods.

Quality & Reliability

8/10

The lecture is mathematically rigorous, with derivations and explanations of key concepts in Bayesian statistics and hypothesis testing. The instructor engages with students, addressing questions and clarifying misconceptions. The content is well-structured and based on established statistical theory.

Key Moments

Contribution & Novelties

The lecture provides a comprehensive overview of Bayesian model selection, with a focus on the Naive Bayes classifier and its underlying assumptions. It bridges the gap between theoretical foundations and practical implementation, discussing issues like prior estimation and multiple testing corrections. The interactive format allows for deeper exploration of concepts.

Pour aller plus loin :

97 words

Radar Profile

The radar profile shows high scores in information quantity, quality, and technical level, indicating a dense and rigorous lecture. The fiabilite_globale is also high, reflecting the soundness of the statistical methods presented.

Reliability 8/10