Information Complexity || @ CMU || Lecture 24c of CS Theory Toolkit

Information Complexity || @ CMU || Lecture 24c of CS Theory Toolkit

🎙 Ryan O'Donnell 👥 14K 📅 July 7, 2020 ⏱ 28 min 👁 1K 📄 lecture 🧭 2026-08-17
Available in: English (current) Français

Keywords

information complexitycommunication complexitymutual informationdisjointnessamortized communication

Summary

This lecture from Carnegie Mellon’s CS Theory Toolkit introduces information complexity, a modern concept for analyzing communication complexity. The speaker begins by revisiting distributional communication complexity and then defines the information complexity of a protocol as the sum of the mutual information each party learns about the other’s input. He explains that the information complexity of a function is the infimum over protocols achieving a given error, and highlights its perfect additivity, analogous to entropy. This property is used to prove lower bounds on randomized communication complexity, particularly for the Disjointness problem. The lecture discusses choosing a hard distribution for Disjointness and sketches a proof of a linear lower bound using information complexity. Finally, it presents the amortized equivalence between communication complexity and information complexity, citing works by Maor, Gupta, and Braverman.

132 words

Critical Evaluation

Value of the Information & Strength of the Argument

The lecture provides a clear and insightful introduction to information complexity, a key concept in theoretical computer science. The argumentation is solid, building from definitions to theorems with intuitive explanations. The speaker connects information complexity to communication complexity and demonstrates its power in proving lower bounds, particularly for Disjointness. The discussion of choosing a hard distribution is instructive. The proof sketches are concise but convey the main ideas, and the speaker acknowledges where details are omitted.

Scientific Rigor, Source Quality, Title Accuracy

The lecture is scientifically rigorous, based on established literature (Cover & Thomas, Braverman) and the speaker’s expertise. The sources are mentioned in the description and are appropriate. The title accurately reflects the content. The speaker is careful to note where he is simplifying or omitting details, maintaining intellectual honesty.

140 words

Title / Content Match

The title accurately reflects the content: a lecture on information complexity within a CS theory course.

Quality & Reliability

8/10

Lecture by a renowned CS theorist, based on established literature (Cover & Thomas, Braverman), with rigorous mathematical definitions and proofs sketched. Minor imprecisions acknowledged by the speaker.

Key Moments

Cited Sources

  • Elements of Information Theory — Reference for information theory concepts
  • Slides and notes of Mark Braverman — Reference for information complexity
  • Ryan O'Donnell's homepage — Instructor's page
  • Course homepage on Diderot — Course materials
  • Thumbnail photo by Rebecca Kiger — Photo credit

Concurring Sources

  • Elements of Information Theory — Standard textbook on information theory
  • Slides and notes of Mark Braverman — Related lecture notes

Contribution & Novelties

This lecture provides a clear and accessible introduction to information complexity, a concept that has revolutionized communication complexity. It explains the definition, key properties, and applications, making it a valuable resource for students and researchers. The lecture also highlights the connection to amortized communication complexity, offering a deeper understanding of the topic.

Pour aller plus loin :

87 words

Radar Profile

The radar profile shows high scores in quality and technical level, with slightly lower but still strong scores in quantity and reliability. This indicates a dense, rigorous lecture that may be challenging for beginners but offers substantial depth.

Reliability 8/10