Compositional Reasoning with Diffusion Models

Compositional Reasoning with Diffusion Models

🎙 Yilun Du (Harvard University) 👥 75K 📅 August 6, 2026 ⏱ 47 min 👁 259 📄 expert opinion 🧭 2026-08-08
Available in: English (current) Français

Keywords

diffusion modelsenergy-based modelsreasoningcompositionalityinference

Summary

Yilun Du presents a framework for using diffusion models and energy-based models for reasoning tasks beyond natural language. He argues that reasoning can be formulated as iterative inference on an energy function, where the model scores possible solutions and searches for low-energy states. He discusses training energy-based models via contrastive methods and Langevin dynamics, and highlights the connection to diffusion models. The talk covers how energy functions can be composed to solve complex tasks, and how inference-time compute can be scaled. He illustrates the approach with examples in symbolic reasoning and planning, and mentions recent results scaling contrastive training to ImageNet. The talk concludes with a discussion of future directions and potential applications.

113 words

Critical Evaluation

The talk provides a compelling and well-structured argument for using energy-based models and diffusion models for reasoning. The conceptual framework is clear, and the connection between energy-based models and diffusion models is well explained. The speaker demonstrates a deep understanding of the field and presents a coherent vision. However, the talk is largely conceptual and lacks detailed experimental evidence or comparisons with alternative approaches. The examples are illustrative but not exhaustive, and the claims about scalability are based on limited results. The sources cited are minimal, and the talk does not provide a comprehensive review of related work. The title is accurate, and the content is technically rigorous, but the presentation is more of an expert opinion than a systematic study. The discussion of compositional reasoning is particularly interesting, but the practical implementation details are not fully explored. Overall, the talk is valuable for researchers familiar with the field, but it may not be accessible to a broader audience. The lack of concrete benchmarks and comparisons limits the ability to assess the practical impact of the proposed methods.

178 words

Title / Content Match

The title accurately reflects the content, which focuses on using diffusion models for compositional reasoning.

Quality & Reliability

8/10

The talk is given by a recognized researcher (Yilun Du) at a prestigious venue (Simons Institute). It presents a coherent conceptual framework and references prior work, but lacks detailed experimental evidence and peer-reviewed citations in the talk itself.

Key Moments

Cited Sources

Concurring Sources

Contribution & Novelties

The talk presents a unified framework for reasoning using energy-based models and diffusion models, emphasizing compositionality and inference-time search. It suggests that energy functions can be composed to solve complex tasks, and that diffusion models can be interpreted as energy-based models. This perspective may inspire new approaches to reasoning in continuous domains.

Pour aller plus loin :

81 words

Radar Profile

The radar profile shows high scores across all dimensions, indicating a technically rich and reliable presentation. The talk is well-balanced, with strong quantitative and qualitative information, and a high level of technical detail.

Reliability 8/10