Exhaustive Symbolic Regression, or how to find the best function for your data

Exhaustive Symbolic Regression, or how to find the best function for your data

🎙 Harry Desmond 👥 31K 📅 December 18, 2025 ⏱ 59 min 👁 463 📄 original study 🧭 2026-08-02
Available in: English (current) Français

Keywords

symbolic regressionexhaustive searchminimum description lengthgenetic algorithmcosmology

Summary

Harry Desmond presents Exhaustive Symbolic Regression (ESR), a deterministic method to find the best simple function for any dataset. He contrasts it with traditional genetic algorithms, which are stochastic and may miss optimal functions. ESR exhaustively enumerates all possible functions up to a complexity limit, then uses the Minimum Description Length (MDL) principle to rank them by balancing accuracy and simplicity in a unified information-theoretic metric. The method is guaranteed to find the optimal simple functions. Desmond demonstrates ESR on three astrophysical problems: cosmic expansion rate (H(z)) from chronometers and supernovae, galaxy dynamics to test modified gravity, and the inflaton potential in single-field inflation. The talk includes a detailed explanation of the algorithm’s steps, including tree generation and simplification, and discusses the advantages of symbolic regression for interpretability and reducing confirmation bias. The presentation is technical and aimed at an expert audience, with a focus on the methodology and its applications.

151 words

Critical Evaluation

The talk provides a compelling introduction to symbolic regression and presents a novel algorithm that addresses key limitations of existing methods. The speaker clearly explains the motivation: genetic algorithms are stochastic and may fail to find optimal functions, and the definitions of accuracy and complexity are often arbitrary. ESR offers a deterministic exhaustive search, which is a significant conceptual advance. The use of MDL to combine accuracy and simplicity into a single criterion is well-justified and provides a principled way to avoid overfitting. The applications to cosmology and galaxy dynamics are relevant and demonstrate the method’s utility. However, the talk is a seminar presentation, and the claims of exhaustiveness and optimality are not backed by peer-reviewed publications or independent verification in the video. The complexity of the algorithm and its computational feasibility for larger datasets are not discussed in detail. The speaker does not address potential limitations or failure modes of ESR, such as the choice of operator basis or the maximum complexity. Overall, the content is scientifically rigorous and well-presented, but the lack of external validation and the absence of a critical discussion of the method’s limitations slightly reduce its overall reliability. The title accurately reflects the content, and the talk is well-structured.

204 words

Title / Content Match

The title accurately reflects the content: the talk explains exhaustive symbolic regression and its applications to finding optimal functions for data.

Quality & Reliability

8/10

The talk presents a novel algorithm with a clear theoretical foundation (minimum description length) and demonstrates applications to real astrophysical datasets. The speaker is an established researcher, and the method is presented with technical detail. However, the talk is a seminar presentation without peer-reviewed publication details, and the algorithm's claims of exhaustiveness and optimality are not independently verified in the video.

Key Moments

Cited Sources

  • PySR — Mentioned as an example of a genetic algorithm for symbolic regression.
  • DataModeler — Mentioned as a Mathematica add-on for symbolic regression.
  • Operon — Mentioned as another genetic algorithm for symbolic regression.

Concurring Sources

  • PySR — A widely used symbolic regression tool that employs genetic algorithms, consistent with the talk's description of traditional methods.

Dissenting Sources

  • None — No discordant sources were mentioned in the video.

Contribution & Novelties

The talk introduces Exhaustive Symbolic Regression (ESR), a deterministic method that exhaustively searches function space, guaranteeing the discovery of optimal simple functions. This contrasts with stochastic genetic algorithms that may miss solutions. The use of Minimum Description Length (MDL) provides a principled way to balance accuracy and simplicity in a single metric, avoiding arbitrary choices. The method is demonstrated on real astrophysical datasets, showing its practical utility.

Pour aller plus loin :

112 words

Radar Profile

The radar profile shows high scores in quantity and quality of information, reflecting the detailed technical content and rigorous methodology. The technical level is high, indicating the talk is aimed at an expert audience. The overall reliability is strong, though not perfect due to the lack of peer-reviewed publication details in the video.

Reliability 8/10