What can we learn from model comparison exercises? Insights from the EU and US

What can we learn from model comparison exercises? Insights from the EU and US

🎙 IAEE 👥 1K 📅 January 15, 2026 ⏱ 62 min 👁 2 📄 expert opinion 🧭 2026-08-16
Available in: English (current) Français

Keywords

energy system modelingmodel intercomparisonstructural uncertaintycapacity expansionpolicy instruments

Summary

This webinar, organized by the IAEE, brings together three experts to discuss lessons learned from model comparison exercises in the energy sector. Matteo Giacomo Prina presents a framework for classifying and comparing energy system models, distinguishing between qualitative and quantitative approaches. He highlights the importance of comparing models, frameworks, and scenarios, and identifies that most studies focus on temporal resolution, with none exploring all four resolution fields simultaneously. Candise Henry then discusses a US-based benchmarking effort that compared four capacity expansion models using highly simplified scenarios. By harmonizing inputs and simplifying the system to a single node, the team was able to isolate structural uncertainties. Key findings include the impact of technology specification (e.g., baseload vs. dispatchable), storage state-of-charge constraints, battery efficiency application, and discount rate treatment on model outcomes. Oliver Ruhnau presents results from the German MODEX-POLINS project, which compared five European electricity market models to analyze the role of carbon pricing. The comparison revealed significant differences in model results, even with harmonized inputs, due to structural differences in model formulations. The webinar concludes with a discussion on the value of model comparison for improving transparency and robustness in policy analysis.

192 words

Critical Evaluation

Value of the Information & Strength of the Argument

The webinar provides valuable insights into the importance of model comparison exercises for energy policy analysis. Each speaker presents concrete examples from their research, demonstrating how structural uncertainties can lead to divergent results even when inputs are harmonized. The argumentation is solid, grounded in peer-reviewed studies and practical experience. The speakers effectively communicate the complexities of energy system modeling and the need for systematic comparison to enhance reliability. The discussion highlights both the benefits and challenges of such exercises, offering a balanced perspective.

Scientific Rigor, Source Quality, Title Accuracy

The webinar maintains a high level of scientific rigor, with each presentation referencing published research. The sources cited are credible and directly relevant to the topic. The title accurately reflects the content, which focuses on lessons learned from model comparison exercises in the EU and US. The presentations are well-structured and provide clear explanations of methodologies and findings. The inclusion of three different perspectives (framework classification, US benchmarking, and EU carbon pricing) adds depth and breadth to the discussion.

177 words

Title / Content Match

The title accurately reflects the content, which focuses on lessons learned from model comparison exercises in the EU and US.

Quality & Reliability

8/10

The webinar features three researchers presenting peer-reviewed studies on energy system model comparison. The content is based on published research and expert experience, with clear methodological explanations. However, as a webinar, it lacks the depth of a full paper and some claims are presented without detailed evidence.

Key Moments

Cited Sources

Concurring Sources

Contribution & Novelties

The webinar provides a comprehensive overview of recent model comparison exercises in the energy sector, highlighting both methodological frameworks and practical insights. It emphasizes the importance of distinguishing between parametric and structural uncertainties, and demonstrates how simplified scenarios can reveal hidden structural differences. The presentations offer concrete examples from the EU and US, showcasing the value of such exercises for improving model transparency and policy robustness.

Pour aller plus loin :

  • Energy system modeling — Provides background on the field and common modeling approaches.
  • Model intercomparison — Discusses the general concept of comparing models across disciplines.
  • Open Energy Modelling Initiative — A community promoting open-source energy models, relevant to the discussion on model transparency.
  • Capacity expansion planning — Explains the specific type of model used in the US benchmarking study.

130 words

Radar Profile

The radar profile shows high scores in information quantity, quality, and reliability, with a slightly lower technical level. This indicates a well-balanced presentation that is both informative and credible, though it may require some background knowledge to fully appreciate the technical details.

Reliability 8/10

💬 No comments were provided for analysis.