Climate Co-Pilot: Scientifically Grounded Agents for Multimodal Earth Data | Salman Khan

Climate Co-Pilot: Scientifically Grounded Agents for Multimodal Earth Data | Salman Khan

Title history
  • Climate Co-Pilot: Scientifically Grounded Agents for Multimodal Earth Data | Salman Khan — observed on 20261104-0952 UTC (YouTube)
🎙 Salman Khan 👥 879 📅 November 4, 2026 ⏱ 23 min 👁 3 📄 original study 🧭 2026-11-04
Available in: English (current) Français

Keywords

TerraBenchEarthAlignAI agentsevidence graphEarth observation

Summary

The talk by Prof. Salman Khan presents the Climate Co-Pilot project, a collaborative research effort funded by ADIA Lab, aiming to build AI agents that can reason about Earth-system data for climate resilience decisions. The talk covers three main components: TerraBench, a benchmark of 403 tasks and 25,000 execution steps for evaluating LLM-based agents on Earth-science reasoning; TerraAgent, a ReAct-style framework with access to 77 tools; and EarthAlign, a foundation model trained on 554,000 samples to align ERA5 atmospheric fields with natural-language event descriptions. Results from TerraBench show that while state-of-the-art LLMs like GPT-5, Claude, and Qwen can plan workflows correctly about 60% of the time, their final scientific answers are only about 20% accurate, revealing a significant gap. EarthAlign demonstrates substantial improvements in aligning multimodal inputs with textual descriptions, with up to 30% absolute gains over zero-shot baselines. The talk also outlines future work on an EarthToken-based evidence graph to ensure claims are grounded in scientific evidence and can request additional information when needed. The project aims to bridge the gap between AI agents and scientifically sound reasoning in climate science.

182 words

Critical Evaluation

Value of the Information & Strength of the Argument

The value of the information is high, as it addresses a critical gap in using AI for climate science: the disconnect between workflow planning and scientifically accurate results. The argumentation is solid, supported by quantitative benchmarks and detailed examples, such as the Yolo County crop rainfall estimation where GPT-5 succeeded but Claude differed by 40×. The speaker clearly explains the limitations of current agents and motivates the need for better foundation models and evidence grounding. However, the talk is a progress report rather than a full research paper, and some claims about future work remain unsubstantiated at this stage.

Scientific Rigor, Source Quality, Title Accuracy

The scientific rigor is acceptable for a conference talk, with clear methodology and reproducible experiments (the code and models are claimed to be open source). The speaker cites no specific papers during the talk, but references the use of CLIP and SigLIP as baselines. The only concrete source is the symposium page linked in the description. The title accurately reflects the content, as the talk indeed presents agents and multimodal Earth data. The presentation is coherent and well-structured, though the absence of external citations limits verification of the claims made.

204 words

Title / Content Match

The title accurately reflects the content, focusing on scientifically grounded agents for multimodal Earth data.

Quality & Reliability

8/10

The talk presents novel research with benchmark results and quantitative comparisons, but it is an ongoing project without peer-reviewed publication yet.

Key Moments

Cited Sources

Contribution & Novelties

The talk presents an original contribution by introducing TerraBench and EarthAlign, which are new benchmarks and models for multimodal Earth data reasoning. The evidence graph concept is also novel in ensuring scientific grounding of AI agents. The work addresses a clear gap in current AI capabilities for climate science.

Pour aller plus loin :

  • Contrastive Language–Image Pre-training (CLIP) — Relevant as the foundation for EarthAlign’s alignment approach.
  • Large language model — Central to the agentic pipelines and reasoning cores discussed.
  • Knowledge graph — Related to the evidence graph concept for grounding claims.
  • ERA5 — The reanalysis dataset used in EarthAlign training.

101 words

Radar Profile

The scores indicate high technical depth and information quality, with slightly lower scores for quantity and reliability due to the ongoing nature of the research. The profile suggests a technically rigorous but not yet fully validated study.

Reliability 8/10