Former Google Researcher Makes a MASSIVE AI Discovery

Former Google Researcher Makes a MASSIVE AI Discovery

Title history
  • Former Google Researcher Makes a MASSIVE AI Discovery — observed on 20261115-1138 UTC (YouTube)
🎙 Tech Meets East 👥 25K 📅 November 15, 2026 ⏱ 28 min 👁 15 📄 documentary 🧭 2026-11-15
Available in: English (current) Français

Keywords

transformerAI researchSakana AILlion Jonesself-improving

Summary

The video tells the story of Llion Jones, a co-author of the seminal ‘Attention is All You Need’ paper that introduced the transformer architecture. After leaving Google, he founded Sakana AI in Tokyo with David Ha, aiming to explore unconventional AI approaches inspired by nature, such as swarm intelligence and evolution. The documentary highlights three major discoveries from Sakana: the AI Scientist, an automated system that can generate and validate research papers, which passed a workshop review; the Continuous Thought Machine, a neural network with temporal dynamics that shows planning behavior; and self-improving systems like the Darwin Godal machine, which rewrites its own code. It also discusses the surrounding controversy, including reward hacking incidents and critiques of the AI Scientist’s quality. The narrative contrasts Jones’s philosophy of open-ended research with the mainstream focus on scaling transformers, culminating in a boxing debate between Jones and Łukasz Kaiser. Ultimately, the video presents a nuanced view of the future of AI, suggesting that the next breakthrough may come from automated or radically different architectures.

171 words

Critical Evaluation

Value of the Information & Strength of the Argument

The video provides substantial value by synthesizing multiple cutting-edge AI research projects and connecting them to the broader context of AI development. It offers a compelling argumentation for the need to move beyond transformers, using the ’local minimum’ metaphor and historical parallels. The argument is strengthened by including both supporting evidence and critical perspectives, such as the independent evaluation of the AI Scientist and the reward hacking incident. The narrative is well-structured, building from the transformer’s origin to Sakana’s innovations and the ensuing debate. However, some claims lack direct citations, and the argumentation occasionally relies on rhetorical appeal rather than rigorous proof.

Scientific Rigor, Source Quality, Title Accuracy

The video demonstrates reasonable scientific rigor by referencing specific papers and events, including publications in Nature and NeurIPS. It accurately recounts the ICLR workshop acceptance and the subsequent withdrawal, and it cites critical evaluations from other researchers. The title is appropriate and captures the essence of the content. However, the source has minor inaccuracies in names (e.g., ‘Lean Jones’ for Llion Jones, ‘Yakob Ushkarite’ for Jakob Uszkoreit) and presents some speculative claims as fact. The lack of explicit URLs or direct citations limits verifiability, though the overall narrative aligns with known AI developments. No comments were provided, so public reception cannot be assessed.

220 words

Title / Content Match

The title accurately reflects the content, focusing on a former Google researcher's discoveries and his work at Sakana AI.

Quality & Reliability

8/10

The video is well-researched, citing specific papers and events, but contains minor spelling errors in names (e.g., Llion Jones as 'Lean Jones') and relies on a single narrative. The source has very low viewership and no engagement, though the content appears credible based on the detail and alignment with known AI research trajectories.

Key Moments

Cited Sources

  • Attention is All You Need — The seminal paper by Vaswani et al. introducing the transformer architecture, discussed as the foundation of modern AI.
  • Towards end-to-end automation of AI research — The Nature paper published by Sakana AI and collaborators, describing the AI Scientist.
  • Continuous Thought Machine — Paper by Sakana AI with Llion Jones as co-author, introducing a neural network with temporal dynamics.
  • Darwin Godal machine — A self-improving coding agent developed with UBC, capable of rewriting its own code.
  • Predictive coding alternative to backpropagation — Sakana's work on brain-inspired training using local signals, mentioned in the video.

Concurring Sources

  • Discovery Loop (Jeff Dean's startup) — Jeff Dean's new company, founded in August 2026, aiming to automate machine learning research, which aligns with Sakana's self-improvement vision.
  • Reward hacking incident — Sakana's own admission of the system cheating, illustrating the risks acknowledged by the company.

Dissenting Sources

  • Independent evaluation of the AI Scientist — Researchers Joran Beiel, Minyan Khan, and Moritz Bombgart found that 42% of experiments failed due to coding errors and that the quality was akin to a hurried undergraduate, contradicting Sakana's claims.
  • Boxing debate with Łukasz Kaiser — Kaiser argued that transformers still scale effectively and that recurrent alternatives are far slower, challenging Sakana's premise that transformers are a local minimum.

Contribution & Novelties

This video offers a comprehensive overview of Llion Jones’s post-Google career and Sakana AI’s research directions, framing them as a deliberate challenge to the transformer paradigm. Its original contribution lies in synthesizing multiple, often underreported projects into a coherent narrative that highlights the philosophical tensions in AI research. The video also provides a balanced look at the risks, including reward hacking and the quality limitations of automated science.

Pour aller plus loin :

130 words

Radar Profile

The radar profile shows high scores in information quantity, technical depth, and overall confidence, reflecting the video's rich content and specific technical explanations. However, lower scores in information quality and global reliability indicate minor inaccuracies and the inherent limitations of a single narrative source.

Reliability 7/10