How to build your own long-term Agentic Memory System for LLMs | Mem0 from scratch in DSPy

How to build your own long-term Agentic Memory System for LLMs | Mem0 from scratch in DSPy

🎙 Neural Breakdown with AVB 👥 34K 📅 October 23, 2025 ⏱ 51 min 👁 17K 📄 tutorial 🧭 2026-08-15
Available in: English (current) Français

Keywords

agentic memoryDSPyQdrantMem0vector database

Summary

This tutorial video by Neural Breakdown with AVB demonstrates how to build a long-term agentic memory system for LLMs from scratch using DSPy and Qdrant, inspired by the Mem0 paper. The author starts by explaining the problem of LLMs lacking persistent memory and introduces the Mem0 API as a reference. The core of the video is a step-by-step implementation: extracting memories from conversations using DSPy signatures and modules, generating embeddings with OpenAI’s text-embedding-3-small, storing and retrieving memories in Qdrant vector database, and implementing a memory upkeep agent using tool calling to add, update, delete, or no-op memories. The tutorial includes code examples, a GitHub repository, and an evaluation dataset for testing. The author emphasizes the importance of atomic memory entries, categories, and the ability to update outdated memories. The video concludes with testing the system and discussing potential extensions.

139 words

Critical Evaluation

Value of the Information & Strength of the Argument

The video provides substantial value by offering a practical, hands-on approach to building a memory system, which is a complex and often overlooked aspect of LLM applications. The argumentation is solid: the author clearly explains the four main challenges (extraction, indexing, retrieval, updating) and systematically addresses each with concrete code examples. The use of DSPy for structured outputs and Qdrant for vector storage is well-justified. The tutorial is well-structured, building from simple to complex components, and includes an evaluation dataset to test the system. The author also discusses design choices, such as using atomic factoids and categories, which enhance the system’s robustness. However, the video is primarily a tutorial and does not provide a critical analysis of the Mem0 approach or compare it with alternative methods, which limits its scientific depth.

Scientific Rigor, Source Quality, Title Accuracy

The video demonstrates scientific rigor by referencing the Mem0 paper (arXiv) and using established tools like DSPy and Qdrant. The author provides a GitHub repository with the code, which enhances reproducibility. The title accurately reflects the content, and the video includes timestamps for easy navigation. The author also mentions the Mem0 API and its features, but the tutorial is based on the paper’s methodology. The sources cited are relevant and credible. The video does not include any sponsored content beyond a brief mention of Mem0 as a sponsor, which is disclosed. Overall, the scientific quality is high for a tutorial, but it lacks a critical evaluation of the methods.

255 words

Title / Content Match

The title accurately describes the content: building a long-term agentic memory system for LLMs using DSPy and Qdrant, inspired by Mem0.

Quality & Reliability

8/10

The video provides a hands-on tutorial with clear explanations and references to the Mem0 paper and open-source tools. The author demonstrates practical implementation and discusses design choices, but relies on personal experience and the Mem0 paper rather than independent verification.

Chapters

Cited Sources

Concurring Sources

  • Mem0 paper — The video's approach is directly based on this paper, which describes the memory extraction and updating mechanisms.
  • DSPy — The framework used in the tutorial, which is consistent with the author's previous videos and the broader community.
  • Qdrant — The vector database used, which is a popular choice for similarity search in AI applications.

Contribution & Novelties

The video provides a practical, hands-on implementation of a memory system based on the Mem0 paper, using DSPy and Qdrant. It offers a clear step-by-step guide that bridges the gap between the paper’s concepts and actual code. The author demonstrates how to extract atomic memories, generate embeddings, store them in a vector database, and implement a CRUD agent for memory upkeep. The tutorial is valuable for developers seeking to integrate persistent memory into LLM applications.

Pour aller plus loin :

  • Mem0 paper — The foundational paper for the memory system, detailing the architecture and methods.
  • DSPy documentation — Official documentation for DSPy, useful for understanding signatures and modules.
  • Qdrant documentation — Official documentation for Qdrant, covering vector search and indexing.
  • OpenAI Embeddings API — Documentation for generating embeddings, as used in the tutorial.
  • Mem0 GitHub — The open-source Mem0 repository, for comparison and further exploration.

145 words

Radar Profile

The radar profile shows high scores in quantity, quality, and technical level, indicating a comprehensive and well-executed tutorial. The slightly lower reliability score reflects the lack of independent verification and reliance on the author's own implementation.

Reliability 7/10