Targeted Unlearning with Single Layer Unlearning Gradient

Targeted Unlearning with Single Layer Unlearning Gradient

🎙 Arian Komaei 👥 1K 📅 December 8, 2025 ⏱ 38 min 👁 23 📄 literature review 🧭 2026-08-16
Available in: English (current) Français

Keywords

unlearningSLUGlayer importancegradient alignmentStable Diffusion

Summary

The video is a journal club presentation by Arian Komaei on the paper ‘Targeted Unlearning with Single Layer Unlearning Gradient’ (SLUG). The method aims to remove specific concepts from trained models by updating only one carefully selected layer using a single gradient step. The presenter explains the core ideas: layer importance based on gradient norm and gradient alignment between forget and retain losses. He discusses the selection of the optimal layer and the trade-off between forgetting and retaining. The presentation includes results on CLIP and Stable Diffusion, showing that SLUG can unlearn concepts like Elon Musk while preserving other knowledge. However, the presenter shares his own testing experiences, noting that the method often produces poor image quality and sometimes fails to generate coherent images. He critically evaluates the benchmark results, questioning their reliability. The discussion also touches on alternative approaches like training-free editing and the potential for future improvements. Overall, the video provides a critical review of the SLUG method, highlighting both its theoretical appeal and practical limitations.

168 words

Critical Evaluation

Value of the Information & Strength of the Argument

The value of the information lies in the presenter’s critical perspective and practical testing of the SLUG method. He provides a clear explanation of the technical details, including layer importance and gradient alignment, and offers insights into the method’s strengths and weaknesses. The argumentation is based on personal experiments and observations, which adds a practical dimension but also introduces subjectivity. The presenter does not blindly accept the paper’s claims but questions the validity of the results, especially regarding image quality and benchmark reliability. However, the discussion is informal and lacks systematic evaluation, making the argumentation less rigorous.

Scientific Rigor, Source Quality, Title Accuracy

The presentation is based on a specific paper (arXiv:2407.11867) and the presenter’s own testing. The source is credible as it is a preprint from arXiv, but the presenter’s personal results are not formally documented. The title accurately reflects the content. The discussion includes critical analysis of the method’s limitations, but the lack of formal citations and the informal nature of the presentation reduce its scientific rigor. The presenter also mentions related work like ESD and Fisher information, but without detailed references.

193 words

Title / Content Match

The title accurately reflects the content, which focuses on the SLUG method for targeted unlearning.

Quality & Reliability

6/10

The presentation is a journal club discussion of a specific paper, providing a critical review. The speaker shares personal testing experiences and raises concerns about the method's practical effectiveness, but the analysis is informal and lacks rigorous verification of the paper's claims.

Key Moments

Cited Sources

Concurring Sources

Dissenting Sources

  • Personal testing results — The presenter's own experiments showed poor image quality and sometimes failure to generate coherent images, contradicting the paper's reported results.

Contribution & Novelties

The video provides a critical review of the SLUG method, offering practical insights from the presenter’s own testing. It highlights the gap between theoretical claims and real-world performance, particularly regarding image quality and reliability. The discussion also explores potential improvements and alternative approaches.

Pour aller plus loin :

69 words

Radar Profile

The radar profile shows moderate scores across all dimensions, with a slight emphasis on technical level and information quantity. The low reliability score reflects the presenter's critical stance and the informal nature of the discussion.

Reliability 5/10