Digital Design & Comp. Arch: L20b: GPU Programming (Spring 2026)

Digital Design & Comp. Arch: L20b: GPU Programming (Spring 2026)

🎙 Dr. Juan Gómez Luna and Prof. Onur Mutlu 👥 64K 📅 May 8, 2026 ⏱ 152 min 👁 902 📄 lecture 🧭 2026-08-15
Available in: English (current) Français

Keywords

GPU programmingCUDASIMTTensor coresMemory bandwidth

Summary

This lecture, part of the Digital Design and Computer Architecture course at ETH Zürich, provides a comprehensive introduction to GPU programming for general-purpose computing. The instructors, Dr. Juan Gómez Luna and Prof. Onur Mutlu, begin by contrasting GPUs with CPUs, highlighting the GPU’s massive parallelism and throughput-oriented design. They explain the SIMT (Single Instruction, Multiple Thread) execution model, where warps of 32 threads execute in lockstep. The lecture covers the evolution of NVIDIA GPU architectures, from the Tesla GTX 285 to the Volta V100, emphasizing the increase in streaming processors and the introduction of tensor cores for deep learning. The programming model is detailed, including the host-device model, kernel launches, thread blocks, and memory hierarchy. Key bottlenecks are discussed, such as PCIe transfer overhead and memory bandwidth limitations. The lecture also touches on performance optimization techniques and collaborative computing. The presentation is technical and aimed at students with a background in computer architecture, providing both theoretical foundations and practical insights.

160 words

Critical Evaluation

Value of the Information & Strength of the Argument

The lecture provides substantial value by demystifying GPU programming and architecture. It explains complex concepts like SIMT execution, warp scheduling, and memory hierarchy with clarity, using concrete examples and architectural diagrams. The argumentation is solid, as the instructors build on established knowledge and cite relevant research papers. They also pose thought-provoking questions, such as the potential use of tensor cores for non-ML applications, encouraging critical thinking. The discussion of bottlenecks, such as the widening gap between compute throughput and memory bandwidth, is well-supported by historical data. The lecture is not merely descriptive; it offers insights into design trade-offs and optimization strategies, making it highly valuable for students and practitioners.

Scientific Rigor, Source Quality, Title Accuracy

The lecture demonstrates high scientific rigor. The instructors are recognized experts in computer architecture, and the content is based on established principles and recent research. The recommended readings include peer-reviewed papers and official documentation, such as the CUDA programming guide and papers on memory-centric computing and RowHammer. The title accurately reflects the content, which is a focused lecture on GPU programming. The lecture is well-structured, with clear objectives and a logical flow. The use of architectural diagrams and performance numbers enhances credibility. The sources cited are authoritative and directly relevant to the topics discussed. The lecture also references the course website for slides, ensuring accessibility. Overall, the scientific quality is excellent, with no apparent biases or unsupported claims.

242 words

Title / Content Match

The title accurately reflects the content, which is a lecture on GPU programming within a digital design and computer architecture course.

Quality & Reliability

9/10

Lecture by renowned experts in computer architecture, with detailed technical content and references to peer-reviewed papers and official course materials. The presentation is rigorous and well-structured, though it is an educational lecture rather than a peer-reviewed publication.

Key Moments

Cited Sources

Concurring Sources

External References

Contribution & Novelties

This lecture provides a comprehensive and up-to-date overview of GPU programming, bridging the gap between theoretical concepts and practical implementation. It emphasizes the evolution of GPU architectures and the importance of memory-centric computing, a topic of growing relevance. The lecture also highlights the challenges of programming GPUs and offers insights into optimization techniques.

Pour aller plus loin :

98 words

Radar Profile

The radar profile shows high scores across all dimensions, indicating a well-rounded and authoritative lecture. The strongest aspects are the quality and quantity of information, as well as the technical depth. The lecture is highly reliable and provides a solid foundation for understanding GPU programming.

Reliability 9/10

💬 No comments were provided for analysis.