
I ran Qwen3.8 27B on $78 Card! (Better than expected)
Title history
- I ran Qwen3.8 27B on $78 Card! (Better than expected) — observed on 20261117-1541 UTC (YouTube)
Keywords
Summary
143 words
Critical Evaluation
Value of the Information & Strength of the Argument
The video provides a thorough and balanced analysis, presenting real measurements and acknowledging the context behind the headline numbers. It explains technical concepts like tensor split and speculative decoding clearly, and gives concrete data from multiple sources. The argumentation is solid, as it supports each claim with specific figures and comparisons, and it does not oversell the results. The section on price dynamics is particularly valuable for understanding market effects.
Scientific Rigor, Source Quality, Title Accuracy
The video cites credible sources, including GitHub repos, price tracking websites, and official documentation. It transparently lists the sources in the description and references them throughout. The title is accurate in that the cards perform better than expected, but the video provides context that tempers the enthusiasm. There is a clear effort to distinguish between different performance scenarios, and the creator notes when numbers are optimistic or ideal.
153 words
Title / Content Match
The title accurately reflects the video's content, though the 67 tok/s figure is context-dependent and the creator explains this nuance.
Quality & Reliability
8/10
The video provides comprehensive data, cites sources, and acknowledges caveats, though some claims rely on community reports.
Chapters
- $78 GPUs at 67 tok/s?
- The Tesla P100 and HBM2 bandwidth
- Why the AI predicted 17 tok/s
- Layer split vs tensor split
- The fix: Kmic's P100 fork
- The 17-year-old behind it
- MTP: where 67 tok/s comes from
- Does speculative decoding hurt quality?
- Real owner results: 11 to 74 tok/s
- The price followed the fork
- $392 vs hosted tokens
- The power bill
- Prefill: the reading half
- Three clocks: fork, driver, Qwen 4
- The build guide
- Who this is for
- Verdict
Cited Sources
- NVIDIA driver support matrix (R580 end of life) — Used to discuss driver support and end-of-life dates for Pascal architecture.
- Kmic's P100 llama.cpp fork — The custom software that significantly boosts performance on Pascal GPUs.
- GPUDojo P100 price tracker — Provides historical price data showing the price increase over time.
- Qwen3.8-27B GGUF (Unsloth) — The model file used in the benchmark, specifically the Q6_K quantized version.
- Qwen 3.8 27B on OpenRouter — Shows hosted pricing and providers for comparison with local inference.
- EIA electricity prices — Used to calculate power costs per million tokens.
- Kmic's r/LocalLLaMA post — Original announcement of the fork by the 17-year-old developer.
- Original video (Junk GPU Lab) — The viral video that triggered the price surge and inspired this analysis.
Contribution & Novelties
The video adds value by providing an independent and up-to-date analysis of the P100 fork and its impact on price and performance. It goes beyond the viral video, offering a critical evaluation that includes power costs, prefill speed, and future risks. The ‘Pour aller plus loin’ section offers resources for deeper understanding.
Pour aller plus loin :
- Speculative sampling paper — Covers the theory behind MTP and speculative decoding.
- High Bandwidth Memory (HBM) — Explains the memory technology used in the Tesla P100.
- Pascal microarchitecture — Details the architectural features of the P100.
- llama.cpp official repo — The primary software framework, for understanding the baseline and ongoing development.
108 words
Radar Profile
The radar profile shows high scores in information quantity and quality, reflecting the video's comprehensive and detailed content. The technical depth is also high, appealing to an audience with some understanding of AI inference. Reliability is slightly lower due to reliance on community reports and the evolving nature of the software and prices, but overall the profile indicates a well-researched and informative video.