I ran Qwen3.8 27B on $78 Card! (Better than expected)

I ran Qwen3.8 27B on $78 Card! (Better than expected)

Title history
  • I ran Qwen3.8 27B on $78 Card! (Better than expected) — observed on 20261117-1541 UTC (YouTube)
🎙 Kai 👥 76K 📅 November 17, 2026 ⏱ 33 min 👁 170 📄 expert opinion 🧭 2026-11-17
Available in: English (current) Français

Keywords

Tesla P100Qwen 3.8 27Btensor splitspeculative decodinglocal AI

Summary

The video investigates the performance of two Nvidia Tesla P100 GPUs running Qwen 3.8 27B locally. It starts by explaining the hardware, focusing on memory bandwidth, and then details how a specialized fork of llama.cpp and the model’s MTP head enable high token rates. The creator benchmarks various configurations, showing that the claimed 67 tok/s is only achievable under specific conditions. He also tracks the price increase of the P100 from $78 to $274 due to the viral video and free software. The video compares local inference with hosted services, analyzing power costs and payback periods. He discusses the limitations, including prefill speed, reliance on a single maintainer, and driver end-of-life. The verdict is that while the hardware is capable, the performance depends heavily on software optimization and the model architecture, and current prices may not justify the investment compared to cloud services.

143 words

Critical Evaluation

Value of the Information & Strength of the Argument

The video provides a thorough and balanced analysis, presenting real measurements and acknowledging the context behind the headline numbers. It explains technical concepts like tensor split and speculative decoding clearly, and gives concrete data from multiple sources. The argumentation is solid, as it supports each claim with specific figures and comparisons, and it does not oversell the results. The section on price dynamics is particularly valuable for understanding market effects.

Scientific Rigor, Source Quality, Title Accuracy

The video cites credible sources, including GitHub repos, price tracking websites, and official documentation. It transparently lists the sources in the description and references them throughout. The title is accurate in that the cards perform better than expected, but the video provides context that tempers the enthusiasm. There is a clear effort to distinguish between different performance scenarios, and the creator notes when numbers are optimistic or ideal.

153 words

Title / Content Match

The title accurately reflects the video's content, though the 67 tok/s figure is context-dependent and the creator explains this nuance.

Quality & Reliability

8/10

The video provides comprehensive data, cites sources, and acknowledges caveats, though some claims rely on community reports.

Chapters

Cited Sources

Contribution & Novelties

The video adds value by providing an independent and up-to-date analysis of the P100 fork and its impact on price and performance. It goes beyond the viral video, offering a critical evaluation that includes power costs, prefill speed, and future risks. The ‘Pour aller plus loin’ section offers resources for deeper understanding.

Pour aller plus loin :

108 words

Radar Profile

The radar profile shows high scores in information quantity and quality, reflecting the video's comprehensive and detailed content. The technical depth is also high, appealing to an audience with some understanding of AI inference. Reliability is slightly lower due to reliance on community reports and the evolving nature of the software and prices, but overall the profile indicates a well-researched and informative video.

Reliability 7/10