[JC] Verification of Randomized Benchmarking with NISQ Devices

[JC] Verification of Randomized Benchmarking with NISQ Devices

🎙 Chanmin Park (KAIST) 👥 268 📅 August 23, 2026 ⏱ 26 min 👁 0 📄 literature review 🧭 2026-08-23
Available in: English (current) Français

Keywords

randomized benchmarkinginterleaved RBgate-dependent noiseClifford groupNISQ verification

Summary

The presentation, given by Chanmin Park from KAIST, introduces randomized benchmarking (RB) as a method to estimate quantum gate errors on NISQ devices. It begins with a review of quantum information processing, including state preparation, dynamics, and measurement, and defines quantum errors via Kraus operators and CPTP maps. The core of the talk explains the Clifford twirl, which averages noise channels into a depolarizing channel, and how RB sequences random Clifford gates to extract an average error rate. The speaker then discusses interleaved randomized benchmarking (IRB), which isolates the error of a specific gate by interleaving it between random Cliffords. He presents his master’s research comparing IBM’s reported error rates with his own IRB measurements on a 3-qubit quantum Fourier transform, finding that IRB yields slightly more accurate results. He also addresses the issue of gate-dependent noise, referencing Wallman’s 2018 paper that extends RB to such noise, and shows numerical verification for two-qubit gates that the delta parameter is less than 1, ensuring convergence. Finally, he discusses practical considerations for applying IRB on real devices, emphasizing the need to estimate p and t values before fitting. The talk concludes with four main takeaways: IRB can be more accurate than IBM’s RB-based estimates, RB and IRB share mathematical structure, the c term decays to zero with increasing sequence length, and simulations confirm the validity of the approach.

226 words

Critical Evaluation

Value of the Information & Strength of the Argument

The presentation provides a solid introduction to randomized benchmarking and interleaved RB, with clear mathematical derivations and a logical progression from theory to practical application. The speaker’s original contribution—comparing IBM’s error rates with his own IRB measurements on a 3-qubit QFT—adds empirical value, and the use of Jensen-Shannon divergence to compare probability distributions is a rigorous approach. The argumentation is coherent, though the talk is more of a literature review with some original numerical work rather than a fully novel study. The speaker also addresses the important issue of gate-dependent noise, referencing Wallman’s work and extending it to two-qubit gates, which strengthens the scientific value.

Scientific Rigor, Source Quality, Title Accuracy

The presentation cites key papers in randomized benchmarking: Magesan et al. (2011, 2012) and Wallman (2018). These are foundational and well-regarded references. The speaker also mentions IBM’s documentation as a reference for RB implementation. The title accurately reflects the content, focusing on verification of RB with NISQ devices. The talk is a journal club presentation, so it is not a peer-reviewed study, but it demonstrates a good understanding of the literature and includes original numerical verification. The speaker does not provide external sources beyond the cited papers, but the references are appropriate and relevant.

214 words

Title / Content Match

The title accurately reflects the content: the speaker discusses verification of randomized benchmarking protocols on NISQ devices, including interleaved RB and gate-dependent noise considerations.

Quality & Reliability

7/10

The presentation is based on established randomized benchmarking literature and includes original numerical verification for two-qubit gates. However, the talk is a journal club presentation, not a peer-reviewed study, and the experimental validation is limited to simulations and a single device comparison.

Key Moments

Cited Sources

  • Randomized benchmarking with gate-dependent noise — Referenced as the main theoretical basis for handling gate-dependent noise in RB.
  • Scalable and robust randomized benchmarking of quantum processes — Foundational paper for randomized benchmarking.
  • Efficient measurement of quantum gate error by interleaved randomized benchmarking — Introduces interleaved randomized benchmarking (IRB).

Concurring Sources

  • Scalable and robust randomized benchmarking of quantum processes — Supports the RB methodology presented.
  • Efficient measurement of quantum gate error by interleaved randomized benchmarking — Supports the IRB methodology and its accuracy.

Dissenting Sources

  • Randomized benchmarking with gate-dependent noise — While the speaker uses this paper to justify handling gate-dependent noise, the paper itself notes limitations for two-qubit gates, which the speaker addresses with his own numerical verification.

Contribution & Novelties

The presentation offers a clear synthesis of randomized benchmarking and interleaved RB, with an original comparison of IBM’s error rates versus IRB-derived rates on a 3-qubit QFT, showing IRB to be slightly more accurate. It also extends Wallman’s gate-dependent noise analysis to two-qubit gates, numerically verifying that the delta parameter is less than 1, which supports the convergence of the fitting model. This adds practical value for researchers applying RB on NISQ devices.

Pour aller plus loin :

116 words

Radar Profile

The radar profile shows high scores in technical level and information quality, reflecting the mathematical depth and rigorous methodology. The fiabilite_globale is slightly lower due to the nature of the presentation (journal club) and limited experimental validation. Overall, the content is strong in theoretical foundations and practical insights.

Reliability 7/10

💬 No comments were provided for analysis.