Highlighting current AI tools that are failing, causing friction, or are operational risks.

Highlighting current AI tools that are failing, causing friction, or are operational risks.

🎙 Shira Rubinoff 👥 937K 📅 August 4, 2026 ⏱ 11 min 👁 102K 📄 interview 🧭 2026-08-15
Available in: English (current) Français

Keywords

AISOCcybersecurityAI failuresoperational risk

Summary

In this interview at Black Hat 2026, Shira Rubinoff speaks with Monzy Merza, CEO of Chronical (referred to as Cogito and Krog will in the transcript), about the real-world performance of AI tools in Security Operations Centers (SOCs). Merza categorizes customer experiences into three groups: skeptics who have tried and failed, those who bought ineffective SaaS products, and those achieving value through in-house or specialized solutions. He emphasizes the importance of sovereignty, privacy, and operational relevance. The role of security analysts is shifting from dashboard monitoring to more engineering-like tasks, requiring new UI paradigms. Merza argues that AI’s financial impact is nuanced; many projects fail due to lack of clear outcomes, citing an MIT report on 95% failure. However, with proper use cases, significant improvements are possible, such as reducing threat intel analysis from weeks to under an hour. He announces the launch of a free enterprise-grade AI SOC platform to reduce friction and let the community evaluate it. The interview concludes with an invitation to visit their booth at the conference.

172 words

Critical Evaluation

Value of the Information & Strength of the Argument

The video provides valuable insights into the practical challenges and successes of AI in cybersecurity, based on the speaker’s experience with enterprise customers. The argumentation is coherent, emphasizing that AI is not a silver bullet and that success depends on clear use cases and realistic expectations. The speaker supports his claims with a concrete example of a customer achieving a 10x-20x improvement in threat intel analysis. However, the evidence is anecdotal and comes from a vendor with a vested interest, which may bias the perspective.

Scientific Rigor, Source Quality, Title Accuracy

The video lacks formal citations, but the speaker references an MIT report on AI project failures, though no specific source is provided. The title accurately reflects the content, which focuses on AI tools’ failures and operational risks. The discussion is based on industry experience rather than peer-reviewed research, so the scientific rigor is moderate. The video is an interview, so it does not provide a systematic review of the literature.

170 words

Title / Content Match

The title accurately reflects the content, which discusses AI tools' failures and operational risks in SOC environments.

Quality & Reliability

6/10

The video is an interview with a vendor CEO, providing anecdotal evidence and industry insights rather than peer-reviewed research. Claims are plausible but not independently verified.

Key Moments

Cited Sources

  • Crogl download page — Mentioned in the video description as a link to learn more about the platform discussed.

Concurring Sources

  • Gartner: AI in Cybersecurity — Gartner predicts AI will be a top priority in cybersecurity, aligning with the video's focus.

Dissenting Sources

  • AI hype vs. reality — Some sources argue that AI in cybersecurity is overhyped and often fails to deliver, which contrasts with the video's more optimistic outlook when properly implemented.

Contribution & Novelties

The video offers a vendor’s perspective on the practical challenges of AI in SOC operations, highlighting the importance of sovereignty, operational relevance, and realistic expectations. It provides a concrete example of AI improving threat intel analysis efficiency. The announcement of a free enterprise-grade AI SOC platform is a notable development.

Pour aller plus loin :

  • AI in Cybersecurity — Overview of AI applications and challenges in cybersecurity.
  • Security Operations Center — Background on SOC functions and evolution.
  • MIT report on AI project failures — Reference to the MIT report mentioned in the video (note: URL is illustrative; actual report may differ).

101 words

Radar Profile

The radar profile shows moderate scores across all dimensions, indicating a balanced but not exceptional video. The highest score is in information quantity, while technical depth and reliability are slightly lower, reflecting the interview format and lack of formal citations.

Reliability 5/10

💬 No comments were provided for analysis.