How To Run Open-Source AI Models on Your Phone (For Free)

How To Run Open-Source AI Models on Your Phone (For Free)

🎙 Matt Wolfe 👥 1.0M 📅 March 4, 2026 ⏱ 11 min 👁 77K 📄 tutorial 🧭 2026-08-28
Available in: English (current) Français

Keywords

Locally AIQwen 3.5on-deviceofflineopen-source

Summary

Matt Wolfe presents Locally AI, an app that allows running open-source AI models directly on an iPhone without an internet connection. He demonstrates the installation process, model selection (Qwen 3.5 variants), and features like text generation, vision, and voice mode. The video highlights the privacy benefits of on-device processing and shows the app working in airplane mode. Wolfe compares the performance to cloud-based models, noting that while not state-of-the-art, these local models are surprisingly capable. He also mentions the app’s settings, including custom instructions and Siri shortcuts. The video concludes with a positive recommendation, emphasizing the app’s free availability and ease of use.

103 words

Critical Evaluation

Value of the Information & Strength of the Argument

The video provides practical, actionable information for users interested in running AI locally on their phones. The demonstration is clear and includes real-time tests, which adds credibility. The argumentation is straightforward: local AI offers privacy and offline functionality, and the performance is adequate for everyday tasks. However, the video lacks a critical comparison with other similar apps or a discussion of potential drawbacks, such as battery drain or model limitations.

Scientific Rigor, Source Quality, Title Accuracy

The video cites the Locally AI app and its website, as well as the developer Adrian Grondin. The creator also references the Qwen 3.5 model and its benchmarks, but does not provide direct links to the model’s official page or benchmark sources. The title accurately describes the content, and the video is well-structured. The creator’s personal experience is the primary source, which is acceptable for a tutorial but limits the scientific rigor.

157 words

Title / Content Match

The title accurately reflects the content: the video focuses on running open-source AI models on a phone for free, with a step-by-step demonstration.

Quality & Reliability

7/10

The video is a hands-on tutorial demonstrating a specific app (Locally AI) for running open-source models on iPhone. The creator provides practical steps, shows real-time performance, and mentions model benchmarks. However, the evaluation is largely anecdotal, lacks independent verification, and does not delve into technical details or potential limitations.

Key Moments

Cited Sources

Concurring Sources

Contribution & Novelties

The video provides a timely and practical introduction to running open-source AI models on a phone, highlighting the Locally AI app. It demonstrates that on-device AI is now accessible to non-technical users, offering privacy and offline capabilities. The novelty lies in the specific app and the Qwen 3.5 model, which is new at the time of recording.

Pour aller plus loin :

  • Qwen 3.5 Model — Official model page on Hugging Face.
  • On-device AI — Wikipedia article on edge computing, relevant to on-device AI.
  • Privacy in AI — Wikipedia article on privacy concerns in AI.

95 words

Radar Profile

The radar profile shows high scores in information quantity and quality, reflecting the practical and detailed tutorial. The technical level is moderate, suitable for a general audience. The reliability is good, but the lack of independent verification and reliance on personal experience slightly lowers the score.

Reliability 7/10

💬 Très positif. Sur les 30 commentaires analysés, la grande majorité exprime de l'enthousiasme et de la gratitude pour la découverte de l'application, avec quelques suggestions d'amélioration et des questions techniques.