Search Ctrl+K
Change language Switch ThemeSign In
Curated Daily BriefWeekly PicksTopicsWorld Cup Special SettingsHelp CenterCollapse
Narrow Mode
Live Demo: Bonsai 27B Model Runs Smoothly on iPhone 17 Pro
Live Demo: Bonsai 27B Model Runs Smoothly on iPhone 17 Pro
 Berryxia.AI@berryxia
卧槽！iPhone 可以跑27B大模型了啊！
一个27B的模型现在能在iPhone 17 Pro上直接跑了，而且内存占用不到5GB。
PrismML的Bonsai 27B据称是第一个能在手机上运行的27B级模型。
视频里它实时响应，表现已经相当可用。
这意味着过去只有云端才能扛得动的参数规模，开始真正进入个人设备。
以前大家觉得手机AI只能跑小模型，现在一个接近顶级开源模型规模的东西已经在掌上跑起来了。
量化技术把内存压到极致，同时保留了可用性。
这不是单纯的工程优化， 是把“强大AI必须连云”这个假设又往前推了一大步。
当模型够大、够聪明、却能在本地低资源运行时，隐私、延迟、离线能力都会发生根本变化。
开源地址：github.com/PrismML-Eng/Bo…Show More
#### Adrien Grondin
@adrgrondin · 8h ago
The new PrismML’s Bonsai 27B model running on iPhone 17 Pro
Bonsai 27B is the first 27B-class model to run on a phone and it uses less than 5GB of memory
Pushing the limits on what can run a phone Show More
00:14
15
25
243
29.8K
Jul 15, 2026, 12:16 AM View on X
4 Replies
0 Retweets
4 Likes
1,045 Views  Berryxia.AI @berryxia
Follow
One Sentence Summary
A video shows PrismML's Bonsai 27B model running in real-time on an iPhone 17 Pro with memory footprint under 5GB, demonstrating usable performance.
Summary
The author quotes a tweet from adrgrondin sharing a live demo of the Bonsai 27B model running on an iPhone 17 Pro. The model uses less than 5GB of memory, responds in real-time, and performs quite usable. The author argues this marks a shift where parameter scales previously only feasible on the cloud are entering personal devices, breaking the notion that "mobile AI can only run small models" and pushing forward the assumption that "powerful AI must be cloud-connected," with fundamental implications for privacy, latency, and offline capability.
AI Screening
80
Influence Score 4
Published Today
Language
Chinese
Tags
On-Device AI
iPhone
Bonsai 27B
Model Demo
Edge Computing
Make your daily reading actually fit you.A daily brief built from the sources you follow. Get started free HomeDiscoverWorld CupSettings