Press Space to continue
Gemma 4 runs on iPhone with 500 MB of RAM
Press Space to continue
Gemma 4 running on an iPhone with just ~500 MB of RAM! User Antikythera on r/LLMDevs shared their calibration-aware quantization approach to shrink Gemma 4 keeping speed and accuracy on an iPhone. They demoed it using an offline assistant that manages calendar actions with just ~516 MB of active RAM.
open on x · 1 viewViews and clicks count once per visitor per day. Clicks are opens of this post on X.