Press Space to continue
Gemma 4 26B Reaches 300 Tokens Per Second on Single GPU
Press Space to continue
16 parallel runs of Gemma 4 26B A4B on a single NVIDIA DGX Spark! Pushing 18 tok/s per instance and a 300 tok/s aggregate. It can even hit 32 parallel runs. This level of concurrency highlights how efficient the architecture is.
View
open on x · 2 viewsViews and clicks count once per visitor per day. Clicks are opens of this post on X.