Press Space to continue
Small VRAM Model With Large Offloaded Knowledge Base
Press Space to continue
would love to see a Qwen4 27B with 100B+ Engram that offloads to RAM + NVMe runs on small VRAM but has the world knowledge of a big MoE local model people would eat this up!
open on x · 2 viewsViews and clicks count once per visitor per day. Clicks are opens of this post on X.