Press Space to continue
Running DeepSeek v4.1 Flash on consumer GPUs via ternarization
Press Space to continue
If you could run DeepSeek v4.1 Flash 1017 on a single RTX 3090 + 64GB RAM, would you? This should be possible by ternarizing the model, but the open problem is how to keep enough agent accuracy to not feel too much degradation. I’m looking into this btw…
open on x · 3 viewsViews and clicks count once per visitor per day. Clicks are opens of this post on X.