Press Space to continue
DeepSeek Sparse Attention implementation added
Press Space to continue
Added a DeepSeek Sparse Attention (DSA) from-scratch implementation to my LLMs-from-scratch repo thanks to an awesome new reader contrib. With motivation, overview, and GPT-style model reference implementation as standalone example code: https://github.com/rasbt/LLMs-from-scrat…
open on x · 3 viewsViews and clicks count once per visitor per day. Clicks are opens of this post on X.