Press Space to continue
Curated tech posts from X on AI, startups, and product development—signal without the doomscroll, updated on weekdays.
Press Space to continue
Press Space to continue
"Block Sparse Attention with Log-Linear Complexity" Most block-sparse attention still has a hidden quadratic bottleneck because every query has to score lots of candidate blocks before deciding which ones to keep. This paper fixes this by first checking large regions of the context, keeps only the most promising ones, then recursively zooms into those regions using LogSumExp scores. That cuts block selection from O(N^2) to O(N log N). At 256K context, routing is 9.95x faster than standard…
