Press Space to continue
Reducing LLM Inference Costs with SGLang and RadixAttention
Press Space to continue
New course available! Efficient Inference with SGLang: Text and Image Generation is live. LLM inference gets expensive fast—mostly due to redundant computation. This course shows how to reduce that using SGLang, with KV cache and RadixAttention, and how to apply the same ideas to faster image generation. Built with @lmsysorg and @radixark, taught by Richard Chen. Enroll for free: https://hubs.la/Q04b0F1J0
View
open on xViews and clicks count once per visitor per day. Clicks are opens of this post on X.