Press Space to continue
Incorrect LLM responses cost more tokens than correct ones
Press Space to continue
Weird thing about LLMs: "incorrect responses" are more expensive than correct ones. If I go to a restaurant and they screw up my food, they usually refund me and remake the meal. If an LLM gets stuck on a problem, it runs around in loops, burning tokens and costing money.
open on x · 3 viewsViews and clicks count once per visitor per day. Clicks are opens of this post on X.