Press Space to continue
Token Per Second Calculation Should Include Request Latency
Press Space to continue
everyone seems to calculate tokens per second window differently A. time from request start to response end B. time from first token coming back to end of response i think it should be A (so it ecompasses TTFT), wdyt?
open on x · 1 viewViews and clicks count once per visitor per day. Clicks are opens of this post on X.