Press Space to continue
Benchmarks Need Ephemeral Specificity to Matter
Press Space to continue
who benchmarks the benchmarkers? a good eval is: - ephemeral. it snapshots a moment in time and capabilities. - grounded. it directly measures performance on tasks and data you care about. - specific. it operates on the desired results and not some proxy of them. take notes!
open on x · 2 viewsViews and clicks count once per visitor per day. Clicks are opens of this post on X.