This guy literally broke down step-by-step how to create frontier lab quality evals: 2:42 - What an eval actually is 3:29 - Offline evals vs prod 5:23 - Why old evals stopped working 7:10 - How to write one 8:29 - Why 100% means you failed 9:03 - Models have saturated Q&A 12:37 - Anthropic dropped every benchmark 13:50 - Q&A thinking vs task thinking 15:32 - Building a real eval live 18:54 - Start with the easiest case 26:39 - Haiku vs Codex, head to head 33:08 - The eval no model solves 40:41…