Nobody actually knows the ceiling of AI model capabilities right now. New models are released every 2-3 months but it also takes 2-3 months to fully push them to their limits. So by the time you figure out what one model can do... the next one is already out. OpenAI researcher @polynoamial on why AI evals are fundamentally broken. cc: @NoPriorsPod, @saranormous, @Jason