Press Space to continue
Ran gemini 4 argon on the same internal evals
Press Space to continue
ran gemini 4 argon on the same internal https://cfo.ai evals - comparable to opus 5.5 in terms of cost efficiency (assuming introductory pricing), but 2X slower gpt-6.1-sol still 3x more cost efficient than either (though slower than opus 5.5 in this run) https://x.com/blader/status/211018066150…
Siqi Chen@bladerSep 30
we found opus 5.5 to be 2X as efficient as gpt-6-sol in our internal https://cfo.ai evals so i was not expecting 6.1-sol to improve on that much but to see it 3X the efficiency of opus 5.5 and 2.5X against even sonnet 5.5 is actually 🤯 this is an insane point release
open on x · 6 viewsViews and clicks count once per visitor per day. Clicks are opens of this post on X.