This is a cool benchmark that uses video games to test agents. Basically, they speedrun the game to test how well agents can plan, act, learn from previous attempts, and optimize a long sequence of decisions. The goal is to evaluate agents' capability through an autoresearch-like loop There's a public leaderboard where you can see how good your favorite model is.