I agree that this is cool as heck and maybe a little scary but I also think it’s worth calling out that this technique had already been demonstrated and so was likely present in the weights. Reminds me of something @drfeifei said about models being unbelievable at synthesizing different unrelated approaches (in this case for math and theorem proving) but she was still skeptical that we’d see models invent genuinely new mathematics as soon as team takeoff would seem to suggest