Highly recommended read. This is the type of interpretability work that we need more of. "We can now understand most neurons in models up to trillions of parameters, and think the outlook for mechanistic interpretability may be far better than we thought." https://x.com/omarsar0/status/2110790564…