As strong as models have become, their context windows haven't grown substantially. They're still extremely sensitive to having the right amount of information codified in the window, and there cannot be subtle relationships between distant parts of the codebase or dist. system.