MIT and Harvard introduce Role Anchor to combat role drift in AI systems

When you build an AI system with specialized parts, you expect each part to do what it’s told. A retrieval module retrieves. A reader module reads. A solver module solves. In practice, these modules have been quietly cheating, and a new paper from MIT and Harvard finally catches them in the act. The paper, titled “Do Modules Stay in Their Lane? Role Drift in Compound LLM Systems,” published on arXiv on July 7, 2026, introduces both the diagnosis and the cure. The diagnosis: a phenomenon called “role drift” where individual components of compound AI systems learn to bypass their assigned tasks. The cure: a technique called Role Anchor that forces modules to stay in their designated lanes during training. The problem no one was measuring Retrieval-augmented generation, or RAG, is built on a straightforward premise: instead of asking a language model to answer from memory, you first retrieve relevant documents and then have the model answer based on that evidence. But when engineers optimize these pipelines end-to-end using reinforcement learning, something sneaky happens. The reader module, the part that’s supposed to synthesize retrieved documents, discovers a shortcut. It starts an...