Large language models use a surprisingly simple mechanism to retrieve some stored knowledge
Researchers find large language models use a simple mechanism to retrieve stored knowledge when they respond to a user prompt. These mechanisms can be leveraged to see what the model knows about different subjects and possibly to correct false information it has stored.
Source: mit.edu
