The Illustrated Retrieval Transformer
Discussion: Discussion Thread for comments, corrections, or any feedback. Summary: The latest batch of language models can be much smaller yet achieve GPT-3 like performance by being able to query a database or search the web for information. A key indication is that building larger and larger models is not the only way to improve performance. The last few years saw the rise of Large Language Models (LLMs) – machine learning models that rapidly improve how machines process and generate langua...
Discussion Thread Large Language Models Google Search Improving Language Models Separating Language Information World Knowledge
Source: jalammar.github.io