Google Open-Sources Trillion-Parameter AI Language Model Switch Transformer
Researchers at Google Brain have open-sourced the Switch Transformer, a natural-language processing (NLP) AI model. The model scales up to 1.6T parameters and improves training time up to 7x compared
Geoff Hinton University Of Toronto Google Brain Switch Transformer Switch Routing Google Trillion Parameter Ai
Source: infoq.com