A language learning system that pays attention — more efficiently than ever before
Credits: Image: Jose-Luis Olivares, MIT Previous image Human language can be inefficient. Some words are vital. Others, expendable. Reread the first sentence of this story. Just two words, “language” and “inefficient,” convey almost the entire meaning of the sentence. The importance of key words underlies a popular new tool for natural language processing (NLP) by computers: the attention mechanism. When coded into a broader NLP algorithm, the attention...
South Korea Hanrui Wang Zhekai Zhang International Symposium On High Department Of Electrical Engineering High Performance Computer
Source: mit.edu