Lukasz Kaiser News Today : Breaking News, Live Updates & Top Stories | Vimarsana

Discussions: Hacker News (64 points, 3 comments), Reddit r/MachineLearning (219 points, 18 comments) Translations: Simplified Chinese, French, Korean, Russian, Turkish This year, we saw a dazzling application of machine learning. The OpenAI GPT-2 exhibited impressive ability of writing coherent and passionate essays that exceed what we anticipated current language models are able to produce. The GPT-2 wasn’t a particularly novel architecture – it’s architecture is very similar to the decoder-only transformer. The GPT2 was, however, a very large, transformer-based language model tra...

No technology remains dominant forever.

A deep dive into Transformer a neural network architecture that was introduced in the famous paper “attention is all you need” in 2017, its applications, impacts, challenges and future directions

Twitter no more, the X factor is here - for better or worse.

It seems fitting that one of Google’s most important inventions — one that would come back to haunt the company — was initially devised over lunch.