AI Research Blog - The Transformer Blueprint: A Holistic Gui

A deep dive into Transformer a neural network architecture that was introduced in the famous paper “attention is all you need” in 2017, its applications, impacts, challenges and future directions

Related Keywords

Jordan , United States , Kalyan , Maharashtra , India , Dominican Republic , Sydney , New South Wales , Australia , American , Basil Mustafa , Hesslow Daniel , Dani Yogatama , Vinhq Tran , Tao Qin , Saining Xie , Mishra Gaurav , Huishuai Zhang , Shuai Bai , Sergio Gomez Colmenarejo , Aidann Gomez , Kristina Toutanova , Alaaeldin El Nouby , Michael Laskin , Jacob Andreas , Ivo Danihelka , Soravit Changpinyo , Jacob Devlin , Donald Metzler , Gabriel Barth Maron , Gideon Mann , Colin Raffel , Elvis Saravia , Roberts Adam , Hongye Jin , Kaixiong Gong , David Dohan , Junyang Lin , Aaron Courville , Trevor Cai , Sebastian Gehrmann , Katherine Lee , Iain Barr , Zihang Dai , Yulia Tsvetkov , Xiaotian Han , Mohit Iyyer , Andrej Karpathy , Jamie Ryan Kiros , Clement Delangue , Jason Wei , Josip Djolonga , Mandar Joshi , Ethan Dyer , Abdelrahman Mohamed , Maria Bauza , Peterj Liu , Percy Liang , Anurag Arnab , Vinay Ramasesh , Gato Reed , Chang Zhou , Mark Dredze , Abhinav Shrivastava , Piotr Bojanowski , Vasudev Alwala , Marjan Ghazvininejad , Guillem Cucurull , Xiaohu Li , Christopher Akiki , Qizhang Feng , Christopher Clark , Henryk Michalewski , Sharan Narang , Alexander Kolesnikov , Kyunghyun Cho , Ming Wei Chang , Denny Zhou , Giulia Vezzani , Pieter Abbeel , Ozan Irsoy , Pauline Luc , Yinhan Liu , Geoffrey Hinton , Prabhanjan Kambadur , Karthik Narasimhan , Greg Brockman , Noam Shazeer , Robert Stojnic , Ehsan Adeli , Kenton Lee , Jakob Uszkoreit , Casey Chu , Aniruddha Kembhavi , Zhikang Li , Xavier Martinet , Benjamin Mann , Pierric Cistac , Bosma Maarten , Exavier Garcia , Mannat Singh , Carlos Riquelme Ruiz , Patrick Esser , Myle Ott , Illia Polosukhin , Chen Xing , Alexander Novikov , Wei Li , Ruslan Salakhutdinov , Thomas Unterthiner , Las Casas , Igor Mordatch , Emilio Parisotto , Xiao Yang Liu , Victor Sanh , Imagebind Girdhar , Eliza Rutherford , Yevgen Chebotar , Thibaut Lavril , Francois Chollet , Joseph Dabis , Russ Altman , Yanqi Zhou , Guoxing Yang , Le Scao , Kevin Lin , Dara Bahri , Viktor Kerkez , Piotr Padlewski , Ishan Misra , Kai Zheng , Mai Gimenez , Chelsea Finn , Yi Tay , Xiaohua Zhai , Saurabh Singh , Andrew Mattarella Micke , Dominik Lorenz , Albert Webson , Mostafa Dehghani , Hany Hassan Awadalla , Vadim Dabravolski , Marie Anne Lachaux , Jeff Donahue , Chris Hallacy , Michele Bevilacqua , Sandhini Agarwal , Junliang Guo , Ruixiang Tang , Nicolas Usunier , Wanli Ouyang , Tim Salimans , Ross Girshick , Julien Chaumond , Alex Krizhevsky , Roozbeh Mottaghi , Mihir Kale , Kalpesh Krishna , Christopherd Manning , Melanie Subbiah , Resdual Xie , Dale Schuurmans , Adam Roberts , Alexx Lee , Simran Arora , Hongxia Yang , Aravind Srinivas , Sergey Zagoruyko , Abhinav Gupta , Aditya Ramesh , Dushyant Rao , Jingren Zhou , Adams Wei Yu , Alexander Ku , Xinyun Chen , Christian Szegedy , Greg Wayne , Kevin Lu , Shuxin Zheng , Alex Nichol , Mohammad Rastegari , Xiangyu Zhang , Tao Tu , Coline Devin , Keerthana Gopalakrishnan , Ilya Sutskever , Arvind Neelakantan , Liwei Wang , Michael Matena , Anders Andreassen , Yunchang Yang , David Rosenberg , Francisco Massa , Konrad Zolna , Xuezhi Wang , Ambrose Slone , Flashattention Dao , Punta Cana , Jialin Wu , Sherman Wong , Arthur Mensch ,