Stay updated with breaking news from Jacob Devlin. Get real-time updates on events, politics, business, and more. Visit us for reliable news and exclusive interviews.
Google Bard has become Google Gemini, and the generative AI has some new tricks to go with the rebranding. Here's how to access it, whether or not you should pay for Gemini Advanced, and whether or no
A deep dive into Transformer a neural network architecture that was introduced in the famous paper “attention is all you need” in 2017, its applications, impacts, challenges and future directions
Announcing our nominees for the VB Transform AI Innovation awards multiple generative AI categories.
The AI Times is a weekly newsletter covering the biggest AI, machine learning, big data, and automation news from around the globe.
I trained a BERT model (Devlin et al, 2019) from scratch on my desktop PC (which has a Nvidia 3060 Ti 8GB GPU). The model architecture, tokenizer, and trainer all came from Hugging Face libraries, and my contribution was mainly setting up the code, setting up the data (~20GB uncompressed text), and leaving my computer running. (And making sure it was working correctly, with good GPU utilization.)