Nvidia's H100: Funny L2, and Tons of Bandwidth – Chips and Cheese
GPUs started out as devices meant purely for graphics rendering, but their highly parallel nature made them attractive for certain compute tasks too. As the GPU compute scene grew over the past couple decades, Nvidia made massive investments to capture the compute market. Part of this involved recognizing that compute tasks have different needs than…
Source: chipsandcheese.com