Hardware for Deep Learning: NVIDIA GPUs and Data Movement
hotchipsvideos · Talk · 1 h 5 min · 2023 · YouTube title: HC2023-K2: Hardware for Deep Learning
Why it's here
HN points to it for an insider view of why NVIDIA's AI gains came from design rather than process, and for data-movement power costs.
What it covers
Bill Dally of NVIDIA gives a Hot Chips 2023 keynote on the challenges of building hardware for deep learning. He traces how GPUs have been adapted for machine learning, especially training.