NVIDIA's Bill Dally on Deep Learning Hardware
Paul G. Allen School · Lecture · 1 h 11 min · 2023 · YouTube title: Trends in Deep Learning Hardware: Bill Dally (NVIDIA)
Why it's here
HN commenters cite it for NVIDIA's perspective on AI hardware efficiency, including logarithmic number formats and energy use.
What it covers
Bill Dally of NVIDIA gives a University of Washington lecture on trends in deep learning hardware. It covers numeric formats, specialized instructions, energy per operation and co-design of hardware and software.