Comment on Andrew Ng: Unbiggen AIComments−random3144yI am not sure why Ng seems to suggest he pioneered the use of GPUs for ML. It was pioneered by the Toronto lab led by Hinton, afaik.−rsfern4yIt seems like he was one of the people advocating using CUDA for deep learning before Krizhevsky’s big breakthrough in 2012.Not a primary source: https://medium.com/analytics-vidhya/gpu-for-deep-learning-7f...Alex Krizhevsky’s home page has a bunch of CUDA ConvNet stuff from ~2010https://www.cs.toronto.edu/~kriz/Edit: found a better source. Deep learning on GPUs dates to 2005, and Ng’s group has the first GPGPU ConvNet report in 2009, and Krizhevsky has the breakthrough in 2011/2https://www.deeplearningbook.org/contents/applications.html
Comments
I am not sure why Ng seems to suggest he pioneered the use of GPUs for ML. It was pioneered by the Toronto lab led by Hinton, afaik.
It seems like he was one of the people advocating using CUDA for deep learning before Krizhevsky’s big breakthrough in 2012.
Not a primary source: https://medium.com/analytics-vidhya/gpu-for-deep-learning-7f...
Alex Krizhevsky’s home page has a bunch of CUDA ConvNet stuff from ~2010
https://www.cs.toronto.edu/~kriz/
Edit: found a better source. Deep learning on GPUs dates to 2005, and Ng’s group has the first GPGPU ConvNet report in 2009, and Krizhevsky has the breakthrough in 2011/2
https://www.deeplearningbook.org/contents/applications.html