off-topic question: is it possible to speed up a neuron network software using a gpu or specialized hardware running openCL ? what about using supercomputers ?
Actually, that's exactly how they speed up neural networks, especially deep neural networks. Andrew Ng showed that they could run the Google Brain on COTS GPUs for about $21,000 [1].
You can experiment with this yourself using a package like Theano (Python) [2] or Caffe (C++) [3].
Comments
off-topic question: is it possible to speed up a neuron network software using a gpu or specialized hardware running openCL ? what about using supercomputers ?
Actually, that's exactly how they speed up neural networks, especially deep neural networks. Andrew Ng showed that they could run the Google Brain on COTS GPUs for about $21,000 [1].
You can experiment with this yourself using a package like Theano (Python) [2] or Caffe (C++) [3].
[1] http://cs.stanford.edu/people/ang/?news=stanford-team-develo... [2] http://deeplearning.net/software/theano/ [3] http://caffe.berkeleyvision.org