In Hinton's Coursera class, which was very good, he made a strong point about GPUs being the way to go (at least for now) in building deep learning networks.
Why are they still using GPUs? Maybe hardware companies should start making AI targeted processors instead. Could they boost performance 10 times with a dedicated processor?