Comment Re:Deep learning? (Score 1) 162
The term "deep" comes from the idea that the algorithm is trying to learn something deeper than previous algorithms. In fact, the usual set of machine learning algorithms are termed shallow learning now.
The difference is that deep learning tries to model P(X) whereas shallow learning (SVM, NN, naive Bayes, etc..) try to learn P(X|Y) where X is your input space and Y is the label space.
In deep learning, these neural networks are not your usual NNs. Deep learning isn't just taking advantage of hardware scaling for more nodes and layers, rather it uses convolutional NNs which are slightly different.
Another difference is that deep learning is trying to learn an efficient representation for the inputs, i.e. automatic feature generation. This is not to say it trying to become an automatic unsupervised learning technique, but instead a supervised learning approach that takes care of the most time intensive and critical process (and typically unappreciated and overlooked) of any machine learning process -- feature extraction/generation.
In deep learning, these neural networks are not your usual NNs. Deep learning isn't just taking advantage of hardware scaling for more nodes and layers, rather it uses convolutional NNs which are slightly different.
Another difference is that deep learning is trying to learn an efficient representation for the inputs, i.e. automatic feature generation. This is not to say it trying to become an automatic unsupervised learning technique, but instead a supervised learning approach that takes care of the most time intensive and critical process (and typically unappreciated and overlooked) of any machine learning process -- feature extraction/generation.