Jason Weston, Frederic Ratle and Ronan Collobert. 2008. Deep Learning via Semi-Supervised Embedding. pdf of ppt. Proceedings of the Twenty-fifth International Conference on Machine Learning. Google Research Group.
- Dasgupta. 2011. Two Faces of Learning.
Scientists See Promise in Deep-Learning Programs NYT November 23, 2012 By JOHN MARKOFF
Nature 323, 533-536 (9 October 1986) | doi:10.1038/323533a0; Accepted 31 July 1986
David E. Rumelhart*, Geoffrey E. Hinton† & Ronald J. Williams* Learning representations by back-propagating errors
- Institute for Cognitive Science, C-015, University of California, San Diego, La Jolla, California 92093, USA
†Department of Computer Science, Carnegie-Mellon University, Pittsburgh, Philadelphia 15213, USA †To whom correspondence should be addressed. Top of pageAbstract We describe a new learning procedure, back-propagation, for networks of neurone-like units. The procedure repeatedly adjusts the weights of the connections in the network so as to minimize a measure of the difference between the actual output vector of the net and the desired output vector. As a result of the weight adjustments, internal 'hidden' units which are not part of the input or output come to represent important features of the task domain, and the regularities in the task are captured by the interactions of these units. The ability to create useful new features distinguishes back-propagation from earlier, simpler methods such as the perceptron-convergence procedure1.