Generative models for discovering sparse distributed representations. |
| |
Authors: | G E Hinton Z Ghahramani |
| |
Institution: | Department of Computer Science, University of Toronto, Ontario, Canada. |
| |
Abstract: | We describe a hierarchical, generative model that can be viewed as a nonlinear generalization of factor analysis and can be implemented in a neural network. The model uses bottom-up, top-down and lateral connections to perform Bayesian perceptual inference correctly. Once perceptual inference has been performed the connection strengths can be updated using a very simple learning rule that only requires locally available information. We demonstrate that the network learns to extract sparse, distributed, hierarchical representations. |
| |
Keywords: | |
|
|