[Note: The following is an excerpt from a paper I am writing as part of the eventual release of the Rebel Speech demo program, the world's first unsupervised audio classifier. I have not yet set a date for the release. Please be patient.]
Signals, sensors, patterns and sequences are the basis of the brain’s amazing ability to understand the world around it. In this paper, I explain how it uses them for perception and learning. Although I delve a little into the neuroscience at the end, I restrict my explanation mostly to the logical and functional organization of the cerebral cortex.
The Perceptual System
Perception is the process of sensing and understanding physical phenomena. The brain’s perceptual system consists of four subsystems: the world, the sensory layer, pattern memory and sequence memory. Both pattern and sequence memories are unsupervised, feedforward, hierarchical neural networks. As explained later, the term “memory” is somewhat inadequate. The networks are actually high level or complex sensory organs. An unsupervised network is one that can classify patterns, objects or actions in the world directly from sensory data. A feedforward network is one in which input information flows in only one direction. A hierarchical network is organized like a tree. That is to say, higher level items are composed of lower level ones.
Signals from pattern detectors travel to sequence memory where sequences (transformations) are detected. Sequence memory is the seat of attention and of short and long-term memory. It is also where actual object recognition occurs. An object is a top-level sequence, i.e., a branch in the sequence hierarchy. A recognition event is triggered when the number of signals arriving at a top sequence detector surpasses a preset threshold. Recognition signals (green arrow) from sequence memory are fed back to pattern memory. They are part of the mechanism used by the brain to deal with noisy or incomplete patterns in the sensory stream.
Sequence memory can also generate motor signals but that is beyond the scope of this paper. What follows is a detailed description of each of the four subsystems.
(to be continued)