PORTLAND, Ore.—By replicating the functions of neurons, synapses, dendrites and axons in the brain using special-purpose silicon circuitry, IBM claims to have developed the first custom cognitive computing cores that bring together digital spiking neurons with ultra-dense, on-chip, crossbar synapses and event-driven communication.
IBM's effort is the crowning achievement of a "phase zero" and "phase one" contract with the Defense Advanced Research Project Agency (DARPA) to build Systems of Neuromorphic Adaptive Plastic Scalable Electronics (SyNAPSE), IBM and its university partners—Columbia University, Cornell University, and University of California-Merced, and the University of Wisconsin-Madison—now enter "phase two," which extends their efforts for another 18 months with a new infusion of $21 million in funding. DARPA funding the project has received thus far, including the new funding, amounts to $41 million in total.
The eventual goal is to create a brain-like 10 billion neuron, 100 trillion synapse cognitive computer with comparable size and power consumption to the human brain.
"We want to extend and complement the traditional von Neumann computer for realtime uncertain environments," said Dharmendra Modha, project leader for IBM Research. "Cognitive computers must integrate the inputs from multiple sensors in a context dependent fashion in order to close the realtime sensory-motor feedback loop."
Though IBM claims its custom cognitive computing cores are the first of their kind, a rival European program using conventional ARM cores called SpiNNaker— for spiking neural network architecture—was announced last month.
Traditional von Nuemann computers are ill-equipped to deal with the multiple simultaneous data streams coming in from sensors today, but brains handle these easily by distributing processing and memory among its neural networks. In particular, sensors feed neurons down input lines called dendrites.
IBM's Cognitive Computing Chip, at about 3-mm wide, has demonstrated the ability to play (and win) against a human in the game "Pong" and can also read a written letter 7, even when written in various ways.
The neuron integrates over these inputs until a threshold is exceeded, at which point it fires a pulse down its output axon, which is weighted by the synapses connected to other neurons. Pattern recognition is accomplished by the synapses "learning" which connections are used most often, which causes them to grow stronger, while seldom used connections wither away. In this way, the neural network closes the sensory-motor feedback loop, since once a pattern is recognized from the sensor inputs, the output motor neurons mobilize a response.
IBM replicates the brain's architecture by using a crossbar array to hold the synapses, which then learn which sensory patterns correspond to which desired motor control outputs. The crossbar array connects the neurons to sensor inputs by integrating over a large fan-in of dendrites, then firing output pulses down axons which feed individual synaptic connections to the other neurons in the network.
"Synapses are realized with a crossbar array, in which the vertical lines are the input dendrites and horizontal lines are the output axons," said Modha. "Each neuron fires in order to communicate with the other neurons which fully integrates memory with processor, instead of separating them like von Neumann."
I have just been asked to explain the final sentence in my posting above, there was a typo. It should have read: "However, that path tends to lead to the conclusion that CBRAM might offer a superior solution." I meant the Conducting Bridge RAM, that offers, by electrochemical action the precision to add and remove individual layers of atoms. Without that is the need for melting, high temperatures and high current densities associated with "reset" in conventional PCM. Apologies.
Say thanks a lot for your time and effort to have put these things together on this blog. Mary and I very much loved your ideas through the articles on certain things.
You seem to be confused regarding the difference between programming a computer to beat people at Pong (which obviously happened when the Pong console came out) and having a computer learn to do the same thing. That's fine; being confused is fine. Matched with your arrogance, however, and your confusion becomes tiresome.