News & Analysis
Memristor emulates neural learning
R Colin Johnson
4/15/2010 11:55 AM EDT
PORTLAND, Ore. Synapses are the bit-cells of the brain, and they behave more like memristors than any other electronic circuit element, according to the University of Michigan researchers who recently demonstrated that a single memristor can learn using the same technique as the human brain.
![]() |
| Researchers demonstrate memristors emulating the learning function of a neural network by changing the strength of its synaptic connections in response to synchronized voltage spikes. |
Their findings will be published in Nano Letters.
Neural networks can learn patterns that are too difficult for engineers to craft as specific algorithms, but they depend on an analog memory element called a synapse, which today is simulated on supercomputers as a numerical value. Learning occurs when simultaneous voltage spikes are generated from feature detectors in the senses, like edge detectors in the eye. When the simultaneous spikes come in, say from the edge detectors in both eyes, the receiving synapse in the brain responds by increasing its value--a digit used for supercomputer simulations.
Instead, memristors change its resistance value.
According to the University of Michigan researchers led by Professor Wei Lu, memristors respond to these simultaneous voltage pulses--called spike timing dependent plasticity--in a manner nearly identical to that of brain synapses, making them a viable alternative to supercomputer simulations. Massive crossbar networks of memristors, proposed by HP Labs researchers could create a more accurate and much faster executing emulation of brain functions than supercomputer simulations.
Last year, the Defense Advanced Research Project Agency (Darpa) signed up three teams led by HP, IBM and HRL Labs to determine the best way to develop the brain's learning element in its SyNAPSE (Systems of Neuromorphic Adaptive Plastic Scalable Electronics) program. A prototype is due by next year.
Hewlett Packard has been studying the use of memristors as synapses for the Darpa program, and will be describing its efforts later this year.
Last year IBM announced it has achieved an accurate supercomputer simulation of a cat brain, for which it received the Association for Computing Machinery Gordon Bell Prize at Supercomputer 2009. Called Blue Matter, the simulation could eventually be transferred to hardware using electronic synapses like those being developed at University of Michigan.
"The cat brain sets a realistic goal because it is much simpler than a human brain, but still extremely difficult to replicate in complexity and efficiency," said Lu. The goal would be to create memristive devices that someday achieve the performance of a supercomputer in a machine the size of a 2-liter bottle.
The University of Michigan research was funded by both Darpa and the National Science Foundation.



Mapou
4/16/2010 12:02 AM EDT
Interesting. However, even though simulating a synapse or a neuron is nice but what is even more important is the ability to physically link those neurons to hundreds or thousands of other neurons in the network. Oftentimes, the neurons can be very distant. Memristors do not provide a solution for this problem.
*
Also, synaptic learning in the sensory cortex is not based on the concurrency of the spikes but on afferent signals arriving about 10 milliseconds before the post-synaptic action potential. See the work of Henry Markram for more on this.
Sign in to Reply
SOY
4/16/2010 7:53 AM EDT
>Memristors do not provide a solution for this problem.
As mentioned in the article, crossbar behaves as interconnection network, and its crosspoint is the synapse-like element.
Sign in to Reply
R_Colin_Johnson
4/16/2010 11:37 AM EDT
Memristors are just a part of the solution. IBM, Hewlett Packard, HRL and their university partners are all looking at these other issues too. Look for a flurry of results over the next 6 to 18 months.
Sign in to Reply
SOY
4/17/2010 5:52 AM EDT
Johnson-san,
Hi, thank you for your valuable articles. I think this is one of reconfigurable computing approaches (or simply FPGA based computings, and or Adaptive Computing from DARPA). And curbon nano-wire based PLD (nanoPLD) researched by Prof. Andre DeHon and the memoristor based computing researched by hp have common scense or face to common direction. Difference between them is probably how many states held by memory element (cross-point, nano-wire may be only one bit, but memoristor may hold multi-bit).
Xbar network is the key that behaves both of the memory and interconnect.
I request you to report not only the structure (or architecture) but also application and HOW TO PROGRAM at initial state or HOW TO CONFIGURE at initial state. Currently FPGA support JTAG based programming, but it is no scense.
And I think this is solution for application-specific computing that means application is statically mapped to the device and does not change to other application (does not make context-switch). Of course, forcing the switching is possible, but it breaks data flow on device, this means a cost involving extra time and space if switching is taken.
Sign in to Reply