Issue No. 05 - October (1996 vol. 16)
Although digital circuits are replacing analog circuits in traditional processing tasks, analog technology will certainly play a dominant role in carrying out real-time perceptive tasks. Indeed, these tasks do not need the precise computation achievable by digital processing. They require the parallel and collective processing of a massive flow of data, for which low-precision analog circuits are more efficient with respect to power consumption and chip area.
Paper contributions to the 1996 MicroNeuro conference, from which we selected the articles for this issue of IEEE Micro, were balanced between analog and digital implementations. However, MicroNeuro confirmed the trend toward analog technology by devoting two full sessions to analog VLSI for vision and for the implementation of new processing schemes inspired by a closer examination of biological solutions. (See the accompanying box for a more thorough description of MicroNeuro 96.)
Selecting a few MicroNeuro papers for revision and adaptation for Micro was not an easy task. To represent the conference profile, we have chosen one article on a digital implementation, four on analog implementations, and one on a very original technical application.
The L-Neuro 2.3 digital architecture developed by M. Duranton of LEP in France is a vector processor composed of an array of 12 DSPs, well adapted to image processing. The operative units are controlled by 286-bit-wide (micro)instructions issued at a 60-MHz frequency. To develop the software, Duranton's group used VML, a virtual machine language defined at UCL London as part of the ESPRIT Galatea project.
In the next article, A. Kramer analyzes the architecture of neural networks—based on summing the output of local operators (synapses) organized in 2D arrays. He shows that this architecture is perfectly suited to exploit the very high efficiency of analog computation when an overall precision of 5 to 6 bits is acceptable. Kramer describes three VLSI chips using different local operators working in different modes: One chip obtains the Manhattan distance in charge mode by exploiting device physics; the second computes the dot product in conductance mode; and the third computes the Euclidean distance in current mode. Each chip has its respective merits with respect to power consumption, speed, chip area, and application domain.
The retinomorphic system K. Boahen describes further demonstrates the high efficiency of analog processing. Far from being just a camera, the retina is an extension of the brain that provides acquisition, conditioning, spatiotemporal filtering, and optimum coding for further communication and processing of the image projected on it. Boahen uses a dense array of analog cells to implement similar features on silicon chips. We expect this silicon retina to drastically enhance the performance of future artificial vision systems, in which it will function as a front end.
The article by G. Indiveri, J. Kramer, and C. Koch shows how to achieve robust operation—despite the very limited precision of low-power, small analog cells—by using collective processing in a cell array. The authors describe three different analog VLSI systems that rely on integrative features of the optical-flow field evaluated by arrays of compact analog velocity sensors. One system obtains the focus of expansion by selecting the steepest and closest zero crossing of velocity. The second evaluates time to contact through summing the activities of velocity sensors arranged on a circle. The third uses motion discontinuity detection to control the local amount of smoothing and thus segment images into different objects.
Analog computation can operate in an essentially passive manner through the distribution of DC current sources in networks of variable linear resistors. We can implement such schemes in VLSI using transistors operated as pseudoconductances. The short article by O. Landolt demonstrates the potential of this approach for the synthesis of any arbitrary nonlinear function of possibly several variables. His architecture is equivalent to the analog implementation of fuzzy rules, and proves very efficient for chip area and the power-delay product.
Biological solutions found in central nervous systems partially inspired all these analog circuits. The last article, by B. Gupta et al., describes an experimental system inspired by the sensor-actuator loops believed to exist in the skin of sharks to achieve active drag reduction. It consists of arrays of micromachined sensors and actuators combined with analog VLSI circuits. The first experiments yield attractive results with possible applications in active drag reduction for critical parts of aircraft wings.
We wish you good reading of this issue, and hope that it will give you some feeling of the need for increased neural network processing power, and how this can be implemented.
Eric A. Vittoz is senior vice president heading the Bio-Inspired System Section of the Swiss Center for Electronics and Microtechnology (CSEM) in Neuchâtel. He also lectures and supervises student projects in analog circuit design at the Swiss Federal Institute of Technology in Lausanne (EPFL), where he is a professor. Formerly, he was executive vice president, integrated circuits and systems, for CSEM's Circuits and Systems Research Division. His field of research interest is the design of low-power analog CMOS circuits, with emphasis on their application to analog VLSI for perceptive computation.Vittoz received MS and PhD degrees in electrical engineering from EPFL and is a fellow of the IEEE. He has published more than 100 articles and holds 25 patents.
Jean-Daniel Nicoud is a professor at EPFL and director of LAMI, the university's Microprocessor and Interface Lab. He has actively pursued microprocessor-related research, designing many microprocessor-based systems. His interests and those of his research group include microcomputers, peripherals, autonomous robotic systems, and neural networks. He is now very concerned with the application of robots in searching for anti-personnel mines and the development of adequate sensors for this purpose. World Wide Web access to a description of his lab is http://diwww.epfl.ch/lami/.Nicoud received an MS in physics and a PhD in electrical engineering from EPFL. He has authored four books and numerous articles and is a member of the IEEE.