Open this publication in new window or tab >>2021 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]
Mixed-signal neuromorphic processors emulate the electrochemical dynamics of neurons and synapses using conventional analog CMOS-transistor technology and have potential for ultra-low-power machine learning and inference. However, the energy-efficiency of such systems is dependent on sparse, time-based information encoding and processing, and they are, furthermore, subject to imprecision from “device mismatch” in the analog circuitry. Hence, there is a need for methods for neuromorphic computing based on principles of dynamic neural processing for efficient use and programming of these low-power but inhomogeneous systems.
In this thesis, inspiration is drawn from a temporal feature-detection circuit in crickets for the design of a disynaptic delay element—based on excitatory–inhibitory balance—which induces neuronal excitation-delays for resource-efficient coincidence-based pattern recognition. Due to the inhomogeneous dynamics, such disynaptic elements generate a distribution of temporal delays when implemented in mixed-signal hardware, both between and within single neurons. Here, this is utilized as a source of the variability needed for spatiotemporal information representation for processing and learning—as a resource-efficient alternative to dedicated axonal or neuronal delays or emulation of dendritic dynamics.
In experiments with a DYNAP-SE neuromorphic processor, connected in a closed loop with a PC and a digital oscilloscope, disynaptic delays of up to 100 ms were characterized, with an intraneuronal variability of order 10 ms. Using the disynaptic delays, spatiotemporal receptive fields with up to five dimensions per hardware neuron were investigated in a Spatiotemporal Correlator (STC) type neural network, as well as in some simple networks inspired by the auditory system of crickets. The energy dissipation of the balanced synaptic elements is one order of magnitude lower per lateral connection (0.65 nJ vs 9.6 nJ per spike) than the original hardware implementation of the STC.
Thus, it is shown how the inhomogeneous synaptic circuits could be utilized for resource-efficient implementation of STC-type network layers, in a way that enables synapse-address reprogramming as a discrete mechanism for feature tuning. The presented approach may serve as a complement to more accurate but resource-intensive delay-based coincidence detection or dendritic integration, offering a digital network-state representation and adaptation concept that can fully benefit from the inhomogeneous analog neurosynaptic dynamics in the forward pass.
Place, publisher, year, edition, pages
Luleå University of Technology, 2021
Series
Licentiate thesis / Luleå University of Technology, ISSN 1402-1757
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Cyber-Physical Systems
Identifiers
urn:nbn:se:ltu:diva-85267 (URN)978-91-7790-889-0 (ISBN)978-91-7790-890-6 (ISBN)
Presentation
2021-10-25, E632, Luleå tekniska universitet, Luleå, 10:00 (English)
Opponent
Supervisors
2021-06-112021-06-112023-09-05Bibliographically approved