Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Spatiotemporal Pattern Recognition in Single Mixed-Signal VLSI Neurons with Heterogeneous Dynamic Synapses
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Internet Systems Lab.ORCID iD: 0000-0003-1024-5821
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Internet Systems Lab.ORCID iD: 0000-0002-6756-0147
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Internet Systems Lab.ORCID iD: 0000-0001-5662-825X
2022 (English)In: Proceedings of International Conference on Neuromorphic Systems 2022, Association for Computing Machinery (ACM), 2022, article id 4Conference paper, Published paper (Refereed)
Abstract [en]

Mixed-signal neuromorphic processors with brain-like organization and device physics offer an ultra-low-power alternative to the unsustainable developments of conventional deep learning and computing. However, realizing the potential of such neuromorphic hardware requires efficient use of its heterogeneous, analog neurosynaptic circuitry with neurocomputational methods for sparse, spike-timing-based encoding and processing. Here, we investigate the use of balanced excitatory–inhibitory disynaptic lateral connections as a resource-efficient mechanism for implementing a thalamocortically inspired Spatiotemporal Correlator (STC) neural network without using dedicated delay mechanisms. We present hardware-in-the-loop experiments with a DYNAP-SE neuromorphic processor, in which receptive fields of heterogeneous coincidence-detection neurons in an STC network with four lateral afferent connections per column were mapped by random input-sampling. Furthermore, we demonstrate how such a neuron was tuned to detect a particular spatiotemporal feature by discrete address-reprogramming of the analog synaptic circuits. The energy dissipation of the disynaptic connections is one order of magnitude lower per lateral connection (0.65 nJ vs 9.6 nJ per spike) than in the former delay-based hardware implementation of the STC.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2022. article id 4
Keywords [en]
Neuromorphic, Spatiotemporal pattern recognition, Ultra-low-power, Device mismatch, Neural heterogeneity, Temporal code, Excitatory-inhibitory balance
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Cyber-Physical Systems; Machine Learning
Identifiers
URN: urn:nbn:se:ltu:diva-85213DOI: 10.1145/3546790.3546794ISI: 001089500800004Scopus ID: 2-s2.0-85138354495OAI: oai:DiVA.org:ltu-85213DiVA, id: diva2:1563808
Conference
International Conference on Neuromorphic Systems (ICONS 2022), Knoxville, TN, USA, [HYBRID], July 27-29, 2022
Funder
The Kempe Foundations, JCK-1809European Commission, 737 459
Note

This paper has previously appeared as a manuscript in a thesis.

Available from: 2021-06-10 Created: 2021-06-10 Last updated: 2024-03-07Bibliographically approved
In thesis
1. Using Inhomogeneous Neuronal–Synaptic Dynamics for Spatiotemporal Pattern Recognition in Neuromorphic Processors
Open this publication in new window or tab >>Using Inhomogeneous Neuronal–Synaptic Dynamics for Spatiotemporal Pattern Recognition in Neuromorphic Processors
2021 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Mixed-signal neuromorphic processors emulate the electrochemical dynamics of neurons and synapses using conventional analog CMOS-transistor technology and have potential for ultra-low-power machine learning and inference. However, the energy-efficiency of such systems is dependent on sparse, time-based information encoding and processing, and they are, furthermore, subject to imprecision from “device mismatch” in the analog circuitry. Hence, there is a need for methods for neuromorphic computing based on principles of dynamic neural processing for efficient use and programming of these low-power but inhomogeneous systems.

In this thesis, inspiration is drawn from a temporal feature-detection circuit in crickets for the design of a disynaptic delay element—based on excitatory–inhibitory balance—which induces neuronal excitation-delays for resource-efficient coincidence-based pattern recognition. Due to the inhomogeneous dynamics, such disynaptic elements generate a distribution of temporal delays when implemented in mixed-signal hardware, both between and within single neurons. Here, this is utilized as a source of the variability needed for spatiotemporal information representation for processing and learning—as a resource-efficient alternative to dedicated axonal or neuronal delays or emulation of dendritic dynamics.

In experiments with a DYNAP-SE neuromorphic processor, connected in a closed loop with a PC and a digital oscilloscope, disynaptic delays of up to 100 ms were characterized, with an intraneuronal variability of order 10 ms. Using the disynaptic delays, spatiotemporal receptive fields with up to five dimensions per hardware neuron were investigated in a Spatiotemporal Correlator (STC) type neural network, as well as in some simple networks inspired by the auditory system of crickets. The energy dissipation of the balanced synaptic elements is one order of magnitude lower per lateral connection (0.65 nJ vs 9.6 nJ per spike) than the original hardware implementation of the STC.

Thus, it is shown how the inhomogeneous synaptic circuits could be utilized for resource-efficient implementation of STC-type network layers, in a way that enables synapse-address reprogramming as a discrete mechanism for feature tuning. The presented approach may serve as a complement to more accurate but resource-intensive delay-based coincidence detection or dendritic integration, offering a digital network-state representation and adaptation concept that can fully benefit from the inhomogeneous analog neurosynaptic dynamics in the forward pass.

Place, publisher, year, edition, pages
Luleå University of Technology, 2021
Series
Licentiate thesis / Luleå University of Technology, ISSN 1402-1757
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Cyber-Physical Systems
Identifiers
urn:nbn:se:ltu:diva-85267 (URN)978-91-7790-889-0 (ISBN)978-91-7790-890-6 (ISBN)
Presentation
2021-10-25, E632, Luleå tekniska universitet, Luleå, 10:00 (English)
Opponent
Supervisors
Available from: 2021-06-11 Created: 2021-06-11 Last updated: 2023-09-05Bibliographically approved
2. Event-Driven Architectures for Heterogeneous Neuromorphic Computing Systems
Open this publication in new window or tab >>Event-Driven Architectures for Heterogeneous Neuromorphic Computing Systems
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Alternative title[sv]
Händelsedrivna arkitekturer för heterogena neuromorfa datorsystem
Abstract [en]

Mixed-signal neuromorphic processors have brain-like organization and device physics optimized for emulation of spiking neural networks (SNNs), and offer an energy-efficient alternative for implementing artificial intelligence in applications where deep learning based on conventional digital computing is unfeasible or unsustainable. However, efficient use of such hardware requires appropriate configuration of its inhomogeneous, analog neurosynaptic circuits, with methods for sparse, spike-timing-based information encoding and processing. Furthermore, as neuromorphic processors are event-driven and asynchronous with massively parallel dynamic processing and colocated memory, they differ fundamentally from conventional von Neumann computers. Therefore, there is a need to investigate programming approaches and learning mechanisms for efficient use of neuromorphic processors, as well as abstractions required for large-scale integration of such devices into the present computational infrastructure of distributed digital systems. In this thesis, a disynaptic excitatory–inhibitory (E–I) element for resource-efficient generation of synaptic delay dynamics for spike-timing-based computation in neuromorphic hardware is proposed. Chip-in-the-loop experiments with a DYNAP-SE neuromorphic processor and SNN simulations are presented, demonstrating how such E–I elements leverage hardware inhomogeneity for representational variance and feature tuning for time-dependent pattern recognition. Using the E–I elements, spatiotemporal receptive fields with up to five dimensions per hardware neuron were characterized, for instance in a modified Spatiotemporal Correlator (STC) network and in an insect-inspired SNN. The energy dissipation of the proposed E–I element is one order of magnitude lower per lateral connection (0.65 vs. 9.6 nJ per spike) than the original delay-based hardware implementation of the STC. Thus, it is shown how the analog synaptic circuits could be used for efficient implementation of STC network layers, in a way that enables digital synapse-address reprogramming as an observable and reproducible mechanism for feature tuning in SNN layers. This approach may serve as a complement to more accurate but resource-intensive delay-based SNNs, as it offers a digital network-state representation and adaptation concept that can fully benefit from the inhomogeneous neurosynaptic dynamics in the inference stage. Furthermore, a microservice-based conceptual framework for neuromorphic systems integration is proposed. The framework consists of a neuromorphic-system proxy that provides virtualization and communication capabilities required in distributed settings, combined with a declarative programming approach offering engineering-process abstraction. By combining several well-established concepts from different domains of computer science, this work addresses the gap between the state of the art in digitization and neuromorphic computing software development.

Place, publisher, year, edition, pages
Luleå: Luleå tekniska universitet, 2023
Series
Doctoral thesis / Luleå University of Technology 1 jan 1997 → …, ISSN 1402-1544
Keywords
Neuromorphic computing, Mixed-signal, Low-power, Non-von Neumann, Spatiotemporal pattern recognition, System integration
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Cyber-Physical Systems
Identifiers
urn:nbn:se:ltu:diva-94116 (URN)978-91-8048-219-6 (ISBN)978-91-8048-220-2 (ISBN)
Public defence
2023-02-06, A109, Luleå tekniska universitet, Luleå, 13:00 (English)
Opponent
Supervisors
Funder
The Kempe Foundations, JCK-1809EU, Horizon 2020, 737459
Available from: 2022-11-21 Created: 2022-11-21 Last updated: 2023-09-05Bibliographically approved

Open Access in DiVA

Manuskript (preprint)(298 kB)149 downloads
File information
File name FULLTEXT01.pdfFile size 298 kBChecksum SHA-512
e289db4be127d361a17318518a119503edda053b67136637933ea7d38d2d00556b74f7ebf78d4bd784e9f0e47e33b7c800f23217bb5491fe3e7432073a375805
Type fulltextMimetype application/pdf
fulltext(668 kB)118 downloads
File information
File name FULLTEXT02.pdfFile size 668 kBChecksum SHA-512
201ba6caa39769e42937b8c54a0062685d920c0591b12f2db959d856a6d7ce90a4acfd5a037bb8e4fa511228bd83231c565a1eceef9fb1ff0c3cc3ba3977401d
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Nilsson, MattiasLiwicki, FoteiniSandin, Fredrik
By organisation
Embedded Internet Systems Lab
Other Electrical Engineering, Electronic Engineering, Information Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 267 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 265 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf