Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Synaptic Integration of Spatiotemporal Features with a Dynamic Neuromorphic Processor
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Internet Systems Lab.ORCID iD: 0000-0003-1024-5821
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Internet Systems Lab.ORCID iD: 0000-0002-6756-0147
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Internet Systems Lab.ORCID iD: 0000-0001-5662-825X
2020 (English)In: 2020 International Joint Conference on Neural Networks (IJCNN): Conference Proceedings, IEEE, 2020, article id 21471Conference paper, Published paper (Refereed)
Abstract [en]

Spiking neurons can perform spatiotemporal feature detection by nonlinear synaptic and dendritic integration of presynaptic spike patterns. Multicompartment models of nonlinear dendrites and related neuromorphic circuit designs enable faithful imitation of such dynamic integration processes, but these approaches are also associated with a relatively high computing cost or circuit size. Here, we investigate synaptic integration of spatiotemporal spike patterns with multiple dynamic synapses on point-neurons in the DYNAP-SE neuromorphic processor, which offers a complementary resource-efficient, albeit less flexible, approach to feature detection. We investigate how previously proposed excitatory–inhibitory pairs of dynamic synapses can be combined to integrate multiple inputs, and we generalize that concept to a case in which one inhibitory synapse is combined with multiple excitatory synapses. We characterize the resulting delayed excitatory postsynaptic potentials (EPSPs) by measuring and analyzing the membrane potentials of the neuromorphic neuronal circuits. We find that biologically relevant EPSP delays, with variability of order 10 milliseconds per neuron, can be realized in the proposed manner by selecting different synapse combinations, thanks to device mismatch. Based on these results, we demonstrate that a single point-neuron with dynamic synapses in the DYNAP-SE can respond selectively to presynaptic spikes with a particular spatiotemporal structure, which enables, for instance, visual feature tuning of single neurons.

Place, publisher, year, edition, pages
IEEE, 2020. article id 21471
Series
International Joint Conference on Neural Networks, ISSN 2161-4393, E-ISSN 2161-4407
Keywords [en]
Spiking Neural Networks, Neuromorphic, Spatiotemporal, Feature Detection, Synaptic and Dendritic Integration, DYNAP
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering Computer Sciences
Research subject
Cyber-Physical Systems; Machine Learning
Identifiers
URN: urn:nbn:se:ltu:diva-77686DOI: 10.1109/IJCNN48605.2020.9207210ISI: 000626021404116Scopus ID: 2-s2.0-85093820242OAI: oai:DiVA.org:ltu-77686DiVA, id: diva2:1392851
Conference
2020 International Joint Conference on Neural Networks (IJCNN), 19–24 July, 2020, Glasgow, United Kingdom
Funder
The Kempe Foundations, JCK-1809, SMK-1429The Swedish Foundation for International Cooperation in Research and Higher Education (STINT), IG2011-2025
Note

ISBN för värdpublikation: 978-1-7281-6926-2, 978-1-7281-6927-9

Available from: 2020-02-13 Created: 2020-02-13 Last updated: 2023-09-05Bibliographically approved
In thesis
1. Using Inhomogeneous Neuronal–Synaptic Dynamics for Spatiotemporal Pattern Recognition in Neuromorphic Processors
Open this publication in new window or tab >>Using Inhomogeneous Neuronal–Synaptic Dynamics for Spatiotemporal Pattern Recognition in Neuromorphic Processors
2021 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Mixed-signal neuromorphic processors emulate the electrochemical dynamics of neurons and synapses using conventional analog CMOS-transistor technology and have potential for ultra-low-power machine learning and inference. However, the energy-efficiency of such systems is dependent on sparse, time-based information encoding and processing, and they are, furthermore, subject to imprecision from “device mismatch” in the analog circuitry. Hence, there is a need for methods for neuromorphic computing based on principles of dynamic neural processing for efficient use and programming of these low-power but inhomogeneous systems.

In this thesis, inspiration is drawn from a temporal feature-detection circuit in crickets for the design of a disynaptic delay element—based on excitatory–inhibitory balance—which induces neuronal excitation-delays for resource-efficient coincidence-based pattern recognition. Due to the inhomogeneous dynamics, such disynaptic elements generate a distribution of temporal delays when implemented in mixed-signal hardware, both between and within single neurons. Here, this is utilized as a source of the variability needed for spatiotemporal information representation for processing and learning—as a resource-efficient alternative to dedicated axonal or neuronal delays or emulation of dendritic dynamics.

In experiments with a DYNAP-SE neuromorphic processor, connected in a closed loop with a PC and a digital oscilloscope, disynaptic delays of up to 100 ms were characterized, with an intraneuronal variability of order 10 ms. Using the disynaptic delays, spatiotemporal receptive fields with up to five dimensions per hardware neuron were investigated in a Spatiotemporal Correlator (STC) type neural network, as well as in some simple networks inspired by the auditory system of crickets. The energy dissipation of the balanced synaptic elements is one order of magnitude lower per lateral connection (0.65 nJ vs 9.6 nJ per spike) than the original hardware implementation of the STC.

Thus, it is shown how the inhomogeneous synaptic circuits could be utilized for resource-efficient implementation of STC-type network layers, in a way that enables synapse-address reprogramming as a discrete mechanism for feature tuning. The presented approach may serve as a complement to more accurate but resource-intensive delay-based coincidence detection or dendritic integration, offering a digital network-state representation and adaptation concept that can fully benefit from the inhomogeneous analog neurosynaptic dynamics in the forward pass.

Place, publisher, year, edition, pages
Luleå University of Technology, 2021
Series
Licentiate thesis / Luleå University of Technology, ISSN 1402-1757
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Cyber-Physical Systems
Identifiers
urn:nbn:se:ltu:diva-85267 (URN)978-91-7790-889-0 (ISBN)978-91-7790-890-6 (ISBN)
Presentation
2021-10-25, E632, Luleå tekniska universitet, Luleå, 10:00 (English)
Opponent
Supervisors
Available from: 2021-06-11 Created: 2021-06-11 Last updated: 2023-09-05Bibliographically approved
2. Event-Driven Architectures for Heterogeneous Neuromorphic Computing Systems
Open this publication in new window or tab >>Event-Driven Architectures for Heterogeneous Neuromorphic Computing Systems
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Alternative title[sv]
Händelsedrivna arkitekturer för heterogena neuromorfa datorsystem
Abstract [en]

Mixed-signal neuromorphic processors have brain-like organization and device physics optimized for emulation of spiking neural networks (SNNs), and offer an energy-efficient alternative for implementing artificial intelligence in applications where deep learning based on conventional digital computing is unfeasible or unsustainable. However, efficient use of such hardware requires appropriate configuration of its inhomogeneous, analog neurosynaptic circuits, with methods for sparse, spike-timing-based information encoding and processing. Furthermore, as neuromorphic processors are event-driven and asynchronous with massively parallel dynamic processing and colocated memory, they differ fundamentally from conventional von Neumann computers. Therefore, there is a need to investigate programming approaches and learning mechanisms for efficient use of neuromorphic processors, as well as abstractions required for large-scale integration of such devices into the present computational infrastructure of distributed digital systems. In this thesis, a disynaptic excitatory–inhibitory (E–I) element for resource-efficient generation of synaptic delay dynamics for spike-timing-based computation in neuromorphic hardware is proposed. Chip-in-the-loop experiments with a DYNAP-SE neuromorphic processor and SNN simulations are presented, demonstrating how such E–I elements leverage hardware inhomogeneity for representational variance and feature tuning for time-dependent pattern recognition. Using the E–I elements, spatiotemporal receptive fields with up to five dimensions per hardware neuron were characterized, for instance in a modified Spatiotemporal Correlator (STC) network and in an insect-inspired SNN. The energy dissipation of the proposed E–I element is one order of magnitude lower per lateral connection (0.65 vs. 9.6 nJ per spike) than the original delay-based hardware implementation of the STC. Thus, it is shown how the analog synaptic circuits could be used for efficient implementation of STC network layers, in a way that enables digital synapse-address reprogramming as an observable and reproducible mechanism for feature tuning in SNN layers. This approach may serve as a complement to more accurate but resource-intensive delay-based SNNs, as it offers a digital network-state representation and adaptation concept that can fully benefit from the inhomogeneous neurosynaptic dynamics in the inference stage. Furthermore, a microservice-based conceptual framework for neuromorphic systems integration is proposed. The framework consists of a neuromorphic-system proxy that provides virtualization and communication capabilities required in distributed settings, combined with a declarative programming approach offering engineering-process abstraction. By combining several well-established concepts from different domains of computer science, this work addresses the gap between the state of the art in digitization and neuromorphic computing software development.

Place, publisher, year, edition, pages
Luleå: Luleå tekniska universitet, 2023
Series
Doctoral thesis / Luleå University of Technology 1 jan 1997 → …, ISSN 1402-1544
Keywords
Neuromorphic computing, Mixed-signal, Low-power, Non-von Neumann, Spatiotemporal pattern recognition, System integration
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Cyber-Physical Systems
Identifiers
urn:nbn:se:ltu:diva-94116 (URN)978-91-8048-219-6 (ISBN)978-91-8048-220-2 (ISBN)
Public defence
2023-02-06, A109, Luleå tekniska universitet, Luleå, 13:00 (English)
Opponent
Supervisors
Funder
The Kempe Foundations, JCK-1809EU, Horizon 2020, 737459
Available from: 2022-11-21 Created: 2022-11-21 Last updated: 2023-09-05Bibliographically approved

Open Access in DiVA

Nilsson_2020_Synaptic_Integration(365 kB)236 downloads
File information
File name FULLTEXT01.pdfFile size 365 kBChecksum SHA-512
5ec43174ca67a70e63944fbd23d5222c0380ecc92c948500c733d2d16cdf6f157b48daa26ddc8bdc67b16e4dcfc79443c8e9a902a1be237cdf0f3dee061b76d9
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Nilsson, MattiasLiwicki, FoteiniSandin, Fredrik
By organisation
Embedded Internet Systems Lab
Other Electrical Engineering, Electronic Engineering, Information EngineeringComputer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 236 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 368 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf