Neurons with dendrites can perform linearly separable computations with low resolution synaptic weights

Archive ouverte : Article de revue

Caze, Romain | Stimberg, Marcel

Edité par HAL CCSD ; Faculty of 1000

International audience. In theory, neurons modelled as single layer perceptrons can implement all linearly separable computations. In practice, however, these computations may require arbitrarily precise synaptic weights. This is a strong constraint since both biological neurons and their artificial counterparts have to cope with limited precision. Here, we explore how non-linear processing in dendrites helps overcome this constraint. We start by finding a class of computations which requires increasing precision with the number of inputs in a perceptron and show that it can be implemented without this constraint in a neuron with sub-linear dendritic subunits. Then, we complement this analytical study by a simulation of a biophysical neuron model with two passive dendrites and a soma, and show that it can implement this computation. This work demonstrates a new role of dendrites in neural computation: by distributing the computation across independent subunits, the same computation can be performed more efficiently with less precise tuning of the synaptic weights. This work not only offers new insight into the importance of dendrites for biological neurons, but also paves the way for new, more efficient architectures of artificial neuromorphic chips.

Consulter en ligne

Suggestions

Du même sujet

Any neuron can perform linearly non-separable computations

Archive ouverte: Article de revue

Cazé, Romain | 2021

International audience. Multiple studies have shown how dendrites enable some neurons to perform linearly non-separable computations. These works focus on cells with an extended dendritic arbor where voltage can var...

A New Fast Track to Nonlinear Modal Analysis of Power System Using Normal F...

Archive ouverte: Article de revue

Ugwuanyi, Nnaemeka Sunday | 2020-01-17

International audience. The inclusion of higher-order terms in small-signal (modal) analysis augments the information provided by linear analysis and enables better dynamic characteristic studies on the power system...

A CMOS Compatible Thermoelectric Device made of Crystalline Silicon Membran...

Archive ouverte: Article de revue

Bah, Thierno-Moussa | 2022-12-10

International audience. Herein, we report the use of nanostructured crystalline silicon as a thermoelectric material and its integration into thermoelectric devices. The proof-of-concept relies on the partial suppre...

Effet de l'angle de charge sur les harmoniques d'efforts magnétiques dans l...

Archive ouverte: Communication dans un congrès

Le Besnerais, Jean | 2016-06-07

International audience. Cet article étudie l'effet de l'angle de charge sur les efforts harmoniques de Maxwell (tangentiels et radiaux) et les bruits et vibrations d'origine magnétique dans deux machines synchrones ...

Further investigation of convolutional neural networks applied in computati...

Archive ouverte: Article de revue

Gong, Ruohan | 2022-04-07

International audience. Convolutional neural networks (CNN) have shown great potentials and have been proven to be an effective tool for some image-based deep learning tasks in the field of computational electromagn...

Thermal and hygroscopic study of hemp concrete in real ambient conditions

Archive ouverte: Article de revue

Asli, M. | 2021-04

International audience

Chargement des enrichissements...