IMR Press / JIN / Volume 17 / Issue 4 / DOI: 10.31083/j.jin.2018.04.0407
Open Access Research article
Anti-interference ability of deep spiking neural network
Lei Guo1,2,3,*Hongyi Shi1,2,3Yunge Chen1,2,3Hongli Yu1,2,3
Show Less
1 Department of Biomedical Engineering, College of Electrical Engineering, Hebei University of Technology, 300130, Tianjin, China
2 State Key Laboratory of Reliable and Intelligence of Electrical Equipment, School of Electrical Engineering, Hebei University of Technology, 300130, Tianjin, China
3 Key Laboratory of Electromagnetic Field and Electrical Apparatus Reliability of Hebei Province, School of Electrical Engineering, Hebei University of Technology, 300130, Tianjin, China
*Correspondence: 2004008@hebut.edu.cn (Lei Guo)
J. Integr. Neurosci. 2018, 17(4), 307–311; https://doi.org/10.31083/j.jin.2018.04.0407
Submitted: 15 December 2018 | Accepted: 7 January 2018 | Published: 15 November 2018
Copyright: © 2018 The authors. Published by IMR press.
This is an open access article under the CC BY–NC 4.0 license. https://creativecommons.org/licenses/by-nc/4.0/
Abstract

Organisms have the advantages of self-adaptive mechanisms and an anti-interference ability. To investigate the anti-interference ability of a deep spiking neural network that simulates a biological neural system, the correlation between membrane potential and firing rate is interpreted as an anti-interference index so as to investigate the anti-interference ability of a deep spiking neural network under the regulation of synaptic plasticity in the presence of different amplitudes of an electric field. When the relative variation rate of firing rate is less than 10% or the correlation between the membrane potential is greater than half, the influence of electric field on neural network is relatively small. Otherwise, the influence is relatively large. Simulation results show that: based on the regulation of synaptic plasticity, within a certain electric field interference range, the relative rate of variation of cell firing rates is small compared with non-interference, while correlation between the membrane potential in each layer is large when compared to non-interference.

Keywords
Deep spiking neural network
synaptic plasticity
anti-interference
electric field
firing rate
correlation
1 Introduction

Compared with other natural environments, the electromagnetic environment is invisible, untouchable, and variable. An organism under the regulation of a neural system has advantages of self-adaptive mechanisms and anti-interference abilities [1]. Organisms can resist electromagnetic interference thousand times greater than the magnitude of their own bioelectrical signals [2].

Synaptic plasticity is the structural basis of information transfer between neurons. Chen et al. [3] constructed a four layers feedforward deep spiking neural network based on STDP (Spike-timing Dependent Plasticity) mechanism. Litwin-Kumar and Doiron [4] found that the STDP mechanism makes neural networks form neuronal clusters during learning and maintain cluster stability. Wei and Koulakov [5] found that the STDP mechanism is helpful for stable storage in long-term memory models of neural networks. Most of these studies are based on excitatory synaptic plasticity. However,inhibitory synaptic plasticity also plays an important role in the regulation of neural networks.

The organism adapts to an external environment with many kinds of interference factors via self-adaptive mechanism [6, 7]. Yu et al. [8] found that under the interference of either a DC or an AC induced electric field, a neural network can produce gamma oscillations and synchronous oscillation, respectively. Chang et al. [9] found that the relationship between the extent of synchronous neuronal firing and an anti-interference ability is approximately linear. Scott et al. [10] found that the ability of synchronous neural network firing strongly depended on the mechanisms of synaptic plasticity. Chen et al. [11] found that a feed-forward deep spiking neural network exhibited anti-interference ability when regulated by STDP.

A deep spiking neural network model regulated by both excitatory and inhibitory synaptic plasticity was constructed by the authors in a previous study [12]. That study focused on neural information coding by rate and temporal coding under an alternating magnetic field. In this study, the same topology of a deep spiking neural network is employed. It aims to investigate the anti-interference ability of the network under an alternating electric field by firing rate and correlation between the membrane potential which are considered as anti-interference indexes.

2 Analysis of Anti-interference Ability of Deep Spiking Neural Network

Based on Izhikevich neuron model [13], a synaptic plasticity and feed-forward deep spiking neural network model with ten layers regulated by both excitatory and inhibitory synaptic plasticity was constructed as in a previous study [12].

2.1 Izhikevich neuron model subject to an electric field

An alternating electric field can influence the membrane potential of neurons [14]. The relationship between the external alternating electric field E and the cell membrane depolarization voltage Δ V can be described as [15]: (1) d Δ V dt + Δ V τ = λ τ E where λ represents the polarization length and τ represents Maxwell-Wagner time constant [16].

The alternating electric field E can be described as:

(2) E ( t ) = A ω sin ( ω t ) where A represents amplitude and ω represents angular frequency [17]. According to equation (1) and equation (2), the cell membrane depolarization voltage Δ V due to an alternating electric field E can be described as:

(3) Δ V (t) = λ A ω sin ( ω t ) - 2 π f τ cos ( ω t ) 1 + ( ωτ ) 2 .

In the model, the order of magnitude τ is generally 1 0 - 10 ms; the frequency f is located in the range of extremely low frequencies [18]. Therefore, the cell membrane depolarization voltage Δ V can be approximated described as follows:

(4) Δ V ( t ) = λ A ω sin ( ω t ) where polarization length λ = 1 mm ; angular frequency ω = 0.1 π rad/s [19]. Cell membrane depolarization voltage Δ V can be seen as an external disturbance of the cell membrane voltage v ( t ) . The cell membrane voltage v ( t ) under the electric field can be described as [20]:

(5) v ( t ) v ( t ) + Δ V ( t )

The Izhikevich neuron model under the alternating electric field can be obtained by introducing equation (5) into the mathematical model of the Izhikevich neuron described in [12].

2.2 Firing rate

The pulse time sequence S ( t ) of neurons with regard to each action potential generated by a neuron has a time function similar to δ . It can be described as:

(6) S ( t ) = m δ ( t - t ( m ) ) where t ( m ) is the firing moment of neurons. The value of S ( t ) in the firing moment is one, and at other times is set to zero. The pulse time sequence clearly shows both the firing moments and firing rate.

The inter-spike interval (ISI) is the difference between two adjacent firing moments of a neuron. It is described as:

(7) IS I n = t n - t n - 1

The firing rate of a single neuron is evaluated by dividing the average value of the ISIs (ms) by 1000. The firing rate of the neural network is evaluated by the average firing rate values of all neurons. The smaller the relative variation rate of firing rate, the better the anti-interference ability of the deep spiking neural network. When the relative variation rate of firing rate is less than 10%, the influence of electric field on the neural network is relatively small.

To investigate the influence of different electric field amplitudes on pulse time sequence of a deep spiking neural network, an electric field interference with amplitudes of 2 mV , 10 mV , or 20 mV are added to the deep spiking neural network. The pulse time sequence diagrams of the output layer neuron under different electric field amplitudes are shown in Fig. 1.

Figure.1.

Pulse time sequence diagrams.

From the Fig. 1, the abscissa gives simulation time; the ordinate gives the time of the action potential. The firing rate is 11.1 Hz under non-interference, the firing rates are 11.2 Hz, 11.4 Hz, and 12.0 Hz under the electric field amplitudes of 2 mV, 10 mV, and 20 mV, respectively. The fluctuations generated by electric field interference are 0.61%, 2.69% and 8.30%, respectively. Simulation results show that with the increased of electric field amplitude, the fluctuations are getting larger. This proved that with the increased electric field amplitude, the influence on firing moment and firing rate of the output layer neuron are all increased.

To further investigate the influence of electric field interference on the firing rate, an electric field interference with different amplitudes was added to the deep spiking neural network. The range of the electric field amplitude A was set to [1, 20] mV, and the step length was set to 1 mV. Simulation results showed that the firing rate of each layer in the deep spiking neural network was within the range of 6.7 Hz to 12.0 Hz. Normalized firing rate of each layer in the deep spiking neural network for different electric field amplitudes A is shown in Fig. 2.

Figure.2.

The firing rate of each layer.

From Fig. 2, the abscissa gives the electric field amplitude, the ordinate gives the number of layers, and the color-map gives the firing rate after normalization. Red indicates a higher neuron firing rate. Blue indicates a lower neuron firing rate. The figure shows that the firing rate of each layer increases with increased electric field amplitude. When the electric field amplitude is constant, the firing rate shows a trend of fluctuation with an increased number of layers.

Trend of firing rates in output the layer neuron under different electric field amplitudes A is shown in Fig. 3.

Fig. 3.

Firing rate of output layer neuron.

In Fig. 3, the abscissa gives the electric field amplitude; the ordinate gives the firing rate of the output neuron. When the electric field amplitude is in the range 0 mV to 6 mV, the firing rate is in the range of 11.1 Hz to 11.2 Hz. The firing rate is typically stable. When the electric field amplitude is in the range of 6 mV to 16 mV, the firing rate is in the range of 11.1 Hz to 11.9 Hz. The firing rate shows a marginally increasing trend. When the electric field amplitude is in the range 16 mV to 20 mV, the firing rate is in the range of 11.9 Hz to 12.0 Hz and the firing rate is effectively stable.

The relative variation rate of firing rate in the output layer neuron under different electric field amplitudes A is shown in Fig. 4.

Fig. 4.

The relative variation rate of firing rate.

In Fig. 4, the abscissa gives the electric field amplitude and the ordinate gives the firing rate of the output neuron. When the electric field amplitude is in the range of 1 mV to 20 mV, the relative variation rate of firing rate is less than 8.53%. An electric field amplitude in the range of 1 mV to 20 mV has little influence on the firing rate of the deep spiking neural network.

2.3 Correlation between the membrane potential

Correlation between the membrane potential can reflect the similarity degree of neuron membrane potential before and after electric field interference. The greater the correlation value is, the higher the similarity degree is before and after interference. Correlation coefficient can describe the correlation between the membrane potential quantitatively. The correlation coefficient can be described as follows:

(8) $ \rho _{ij} (\tau )=\frac{\sum\limits _{t=t_{1} }^{t_{2} -\tau +1}x_{i} (t)x_{j} (t+\tau ) }{\sqrt{\sum\limits _{t=t_{1} }^{t_{2} -\tau +1}x_{i} {}^{2} (t)\sum\limits _{t=t_{1} }^{t_{2} -\tau +1}x_{j} {}^{2} (t+\tau ) } } $ where ρ ij ( τ ) is correlation coefficient; [ t 1 , t 2 ] is simulation duration; x i is neuron membrane potential before electric field interference; x j is neuron membrane potential after electric field interference. The larger the value of ρ ij ( τ ) is, the better the anti-interference ability of the deep spiking neural network is. When the correlation between the membrane potential is greater than half, the influence of electric field on neural network is relatively small.

In order to investigate the influence of electric field interference on correlation between the membrane potential, the electric field interference with different amplitudes is added to deep spiking neural network. The range of the electric field amplitude A is set to be [1, 20] mV, the step length is set to be 1 mV. The correlation of the membrane potential of each layer in deep spiking neural network under different electric field amplitudes is shown in Fig. 5.

Fig. 5.

Correlation between membrane potential of each layer.

From the Fig. 5, the abscissa gives the electric field amplitude; the ordinate gives the number of layers; the color-map represents the correlation between the membrane potential of each layer. Red indicates a higher correlation between the membrane potential in each layer. Blue indicates lower correlation between the membrane potential in each layer. The figure shows that the correlation between the membrane potential in each layer decreases with increased electric field amplitude. When the electric field amplitude is in the range of 0 mV to 7 mV, the correlation between the membrane potential of each layer is relatively large. When the electric field amplitude is in the range of 7 mV to 20 mV, the correlation between the membrane potential of each layer is relatively small.

The correlation trend between the membrane potential in output layer and other layers for different electric field amplitudes A is shown in Fig. 6.

Fig. 6.

Correlation between the membrane potential of the output layer neuron and other layers.

From the Fig. 6, the abscissa gives electric field amplitude; the ordinate gives the correlation between the membrane potential of the output layer neuron and other layers. With increased electric field amplitude, the correlation between the membrane potential shows a decreasing trend of fluctuations. When the electric field amplitude is 1 mV, the correlation between the membrane potential and membrane potential in other layers attains a maximum value of 0.71. When the electric field amplitude was 20 mV, the correlation between the membrane potential between layers attained the minimum value of 0.14.

According to Fig. 6, the correspondence between membrane potential correlations and electric field amplitude A are shown in Table.1. From Table.1, with an increase in the range of electric field amplitude, the range of correlations between the membrane potential of the output layer neuron and other layers is decreased. When the electric field amplitude is in the range of 1 mV to 9 mV, the correlation between membrane potential of the different layers is relatively large, whereas, the influence of the electric field on the correlation between the membrane potential of different layers is relatively small; when the electric field amplitude is in the range of 10 mV to 20 mV, the value of correlation is relatively small, the influence of electric field on the correlation between the membrane potential is relatively large.

doi.org/10.31083/j.jin.2018.04.0407.t0001 Table 1 Correspondences between membrane potential correlations and electric field amplitude
range of electric field amplitude 1~4 5~9 10~13 14~20
range of correlation 0.61~0.71 0.45~0.67 0.26~0.36 0.14~0.24
3 Conclusion

We conclude from the simulation results that with increased electric field amplitude, neuron firing rate is increased and the correlation between the membrane potential of different layers in the neural network is decreased. When the relative variation rate of firing rate is less than 10% or the correlation between the membrane potential is greater than half, the influence of electric field on neural network is relatively small. Otherwise, the influence is relatively large. Based on the regulation of synaptic plasticity, under a certain electric field interference range, the variation of firing rate is relatively small compared with non-interference; the correlation between the membrane potential of neurons in different network levels is relatively large compared with non-interference. A certain range of electric field interference has little influence on activity in the deep spiking neural network. The deep spiking neural network has ability to resist electric field interference.

Acknowledgments

This work was supported by National Natural Science Foundation of China (No. 61571180, 31400844) and Natural Science Foundation of Hebei Province (No. E2016202128).

Conflict of Interest

All authors declare no conflict of interest.

References
[1]
Zheng-Quan JU, Man MH, Yuan L ( 2012) The design and reliability analysis of the self-organizing fault-tolerant system. Microelectronics & Computer. 29(04), 89-93. 1118e8b5bc141ef60b815519bf80c443http%3A%2F%2Fen.cnki.com.cn%2FArticle_en%2FCJFDTOTAL-WXYJ201204022.htmhttp://en.cnki.com.cn/Article_en/CJFDTOTAL-WXYJ201204022.htm
[2]
Lin Xh, Wang Xw, Zhang N, Ma HF ( 2015) Supervised learning algorithms for spiking neural networks: a review. Acta Electronica Sinica 43(3), 577-586. 10.3969/j.issn.0372-2112.2015.03.024e96a99af-58a7-4717-93a2-aaf3185dce1dmag3985220154335774610587969260b2cb8442797f5f40bc8http%3A%2F%2Fwww.en.cnki.com.cn%2FArticle_en%2FCJFDTotal-DZXU201503024.htmhttp://www.en.cnki.com.cn/Article_en/CJFDTotal-DZXU201503024.htm
[3]
Chen YZ, Xu GZ, Zhou Q, Qu RW, Guo MM, Guo L, Wang XW ( 2014) Construction and simulation of adaptive neural networks based on STDP plasticity. Chinese Journal of Medical Physics 31(02), 4820-4832.
[4]
Litwin-Kumar A, Doiron B ( 2014) Formation and maintenance of neuronal assemblies through synaptic plasticity. Nature Communications 5, 5319. 10.1038/ncomms6319253950159bb6f41c294476a0280e31b291663142http%3A%2F%2Feuropepmc.org%2Fabstract%2Fmed%2F25395015http://europepmc.org/abstract/med/25395015
[5]
Wei Y, Koulakov AA ( 2014) Long-term memory stabilized by noise-induced rehearsal. Journal of Neuroscience 34(47), 15804-15815. 10.1186/1471-2202-14-S1-P2204236406c84e934e-a672-4e0f-beb5-30e5d2482003WOS:000345907500028458f1824d34aa737bace375bae7815cehttp%3A%2F%2Feuropepmc.org%2Farticles%2FPMC4236406%2Fhttp://med.wanfangdata.com.cn/paper/detail/periodicalpaper_pm25411507
[6]
Yang YP, Ma QS, Xie QM ( 2013) Prediction of electromagnetic interference based on neural network. Journal of Beijing University of Aeronautics and Astronautics 39(5), 697-700, 705. d207e70a-3db2-49af-9a12-f34bb743a857mag5266020133956970ac3bc4e56dab1f37109e370eed81803http%3A%2F%2Fen.cnki.com.cn%2FArticle_en%2FCJFDTOTAL-BJHK201305026.htmhttp://en.cnki.com.cn/Article_en/CJFDTOTAL-BJHK201305026.htm
[7]
Yuan L, Mang MH, Chang XL ( 2014) Principle of electromagnetic protection bionics and research on self repairing mechanism of fault. Chinese Engineering Science 16(03), 76-102.
[8]
Yu K, Wang J, Deng B, We XL ( 2013) Effects of induced electric field on network synchronization under magnetic stimulation. Journal of Tianjin University: Natural Science and Engineering Technology 46(8), 726-736.
[9]
Chang XL, Ding GL, Lou JA ( 2014) Anti disturbance characteristics of synchronous discharge in neural networks. Journal of Shanghai Jiao Tong University 48(10), 1485-1490.
[10]
Rich S, Booth V, Zochowski M ( 2015) The role of adaptation current in synchronously firing inhibitory neural networks with various topologies. BMC Neuroscience 16(1), P303. 10.1186/1471-2202-16-S1-P3034698997bbde07160a857e900c57db4001fae668http%3A%2F%2Flink.springer.com%2Farticle%2F10.1186%2F1471-2202-16-S1-P303http://link.springer.com/article/10.1186/1471-2202-16-S1-P303
[11]
Chen YZ, Xu GZ, Zhou Q, Guo MM, Guo L ( 2015) Research on adaptive neural network anti disturbance ability based on spiking time dependent plasticity. Journal of Biomedical Engineering 39(05), 697-705.
[12]
Guo L, Zhang W, Zhang J ( 2018) The effect of an exogenous magnetic field on neural coding in deep spiking neural networks. Journal of Integrative Neuroscience 17(2), 1-12. 10.3233/JIN-17004682dd5b736c46b915645bedfbc04c76b5http%3A%2F%2Feuropepmc.org%2Fabstract%2FMED%2F29526851http://europepmc.org/abstract/MED/29526851
[13]
Izhikevich EM ( 2003) Simple model of spiking neurons. IEEE Transactions on Neural Networks 14(6), 1569-1572. 10.1109/TNN.2003.820440182446026971d9b7ed62b0d0648d918dfa334acchttp%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Ficp.jsp%3Farnumber%3D1257420http://med.wanfangdata.com.cn/Paper/Detail/PeriodicalPaper_PM18244602
[14]
YU K, Wand J, Deng B, Weu XL ( 2014) Synchronizing characteristics of neural network subject to external electric field. Application Research of Computers 31(1), 70. aa89b44d37e9f072f5bc55e4ce308d09http%3A%2F%2Fen.cnki.com.cn%2FArticle_en%2FCJFDTotal-JSYJ201401017.htmhttp://en.cnki.com.cn/Article_en/CJFDTotal-JSYJ201401017.htm
[15]
Nobukawa S, Nishimura H, Yamanishi T, Liu JQ ( 2015) Chaotic states induced by resetting process in Izhikevich neuron model. Journal of Artificial Intelligence and Soft Computing Research 5(2), 109-119.
[16]
Bédard C, Kröger H, Destexhe A ( 2006) Model of low-pass filtering of local field potentials in brain tissue. Physical Review E 73(5), 051911. 10.1103/PhysRevE.73.05191116802971e952c9f421909119fc7300abb8799df6http%3A%2F%2Feuropepmc.org%2Fabstract%2FMED%2F16802971http://med.wanfangdata.com.cn/Paper/Detail/PeriodicalPaper_PM16802971
[17]
Izhikevich EM, Gally JA, Edelman GM ( 2004) Spike-timing dynamics of neuronal groups. Cerebral Cortex 14(8), 933-944. 10.1093/cercor/bhh05315142958602c821eed7f27af8a75075cc6a10b8chttp%3A%2F%2Fwww.ncbi.nlm.nih.gov%2Fpubmed%2F15142958%2Fhttp://med.wanfangdata.com.cn/Paper/Detail/PeriodicalPaper_PM15142958
[18]
Zhang ZZ, Han HG ( 2014) Structural design of dynamic feed-forward neural networks based on information entropy. Information and Control 43(2), 181-185.
[19]
Radman T, Ramos RL, Brumberg JC, Bikson M ( 2009) Role of cortical cell type and morphology in subthreshold and suprathreshold uniform electric field stimulation in vitro. Brain Stimulation 2(4), 215-228. 10.1016/j.brs.2009.03.007279713193206f38-5746-44b4-9d3a-3c466788f844sdarticleid_34564913c13050b8f9048c03da693e65d24d65http%3A%2F%2Fwww.ncbi.nlm.nih.gov%2Fpubmed%2F20161507http://www.sciencedirect.com/science/article/pii/S1935861X09000424
[20]
Wang ML, Wang JS ( 2015) Excitatory and inhibitory homeostasis of feedback neural circuits based on inhibitory synaptic plasticity. Acta Physica Sinica 64(10), 416-423.
Share
Back to top