Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

1.3 What is Synaptic Plasticity?

Nokia Bell Labs

In the previous chapters, we saw how spikes travel across synapses and how synaptic weights control the flow of information in SNNs. Up to now, those weights were static, i.e., set once, used forever. But in biological systems, and often in SNNs, weights can evolve over time. This ability to change weights is called synaptic plasticity.

In biology, plastic means malleable, i.e., capable of being reshaped. A synapse is said to be plastic when its strength changes based on neural activity. Two of the most studied complementary mechanisms of these synaptic changes are Long-Term Potentiation (LTP) and Long-Term Depression (LTD). In the next sections, we look at how each mechanism works and why they matter for SNNs.

1.3.1Long-Term Potentiation

LTP refers to a persistent increase of a synaptic weight following specific patterns of correlated pre- and post-synaptic activity. Specifically, when a pre-synaptic neuron repeatedly fires just before the post-synaptic neuron, the system interprets it as a “causal” relationship:

“Neuron A helped neuron B fire, let’s make that connection stronger.”

In SNNs, this principle appears in multiple practical forms. One of the most common ones is based on how close in time the two spikes occur: if the pre-synaptic spike arrives shortly before the post-synaptic one, the weight increases; if the delay is large, the effect becomes negligible.

Formally, this timing-based increase of the weight can be described by:

ΔWLTP=A+exp ⁣(Δtτ+),for Δt>0,\Delta W_{\text{LTP}} = A_+ \, \exp\!\left(-\frac{\Delta t}{\tau_+}\right), \qquad \text{for } \Delta t > 0 ,

where:

Because τ+\tau_+ appears in the denominator of the exponential term in Eq (1), it sets the rate at which the curve decays. A small τ+\tau_+ means only spikes that occur very close together strengthen the synapse, while a larger τ+\tau_+ makes the rule more tolerant to longer delays between pre- and post-synaptic spikes. This behavior is illustrated in the plot below.

1.3.2Long-Term Depression

LTD refers to a persistent decrease of a synaptic weight that occurs when pre- and post-synaptic activity are poorly coordinated. In practice, this happens when the pre-synaptic neuron tends to fire after the post-synaptic one. In that situation, the system interprets the timing as a “non-causal” relationship:

“Neuron A didn’t contribute to neuron B firing, let’s weaken that connection.”

Similar to LTP, a common form of LTD depends on timing: if the pre-synaptic spike arrives shortly after the post-synaptic one, the weight decreases, and the further apart the spikes are, the weaker the effect becomes.

Formally, this timing-based decrease of the weight can be described by:

ΔWLTD=Aexp ⁣(Δtτ),for Δt<0,\Delta W_{\text{LTD}} = -A_- \, \exp\!\left(\frac{\Delta t}{\tau_-}\right), \qquad \text{for } \Delta t < 0 ,

where:

The following plot illustrates how τ\tau_{-} and AA_{-} influence the relation between ΔW\Delta{W} and Δt\Delta{t}.

1.3.3From plasticity to learning

We have seen how LTP and LTD capture two complementary relationships between pre- and post-synaptic activity. LTP strengthens a synapse when a pre-synaptic spike occurs shortly before a post-synaptic spike, while LTD weakens it when the order is reversed. Taken together, they form the basis of learning rules such as Spike Timing-Dependent Plasticity (STDP), which can be used to train SNNs. We will explore such bio-inspired learning rules in more detail in the next topic.