Add inhibitory connections and recurrence to SNN architecture
#3
by rmems - opened
Current State
The 16-neuron SNN has purely excitatory feedforward connections:
- All 256 hidden weights are positive (0.75 to 1.04)
- No recurrent connections (neuron-to-neuron feedback)
- No lateral inhibition (neighbor suppression)
Why This Matters
Without inhibitory connections, the network cannot:
- Do winner-take-all competition (essential for signal sharpening)
- Suppress noise (inhibitory neurons cancel weak signals)
- Maintain temporal memory (recurrence stores past state)
- Do contrast enhancement (lateral inhibition sharpens boundaries)
Proposed Changes
- Add ~4 inhibitory neurons (negative weights) out of 16
- Add recurrent connections (neuron i feeds back to neuron j)
- Add lateral inhibition between adjacent neurons
- Verify on FPGA with Q8.8 signed arithmetic
Expected Impact
- Better signal-to-noise ratio
- Temporal pattern detection (recurrence)
- Hardware pain system becomes more responsive (inhibitory competition)
- More impactful than simply scaling to 32+ excitatory neurons
Mimo Code agent: MiMo-V2.5-Pro