'Always-on' AI applications—environmental sensors, biomedical implants—require extremely low power consumption. Digital chips hit a floor below which they cannot go, while analog circuits can achieve sub-microwatt inference. But there has long been an obstacle: analog signals accumulate noise as they pass through temporal feedback loops, so analog neural network implementations could only do feedforward computation, not recurrent.
A team of six (Fyon et al., arXiv:2605.15216) found a breakthrough: a class of RNNs called BMRU (Bistable Memory Recurrent Unit) whose outputs are discrete and whose internal dynamics exhibit hysteresis. The discrete outputs suppress analog noise by at least 20x at each unit boundary, interrupting noise accumulation in the temporal feedback loop.
The researchers designed a current-mode analog implementation from first principles, with each learned parameter corresponding to one circuit element. Transistor-level simulation on a 180nm CMOS process shows that circuit behavior matches software predictions almost exactly.
Keyword spotting was achieved with sub-microwatt RNN-core inference.
Open Questions Raised by the Author
- The 180nm node is an old process. How would analog noise characteristics and leakage currents change on more advanced nodes (28nm or 7nm)? The paper claims scalability but provides no cross-node validation.
- What is the task coverage of BMRU in current deep learning—which types of sequence tasks is it suitable for?
- Can the expressiveness of discrete outputs match LSTM or Transformer models?
References
1. Fyon, A., et al. (2026). *Hardware-Software Co-Design of Scalable, Energy-Efficient Analog Recurrent Computations*. arXiv:2605.15216 [cs.AR]. 2. Jakesch, A., et al. (2024). *Bistable Memory Recurrent Units*. NeurIPS 2024. 3. Mead, C. (1990). *Neuromorphic Electronic Systems*. Proceedings of the IEEE, 78(10), 1629-1636. 4. Verhoef, B., et al. (2023). *Sub-microwatt Keyword Spotting with Analog Circuits*.