Structuring Multiple Simple Cycle Reservoirs with Particle Swarm Optimization

Reservoir Computing (RC) is a time-efficient computational paradigm derived from Recurrent Neural Networks (RNNs). The Simple Cycle Reservoir (SCR) is an RC model that stands out for its minimalistic design, offering extremely low construction complexity and proven capability of universally approximating time-invariant causal fading memory filters, even in the linear dynamics regime. This paper introduces Multiple Simple Cycle Reservoirs (MSCRs), a multi-reservoir framework that extends Echo State Networks (ESNs) by replacing a single large reservoir with multiple interconnected SCRs. We demonstrate that optimizing MSCR using Particle Swarm Optimization (PSO) outperforms existing multi-reservoir models, achieving competitive predictive performance with a lower-dimensional state space. By modeling interconnections as a weighted Directed Acyclic Graph (DAG), our approach enables flexible, task-specific network topology adaptation. Numerical simulations on three benchmark time-series prediction tasks confirm these advantages over rival algorithms. These findings highlight the potential of MSCR-PSO as a promising framework for optimizing multi-reservoir systems, providing a foundation for further advancements and applications of interconnected SCRs for developing efficient AI devices. LINK

Joint work with Z. Li, K. Fujiwara, K. Aihara, and G. Tanaka

Ziqiang Li, Robert Simon Fong, Kantaro Fujiwara, Kazuyuki Aihara, and Gouhei Tanaka. Structuring Multiple Simple Cycle Reservoirs with Particle Swarm Optimization. In 2025 International Joint Conference on Neural Networks (IJCNN), pages 1–9, 2025
Download Paper