多层回声状态机:一种新颖的架构与算法

Multilayered Echo State Machine: A Novel Architecture and Algorithm

IEEE Transactions on Cybernetics · 2016
被引 118
ABS 3

中文导读

提出了一种多层回声状态机的新架构和算法,通过集成多层储层增强了传统回声状态网络的鲁棒性,在基准数据集和实际应用中展示了其优势。

Abstract

In this paper, we present a novel architecture and learning algorithm for a multilayered echo state machine (ML-ESM). Traditional echo state networks (ESNs) refer to a particular type of reservoir computing (RC) architecture. They constitute an effective approach to recurrent neural network (RNN) training, with the (RNN-based) reservoir generated randomly, and only the readout trained using a simple computationally efficient algorithm. ESNs have greatly facilitated the real-time application of RNN, and have been shown to outperform classical approaches in a number of benchmark tasks. In this paper, we introduce a novel criteria for integrating multiple layers of reservoirs within the ML-ESM. The addition of multiple layers of reservoirs are shown to provide a more robust alternative to conventional RC networks. We demonstrate the comparative merits of this approach in a number of applications, considering both benchmark datasets and real world applications.

回声状态网络储层计算递归神经网络机器学习人工智能