Murdoch University Research Repository

Welcome to the Murdoch University Research Repository

The Murdoch University Research Repository is an open access digital collection of research
created by Murdoch University staff, researchers and postgraduate students.

Learn more

Analysis and variants of Broad Learning System

Zhang, L., Li, J., Lu, G., Shen, P., Bennamoun, M., Shah, S.A.A., Miao, Q., Zhu, G., Li, P. and Lu, X. (2022) Analysis and variants of Broad Learning System. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 52 (1). pp. 334-344.

Link to Published Version: https://doi.org/10.1109/TSMC.2020.2995205
*Subscription may be required

Abstract

The broad learning system (BLS) is designed based on the technology of compressed sensing and pseudo-inverse theory, and consists of feature nodes and enhancement nodes, has been proposed recently. Compared with the popular deep learning structures, such as deep neural networks, BLS has the ability of rapid incremental learning and can remodel the system without the usual tedious retraining process. However, given that BLS is still in its infancy, it still needs analysis, improvements, and verification. In this article, we first analyze the principle of fast incremental learning ability of BLS in depth. Second, in order to provide an in-depth analysis of the BLS structure, according to the novel structure design concept of deep neural networks, we present four brand-new BLS variant networks and their incremental realizations. Third, based on our analysis of the effect of feature nodes and enhancement nodes, a new BLS structure with a semantic feature extraction layer has been proposed, which is called SFEBLS. The experimental results show that SFEBLS and its variants can increase the accuracy rate on the NORB dataset 6.18%, Fashion-MNIST dataset by 3.15%, ORL data by 5.00%, street view house number dataset by 12.88%, and CIFAR-10 dataset by 18.42%, respectively, and the four brand-new BLS variant networks also obviously outperform the original BLS.

Item Type: Journal Article
Murdoch Affiliation(s): Information Technology, Mathematics and Statistics
Publisher: IEEE
Copyright: © 2021 IEEE.
URI: http://researchrepository.murdoch.edu.au/id/eprint/63438
Item Control Page Item Control Page