Murdoch University Research Repository

Welcome to the Murdoch University Research Repository

The Murdoch University Research Repository is an open access digital collection of research
created by Murdoch University staff, researchers and postgraduate students.

Learn more

Probability-based framework to fuse temporal consistency and semantic information for background segmentation

Zeng, Z., Wang, T., Ma, F., Zhang, L., Shen, P., Shah, S.A.A. and Bennamoun, M. (2022) Probability-based framework to fuse temporal consistency and semantic information for background segmentation. IEEE Transactions on Multimedia, 24 . pp. 740-754.

Link to Published Version: https://doi.org/10.1109/TMM.2021.3058770
*Subscription may be required

Abstract

The fusion of temporal consistency and semantic information with limited foreground information for background segmentation using deep learning is an underinvestigated problem. In this paper, we explore the relation between temporal consistency and semantic information based on the law of total probability. A highly concise framework is proposed to fuse these two types of information. A theoretical proof is given to show that the proposed framework is more accurate than either the temporal consistency-based model or the semantic information-based model and that each model is a special case of the proposed framework. The proposed framework is a white-box framework that can easily be embedded into a deep neural network as a merging layer. In the proposed model, only a few parameters must be learned, which substantially reduces the need for a large dataset. In addition, these interpretable parameters reflect our understanding of the background and can be applied to a wide range of environments. Extensive evaluations indicate the promising performance of the proposed method. Our code and trained weights for the experiments are available at GitHub.

Item Type: Journal Article
Murdoch Affiliation(s): IT, Media and Communications
Publisher: IEEE
Copyright: © 2022 IEEE
URI: http://researchrepository.murdoch.edu.au/id/eprint/64098
Item Control Page Item Control Page