Murdoch University Research Repository

Welcome to the Murdoch University Research Repository

The Murdoch University Research Repository is an open access digital collection of research
created by Murdoch University staff, researchers and postgraduate students.

Learn more

Generalized joint sparse representation for multimodal biometric fusion of heterogeneous features

Primorac, R., Togneri, R., Bennamoun, M. and Sohel, F. (2018) Generalized joint sparse representation for multimodal biometric fusion of heterogeneous features. In: IEEE International Workshop on Information Forensics and Security (WIFS) 2018, 11 - 13 December 2018, Hong Kong

Link to Published Version:
*Subscription may be required


In this paper we introduce a novel multimodal biometric recognition system based on generalized sparse representations. In the recently proposed systems, with heterogeneous features (such as audio and video), the joint sparse optimization problem was addressed by bringing the features into the same dynamic range, such as normalizing the features into unitl 2 norm. This is however not optimal, and such normalization may decrease the performance of that modality unimodally. We propose to solve the original joint sparse optimization problem by introducing scaling factors for different modalities, such that the modalities interact efficiently at the feature level. The sequence-dependent scaling factors are automatically calculated so that the mismatch between the sparse representations of different modalities is accounted for. In the case of audiovisual recognition system, our experiments on the challenging MOBIO database show that the proposed method outperforms the original joint sparsity-based system (96.8% vs 94.3% recognition rate).

Item Type: Conference Paper
Murdoch Affiliation(s): School of Engineering and Information Technology
Item Control Page Item Control Page