Catalog Home Page

Separating objects and clutter in indoor scenes

Khan, S., He, X., Bennamoun, M., Togneri, R. and Sohel, F. (2015) Separating objects and clutter in indoor scenes. In: Computer Vision (CVPR) 2015, 8 - 10 June 2015, Boston, MA

PDF - Published Version
Download (5MB)
Link to Open Access version:
*No subscription required


Objects’ spatial layout estimation and clutter identification are two important tasks to understand indoor scenes. We propose to solve both of these problems in a joint framework using RGBD images of indoor scenes. In contrast to recent approaches which focus on either one of these two problems, we perform ‘fine grained structure categorization’ by predicting all the major objects and simultaneously labeling the cluttered regions. A conditional random field model is proposed to incorporate a rich set of local appearance, geometric features and interactions between the scene elements. We take a structural learning approach with a loss of 3D localisation to estimate the model parameters from a large annotated RGBD dataset, and a mixed integer linear programming formulation for inference. We demonstrate that our approach is able to detect cuboids and estimate cluttered regions across many different object and scene categories in the presence of occlusion, illumination and appearance variations.

Publication Type: Conference Paper
Conference Website:
Item Control Page Item Control Page


Downloads per month over past year