3D Indoor Scene Understanding

This tutorial aims to provide the necessary background for understanding different indoor problems, their difficulties, the different sensors and data sources that one can use, how to exploit them, as well as how to formulate the problems such that efficient learning and inference is possible. In particular, we will review models for 3D object detection in both, monocular and RGB-D imagery, semantic segmentation (class and instance level), room layout estimation, as well as depth and normal estimation from a single image. The tutorial will discuss different possible parameterizations, sensors, the use of generative vs discriminative models, learned vs hand-crafted features, use of extra-information (e.g., CAD models, furniture catalogues), possible inference techniques, and possible learning algorithms. This will allow the audience to get a bigger picture of what is happening in the field, and what is potentially missing.