Scene Interpretation in Images and Videos (Paperback)

Scene interpretation is a fundamental task in both computer vision and robotic systems. We deal with two important aspects of scene interpretation, they are scene reconstruction and scene recognition. Scene reconstruction is determining 3D positions of world points and retrieving camera poses from images. It has several applications such as virtual building editing, video augmentation; and planning and navigation in robotics. Among several approaches to modeling the scene, we deal with piecewise planar modeling due to several advantages. We propose a convex optimization based, approach for piecewise planar reconstruction. Scene recognition in robotics, specifically terrain scene recognition is one of the fundamental tasks of autonomous navigation. Navigable terrains are examples of planar scenes. It has applications in various domains such as advanced driver assistance systems, remote sensing, etc. Various sensing modalities such as ladars, lasers, accelerometers, stereo cameras, or combination of them are used in literature. We propose an algorithm which is purely based on a single monocular camera.