This is a nice new project. Sharam Izadi et al. employ the Kinect to reconstruct arbitrary surroundings in 3D by using a Microsoft Kinect depth camera.
After 6:40 minutes, the video gets especially interesting if you are into multi-touch interaction. With Kinectfusion, any surface can be used for interactive multi-touch input.