Video Layer Extraction and Reconstruction

S. Pelletier, G. Koepfler, and F. Dibos (France)


Video, image layer, occlusion, variational method.


The layer model describes images as the projection of a three dimensional scene composed of several opaque ob jects located at different depths from the camera. The background is the last layer, and the moving ob jects are projected upon it, in opposite order of their depth. When a layer is projected upon another, the one below is hidden, thus creating an occlusion. In the case of a video sequence, the layers move during the sequence and a layer might be hidden by another one during several images. In this article we present a variational method to ex tract layers from a video, recover the depth order and inter polate layers even in the case of total occlusion. The method is based on a known background. From a uniform motion hypothesis on the 3d objects, a defor mation model of the projection on the image is deduced. A variational formulation is used to recover the model param eters, these allow the extraction of moving object layers, depth order and the reconstruction of the sequence.

Important Links:

Go Back