Perceiving Systems, Computer Vision

Modeling Blurred Video with Layers

2014

Conference Paper

ps


Videos contain complex spatially-varying motion blur due to the combination of object motion, camera motion, and depth variation with fi nite shutter speeds. Existing methods to estimate optical flow, deblur the images, and segment the scene fail in such cases. In particular, boundaries between di fferently moving objects cause problems, because here the blurred images are a combination of the blurred appearances of multiple surfaces. We address this with a novel layered model of scenes in motion. From a motion-blurred video sequence, we jointly estimate the layer segmentation and each layer's appearance and motion. Since the blur is a function of the layer motion and segmentation, it is completely determined by our generative model. Given a video, we formulate the optimization problem as minimizing the pixel error between the blurred frames and images synthesized from the model, and solve it using gradient descent. We demonstrate our approach on synthetic and real sequences.

Author(s): Jonas Wulff and Michael J. Black
Book Title: Computer Vision – ECCV 2014
Volume: 8694
Pages: 236--252
Year: 2014
Month: September

Series: Lecture Notes in Computer Science
Editors: D. Fleet and T. Pajdla and B. Schiele and T. Tuytelaars
Publisher: Springer International Publishing

Department(s): Perceiving Systems
Research Project(s): Layered Optical Flow
Motion Blur in Layers
Bibtex Type: Conference Paper (inproceedings)
Paper Type: Conference

DOI: 10.1007/978-3-319-10599-4_16
Event Name: 13th European Conference on Computer Vision
Event Place: Zürich, Switzerland

Links: pdf
Supplemental
Video
Data
Video:

BibTex

@inproceedings{Wulff:ECCV:2014,
  title = {Modeling Blurred Video with Layers},
  author = {Wulff, Jonas and Black, Michael J.},
  booktitle = {Computer Vision -- ECCV 2014},
  volume = {8694},
  pages = {236--252},
  series = {Lecture Notes in Computer Science},
  editors = {D. Fleet  and T. Pajdla and B. Schiele  and T. Tuytelaars },
  publisher = {Springer International Publishing},
  month = sep,
  year = {2014},
  doi = {10.1007/978-3-319-10599-4_16},
  month_numeric = {9}
}