Perceiving Systems, Computer Vision

On the spatial statistics of optical flow

2007

Article

ps


We present an analysis of the spatial and temporal statistics of "natural" optical flow fields and a novel flow algorithm that exploits their spatial statistics. Training flow fields are constructed using range images of natural scenes and 3D camera motions recovered from hand-held and car-mounted video sequences. A detailed analysis of optical flow statistics in natural scenes is presented and machine learning methods are developed to learn a Markov random field model of optical flow. The prior probability of a flow field is formulated as a Field-of-Experts model that captures the spatial statistics in overlapping patches and is trained using contrastive divergence. This new optical flow prior is compared with previous robust priors and is incorporated into a recent, accurate algorithm for dense optical flow computation. Experiments with natural and synthetic sequences illustrate how the learned optical flow prior quantitatively improves flow accuracy and how it captures the rich spatial structure found in natural scene motion.

Author(s): Roth, S. and Black, M. J.
Journal: International Journal of Computer Vision
Volume: 74
Number (issue): 1
Pages: 33--50
Year: 2007

Department(s): Perceiving Systems
Bibtex Type: Article (article)
Paper Type: Journal

DOI: 10.1007/s11263-006-0016-x

Links: pdf preprint
pdf from publisher

BibTex

@article{Roth:IJCV:07,
  title = {On the spatial statistics of optical flow},
  author = {Roth, S. and Black, M. J.},
  journal = {International Journal of Computer Vision},
  volume = {74},
  number = {1},
  pages = {33--50},
  year = {2007},
  doi = {10.1007/s11263-006-0016-x}
}