Perceiving Systems, Computer Vision

Summarization of video-taped presentations: Automatic analysis of motion and gesture

1998

Article

ps


This paper presents an automatic system for analyzing and annotating video sequences of technical talks. Our method uses a robust motion estimation technique to detect key frames and segment the video sequence into subsequences containing a single overhead slide. The subsequences are stabilized to remove motion that occurs when the speaker adjusts their slides. Any changes remaining between frames in the stabilized sequences may be due to speaker gestures such as pointing or writing, and we use active contours to automatically track these potential gestures. Given the constrained domain, we define a simple set of actions that can be recognized based on the active contour shape and motion. The recognized actions provide an annotation of the sequence that can be used to access a condensed version of the talk from a Web page.

Author(s): Ju, S. X. and Black, M. J. and Minneman, S. and Kimber, D.
Journal: IEEE Trans. on Circuits and Systems for Video Technology
Volume: 8
Number (issue): 5
Pages: 686-696
Year: 1998
Month: September

Department(s): Perceiving Systems
Bibtex Type: Article (article)
Paper Type: Journal

DOI: 10.1109/76.718513

Links: pdf
pdf from publisher

BibTex

@article{Black:IEEE:1998,
  title = {Summarization of video-taped presentations: Automatic analysis of motion and gesture},
  author = {Ju, S. X. and Black, M. J. and Minneman, S. and Kimber, D.},
  journal = {IEEE Trans. on Circuits and Systems for Video Technology},
  volume = {8},
  number = {5},
  pages = {686-696},
  month = sep,
  year = {1998},
  doi = {10.1109/76.718513},
  month_numeric = {9}
}