Perceiving Systems, Computer Vision

MoSh: Motion and Shape Capture from Sparse Markers

2014

Article

ps


Marker-based motion capture (mocap) is widely criticized as producing lifeless animations. We argue that important information about body surface motion is present in standard marker sets but is lost in extracting a skeleton. We demonstrate a new approach called MoSh (Motion and Shape capture), that automatically extracts this detail from mocap data. MoSh estimates body shape and pose together using sparse marker data by exploiting a parametric model of the human body. In contrast to previous work, MoSh solves for the marker locations relative to the body and estimates accurate body shape directly from the markers without the use of 3D scans; this effectively turns a mocap system into an approximate body scanner. MoSh is able to capture soft tissue motions directly from markers by allowing body shape to vary over time. We evaluate the effect of different marker sets on pose and shape accuracy and propose a new sparse marker set for capturing soft-tissue motion. We illustrate MoSh by recovering body shape, pose, and soft-tissue motion from archival mocap data and using this to produce animations with subtlety and realism. We also show soft-tissue motion retargeting to new characters and show how to magnify the 3D deformations of soft tissue to create animations with appealing exaggerations.

Author(s): Matthew M. Loper and Naureen Mahmood and Michael J. Black
Journal: ACM Transactions on Graphics, (Proc. SIGGRAPH Asia)
Volume: 33
Number (issue): 6
Pages: 220:1--220:13
Year: 2014
Month: November
Publisher: ACM

Department(s): Perceiving Systems
Research Project(s): Beyond Motion Capture
Virtual Humans (2011-2015)
Bibtex Type: Article (article)
Paper Type: Journal

Address: New York, NY, USA
DOI: 10.1145/2661229.2661273
URL: http://doi.acm.org/10.1145/2661229.2661273

Links: pdf
video
data
pdf from publisher
Video:

BibTex

@article{Loper:SIGASIA:2014,
  title = {{MoSh}: Motion and Shape Capture from Sparse Markers},
  author = {Loper, Matthew M. and Mahmood, Naureen and Black, Michael J.},
  journal = {ACM Transactions on Graphics, (Proc. SIGGRAPH Asia)},
  volume = {33},
  number = {6},
  pages = {220:1--220:13},
  publisher = {ACM},
  address = {New York, NY, USA},
  month = nov,
  year = {2014},
  doi = {10.1145/2661229.2661273},
  url = {http://doi.acm.org/10.1145/2661229.2661273},
  month_numeric = {11}
}