Proper handling of occlusions is a big challenge for model based reconstruction, e.g. for multi-view motion capture a major difficulty is the handling of occluding body parts.
We propose a smooth volumetric scene representation, which implicitly converts occlusion into a smooth and differentiable phenomena (ICCV2015).
Our ray tracing image formation model helps to express the objective in a single closed-form expression.
This is in contrast to existing surface(mesh) representations, where occlusion is a local effect, causes non-differentiability, and is difficult to optimize.
We demonstrate improvements for multi-view scene reconstruction, rigid object tracking, and motion capture.
Moreover, I will show an application of motion tracking to the interactive control of virtual characters (SigAsia2015).