Publications | Perceiving Systems - Max Planck Institute for Intelligent Systems

99 results (View BibTeX file of all listed publications)

2011

Combining wireless neural recording and video capture for the analysis of natural gait

Foster, J., Freifeld, O., Nuyujukian, P., Ryu, S., Black, M. J., Shenoy, K.

In Proc. 5th Int. IEEE EMBS Conf. on Neural Engineering, pages: 613-616, IEEE, 2011 (inproceedings)

2011

Foster, J., Freifeld, O., Nuyujukian, P., Ryu, S., Black, M. J., Shenoy, K. Combining wireless neural recording and video capture for the analysis of natural gait In Proc. 5th Int. IEEE EMBS Conf. on Neural Engineering, pages: 613-616, IEEE, 2011 (inproceedings)

pdf Project Page [BibTex]

Tagged Cardiac MR Image Segmentation Using Boundary & Regional-Support and Graph-based Deformable Priors

Xiang, B., Wang, C., Deux, J., Rahmouni, A., Paragios, N.

In IEEE International Symposium on Biomedical Imaging (ISBI), 2011 (inproceedings)

pdf [BibTex]

Xiang, B., Wang, C., Deux, J., Rahmouni, A., Paragios, N. Tagged Cardiac MR Image Segmentation Using Boundary & Regional-Support and Graph-based Deformable Priors In IEEE International Symposium on Biomedical Imaging (ISBI), 2011 (inproceedings)

pdf [BibTex]

Multiview Structure from Motion in Trajectory Space

Zaheer, A., Akhter, I., Mohammad, H. B., Marzban, S., Khan, S.

In Computer Vision (ICCV), 2011 IEEE International Conference on, pages: 2447-2453, 2011 (inproceedings)

Abstract

Most nonrigid objects exhibit temporal regularities in their deformations. Recently it was proposed that these regularities can be parameterized by assuming that the non- rigid structure lies in a small dimensional trajectory space. In this paper, we propose a factorization approach for 3D reconstruction from multiple static cameras under the com- pact trajectory subspace representation. Proposed factor- ization is analogous to rank-3 factorization of rigid struc- ture from motion problem, in transformed space. The benefit of our approach is that the 3D trajectory basis can be directly learned from the image observations. This also allows us to impute missing observations and denoise tracking errors without explicit estimation of the 3D structure. In contrast to standard triangulation based methods which require points to be visible in at least two cameras, our ap- proach can reconstruct points, which remain occluded even in all the cameras for quite a long time. This makes our solution especially suitable for occlusion handling in motion capture systems. We demonstrate robustness of our method on challenging real and synthetic scenarios.

pdf project page [BibTex]

Zaheer, A., Akhter, I., Mohammad, H. B., Marzban, S., Khan, S. Multiview Structure from Motion in Trajectory Space In Computer Vision (ICCV), 2011 IEEE International Conference on, pages: 2447-2453, 2011 (inproceedings)

pdf project page [BibTex]

Unscented Kalman Filtering for Articulated Human Tracking

Anders Boesen Lindbo Larsen, Soren Hauberg, Kim S. Pedersen

In Image Analysis, 6688, pages: 228-237, Lecture Notes in Computer Science, (Editors: Heyden, Anders and Kahl, Fredrik), Springer Berlin Heidelberg, 2011 (inproceedings)

Publishers site PDF [BibTex]

Anders Boesen Lindbo Larsen, Soren Hauberg, Kim S. Pedersen Unscented Kalman Filtering for Articulated Human Tracking In Image Analysis, 6688, pages: 228-237, Lecture Notes in Computer Science, (Editors: Heyden, Anders and Kahl, Fredrik), Springer Berlin Heidelberg, 2011 (inproceedings)

Publishers site PDF [BibTex]

Adaptation for perception of the human body: Investigations of transfer across viewpoint and pose

Sekunova, A., Black, M. J., Parkinson, L., Barton, J. S.

Vision Sciences Society, 2011 (conference)

[BibTex]

Sekunova, A., Black, M. J., Parkinson, L., Barton, J. S. Adaptation for perception of the human body: Investigations of transfer across viewpoint and pose Vision Sciences Society, 2011 (conference)

[BibTex]

Level Set Segmentation with Robust Image Gradient Energy and Statistical Shape Prior

Si Yong Yeo, Xianghua Xie, Igor Sazonov, Perumal Nithiarasu

In IEEE International Conference on Image Processing, pages: 3397 - 3400, 2011 (inproceedings)

Abstract

We propose a new level set segmentation method with statistical shape prior using a variational approach. The image energy is derived from a robust image gradient feature. This gives the active contour a global representation of the geometric configuration, making it more robust to image noise, weak edges and initial configurations. Statistical shape information is incorporated using nonparametric shape density distribution, which allows the model to handle relatively large shape variations. Comparative examples using both synthetic and real images show the robustness and efficiency of the proposed method.

link (url) [BibTex]

Si Yong Yeo, Xianghua Xie, Igor Sazonov, Perumal Nithiarasu Level Set Segmentation with Robust Image Gradient Energy and Statistical Shape Prior In IEEE International Conference on Image Processing, pages: 3397 - 3400, 2011 (inproceedings)

link (url) [BibTex]

Variational Level Set Segmentation Using Shape Prior

Si Yong Yeo, Xianghua Xie, Igor Sazonov, Perumal Nithiarasu

In International Conference on Mathematical and Computational Biomedical Engineering, 2011 (inproceedings)

[BibTex]

Si Yong Yeo, Xianghua Xie, Igor Sazonov, Perumal Nithiarasu Variational Level Set Segmentation Using Shape Prior In International Conference on Mathematical and Computational Biomedical Engineering, 2011 (inproceedings)

[BibTex]

HMDB: A Large Video Database for Human Motion Recognition

Kuhne, H., Jhuang, H., Garrote, E., Poggio, T., Serre, T.

In IEEE International Conference on Computer Vision (ICCV), 2011 (inproceedings)

code, webpage, dataset pdf [BibTex]

Kuhne, H., Jhuang, H., Garrote, E., Poggio, T., Serre, T. HMDB: A Large Video Database for Human Motion Recognition In IEEE International Conference on Computer Vision (ICCV), 2011 (inproceedings)

code, webpage, dataset pdf [BibTex]

Context dependent changes in grip selectivity in primate ventral premotor cortex

Franquemont, L., Vargas-Irwin, C., Black, M., Donoghue, J.

2011 Abstract Viewer and Itinerary Planner, Online, Society for Neuroscience, 2011, Online (conference)

[BibTex]

Franquemont, L., Vargas-Irwin, C., Black, M., Donoghue, J. Context dependent changes in grip selectivity in primate ventral premotor cortex 2011 Abstract Viewer and Itinerary Planner, Online, Society for Neuroscience, 2011, Online (conference)

[BibTex]

Towards a freely moving animal model: Combining markerless multi-camera video capture and wirelessly transmitted neural recording for the analysis of walking

Foster, J., Freifeld, O., Nuyujukian, P., Ryu, S., Black, M., Shenoy, K.

2011 Abstract Viewer and Itinerary Planner, Society for Neuroscience, 2011, Online (conference)

Project Page [BibTex]

Foster, J., Freifeld, O., Nuyujukian, P., Ryu, S., Black, M., Shenoy, K. Towards a freely moving animal model: Combining markerless multi-camera video capture and wirelessly transmitted neural recording for the analysis of walking 2011 Abstract Viewer and Itinerary Planner, Society for Neuroscience, 2011, Online (conference)

Project Page [BibTex]

Shape and pose-invariant correspondences using probabilistic geodesic surface embedding

Tsoli, A., Black, M. J.

In 33rd Annual Symposium of the German Association for Pattern Recognition (DAGM), 6835, pages: 256-265, Lecture Notes in Computer Science, (Editors: Mester, Rudolf and Felsberg, Michael), Springer, 2011 (inproceedings)

Abstract

Correspondence between non-rigid deformable 3D objects provides a foundation for object matching and retrieval, recognition, and 3D alignment. Establishing 3D correspondence is challenging when there are non-rigid deformations or articulations between instances of a class. We present a method for automatically finding such correspondences that deals with significant variations in pose, shape and resolution between pairs of objects.We represent objects as triangular meshes and consider normalized geodesic distances as representing their intrinsic characteristics. Geodesic distances are invariant to pose variations and nearly invariant to shape variations when properly normalized. The proposed method registers two objects by optimizing a joint probabilistic model over a subset of vertex pairs between the objects. The model enforces preservation of geodesic distances between corresponding vertex pairs and inference is performed using loopy belief propagation in a hierarchical scheme. Additionally our method prefers solutions in which local shape information is consistent at matching vertices. We quantitatively evaluate our method and show that is is more accurate than a state of the art method.

pdf talk Project Page [BibTex]

Tsoli, A., Black, M. J. Shape and pose-invariant correspondences using probabilistic geodesic surface embedding In 33rd Annual Symposium of the German Association for Pattern Recognition (DAGM), 6835, pages: 256-265, Lecture Notes in Computer Science, (Editors: Mester, Rudolf and Felsberg, Michael), Springer, 2011 (inproceedings)

pdf talk Project Page [BibTex]

Visual orientation and direction selectivity through thalamic synchrony

Kelly, S., Stanley, G., Jin, J., Wang, Y., Desbordes, G., Wang, Q., Black, M., Alonso, J.

2011 Abstract Viewer and Itinerary Planner, Society for Neuroscience, 2011, Online (conference)

[BibTex]

Kelly, S., Stanley, G., Jin, J., Wang, Y., Desbordes, G., Wang, Q., Black, M., Alonso, J. Visual orientation and direction selectivity through thalamic synchrony 2011 Abstract Viewer and Itinerary Planner, Society for Neuroscience, 2011, Online (conference)

[BibTex]

Use of the BrainGate neural inteface system for more than five years by a woman with tetraplegia

2011 Abstract Viewer and Itinerary Planner, Society for Neuroscience, 2011, Onine (conference)

[BibTex]

Hochberg, L., Bacher, D., Barefoot, L., Berhanu, E., Black, M., Cash, S., Feldman, J., Gallivan, E., Homer, M., Jarosiewicz, B., King, B., Liu, J., Malik, W., Masse, N., Berge, J., Rosler, D., Schmansky, N., Simeral, J., Travers, B., Truccolo, W., Donoghue, J. Use of the BrainGate neural inteface system for more than five years by a woman with tetraplegia 2011 Abstract Viewer and Itinerary Planner, Society for Neuroscience, 2011, Onine (conference)

[BibTex]

Extracting 3D Structures from Biomedical Data

Xianghua Xie, Si Yong Yeo, Igor Sazonov, Perumal Nithiarasu

Proceedings of the 5th International Conference on Bioinformatics and Biomedical Engineering, 2011 (conference)

[BibTex]

Xianghua Xie, Si Yong Yeo, Igor Sazonov, Perumal Nithiarasu Extracting 3D Structures from Biomedical Data Proceedings of the 5th International Conference on Bioinformatics and Biomedical Engineering, 2011 (conference)

[BibTex]

Illumination Estimation and Cast Shadow Detection through a Higher-order Graphical Model

Panagopoulos, A., Wang, C., Samaras, D., Paragios, N.

In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011 (inproceedings)

pdf [BibTex]

Panagopoulos, A., Wang, C., Samaras, D., Paragios, N. Illumination Estimation and Cast Shadow Detection through a Higher-order Graphical Model In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011 (inproceedings)

pdf [BibTex]

Pose-invariant 3D Proximal Femur Estimation through Bi-Planar Image Segmentation with Hierarchical Higher-Order Graph-based Priors

Wang, C., Boussaid, H., Simon, L., Lazennec, J., Paragios, N.

In International Conference, Medical Image Computing and Computer Assisted Intervention (MICCAI), 2011 (inproceedings)

pdf [BibTex]

Wang, C., Boussaid, H., Simon, L., Lazennec, J., Paragios, N. Pose-invariant 3D Proximal Femur Estimation through Bi-Planar Image Segmentation with Hierarchical Higher-Order Graph-based Priors In International Conference, Medical Image Computing and Computer Assisted Intervention (MICCAI), 2011 (inproceedings)

pdf [BibTex]

Intrinsic Dense 3D Surface Tracking

Zeng, Y., Wang, C., Wang, Y., Gu, X., Samaras, D., Paragios, N.

In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011 (inproceedings)

pdf [BibTex]

Zeng, Y., Wang, C., Wang, Y., Gu, X., Samaras, D., Paragios, N. Intrinsic Dense 3D Surface Tracking In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011 (inproceedings)

pdf [BibTex]

Data-Driven Importance Distributions for Articulated Tracking

Soren Hauberg, Kim S. Pedersen

In Energy Minimization Methods in Computer Vision and Pattern Recognition, 6819, pages: 287-299, Lecture Notes in Computer Science, (Editors: Boykov, Yuri and Kahl, Fredrik and Lempitsky, Victor and Schmidt, Frank), Springer Berlin Heidelberg, 2011 (inproceedings)

Publishers site Code PDF Suppl. material [BibTex]

Soren Hauberg, Kim S. Pedersen Data-Driven Importance Distributions for Articulated Tracking In Energy Minimization Methods in Computer Vision and Pattern Recognition, 6819, pages: 287-299, Lecture Notes in Computer Science, (Editors: Boykov, Yuri and Kahl, Fredrik and Lempitsky, Victor and Schmidt, Frank), Springer Berlin Heidelberg, 2011 (inproceedings)

Publishers site Code PDF Suppl. material [BibTex]

A Physically Natural Metric for Human Motion and the Associated Brownian Motion Model

Soren Hauberg, Kim Steenstrup Pedersen

In 1st IEEE Workshop on Kernels and Distances for Computer Vision (ICCV workshop), 2011 (inproceedings)

Workshop link [BibTex]

Soren Hauberg, Kim Steenstrup Pedersen A Physically Natural Metric for Human Motion and the Associated Brownian Motion Model In 1st IEEE Workshop on Kernels and Distances for Computer Vision (ICCV workshop), 2011 (inproceedings)

Workshop link [BibTex]

Virtual Visual Servoing for Real-Time Robot Pose Estimation

Gratal, X., Romero, J., Kragic, D.

In International Federation of Automatic Control World Congress, IFAC, 2011 (inproceedings)

Pdf [BibTex]

Gratal, X., Romero, J., Kragic, D. Virtual Visual Servoing for Real-Time Robot Pose Estimation In International Federation of Automatic Control World Congress, IFAC, 2011 (inproceedings)

Pdf [BibTex]

Cooperative Localization Based on Visually Shared Objects

Lima, P., Santos, P., Oliveira, R., Ahmad, A., Santos, J.

In RoboCup 2010: Robot Soccer World Cup XIV, pages: 350-361, Lecture Notes in Computer Science ; 6556, Springer, Berlin, Germany, 2011 (inproceedings)

Abstract

In this paper we describe a cooperative localization algorithm based on a modification of the Monte Carlo Localization algorithm where, when a robot detects it is lost, particles are spread not uniformly in the state space, but rather according to the information on the location of an object whose distance and bearing is measured by the lost robot. The object location is provided by other robots of the same team using explicit (wireless) communication. Results of application of the method to a team of real robots are presented.

DOI [BibTex]

Lima, P., Santos, P., Oliveira, R., Ahmad, A., Santos, J. Cooperative Localization Based on Visually Shared Objects In RoboCup 2010: Robot Soccer World Cup XIV, pages: 350-361, Lecture Notes in Computer Science ; 6556, Springer, Berlin, Germany, 2011 (inproceedings)

DOI [BibTex]

Discrete Minimum Distortion Correspondence Problems for Non-rigid Shape Matching

Wang, C., Bronstein, M. M., Bronstein, A. M., Paragios, N.

In International Conference on Scale Space and Variational Methods in Computer Vision (SSVM), 2011 (inproceedings)

pdf [BibTex]

Wang, C., Bronstein, M. M., Bronstein, A. M., Paragios, N. Discrete Minimum Distortion Correspondence Problems for Non-rigid Shape Matching In International Conference on Scale Space and Variational Methods in Computer Vision (SSVM), 2011 (inproceedings)

pdf [BibTex]

Viewpoint Invariant 3D Landmark Model Inference from Monocular 2D Images Using Higher-Order Priors

Wang, C., Zeng, Y., Simon, L., Kakadiaris, I., Samaras, D., Paragios, N.

In IEEE International Conference on Computer Vision (ICCV), 2011 (inproceedings)

pdf [BibTex]

Wang, C., Zeng, Y., Simon, L., Kakadiaris, I., Samaras, D., Paragios, N. Viewpoint Invariant 3D Landmark Model Inference from Monocular 2D Images Using Higher-Order Priors In IEEE International Conference on Computer Vision (ICCV), 2011 (inproceedings)

pdf [BibTex]

Correspondence estimation from non-rigid motion information

Wulff, J., Lotz, T., Stehle, T., Aach, T., Chase, J. G.

In Proc. SPIE, Proc. SPIE, (Editors: B. M. Dawant, D. R. Haynor), SPIE, 2011 (inproceedings)

Abstract

The DIET (Digital Image Elasto Tomography) system is a novel approach to screen for breast cancer using only optical imaging information of the surface of a vibrating breast. 3D tracking of skin surface motion without the requirement of external markers is desirable. A novel approach to establish point correspondences using pure skin images is presented here. Instead of the intensity, motion is used as the primary feature, which can be extracted using optical flow algorithms. Taking sequences of multiple frames into account, this motion information alone is accurate and unambiguous enough to allow for a 3D reconstruction of the breast surface. Two approaches, direct and probabilistic, for this correspondence estimation are presented here, suitable for different levels of calibration information accuracy. Reconstructions show that the results obtained using these methods are comparable in accuracy to marker-based methods while considerably increasing resolution. The presented method has high potential in optical tissue deformation and motion sensing.

pdf link (url) DOI [BibTex]

Wulff, J., Lotz, T., Stehle, T., Aach, T., Chase, J. G. Correspondence estimation from non-rigid motion information In Proc. SPIE, Proc. SPIE, (Editors: B. M. Dawant, D. R. Haynor), SPIE, 2011 (inproceedings)

pdf link (url) DOI [BibTex]

An Empirical Study on the Performance of Spectral Manifold Learning Techniques

Peter Mysling, Soren Hauberg, Kim S. Pedersen

In Artificial Neural Networks and Machine Learning – ICANN 2011, 6791, pages: 347-354, Lecture Notes in Computer Science, (Editors: Honkela, Timo and Duch, Włodzisław and Girolami, Mark and Kaski, Samuel), Springer Berlin Heidelberg, 2011 (inproceedings)

Publishers site PDF [BibTex]

Peter Mysling, Soren Hauberg, Kim S. Pedersen An Empirical Study on the Performance of Spectral Manifold Learning Techniques In Artificial Neural Networks and Machine Learning – ICANN 2011, 6791, pages: 347-354, Lecture Notes in Computer Science, (Editors: Honkela, Timo and Duch, Włodzisław and Girolami, Mark and Kaski, Samuel), Springer Berlin Heidelberg, 2011 (inproceedings)

Publishers site PDF [BibTex]

Separation of visual object features and grasp strategy in primate ventral premotor cortex

Vargas-Irwin, C., Franquemont, L., Black, M., Donoghue, J.

Neural Control of Movement, 21st Annual Conference, 2011 (conference)

[BibTex]

Vargas-Irwin, C., Franquemont, L., Black, M., Donoghue, J. Separation of visual object features and grasp strategy in primate ventral premotor cortex Neural Control of Movement, 21st Annual Conference, 2011 (conference)

[BibTex]

2005

A quantitative evaluation of video-based 3D person tracking

Balan, A. O., Sigal, L., Black, M. J.

In The Second Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, VS-PETS, pages: 349-356, October 2005 (inproceedings)

pdf [BibTex]

2005

Balan, A. O., Sigal, L., Black, M. J. A quantitative evaluation of video-based 3D person tracking In The Second Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, VS-PETS, pages: 349-356, October 2005 (inproceedings)

pdf [BibTex]

Inferring attentional state and kinematics from motor cortical firing rates

Wood, F., Prabhat, , Donoghue, J. P., Black, M. J.

In Proc. IEEE Engineering in Medicine and Biology Society, pages: 1544-1547, September 2005 (inproceedings)

pdf [BibTex]

Wood, F., Prabhat, , Donoghue, J. P., Black, M. J. Inferring attentional state and kinematics from motor cortical firing rates In Proc. IEEE Engineering in Medicine and Biology Society, pages: 1544-1547, September 2005 (inproceedings)

pdf [BibTex]

Motor cortical decoding using an autoregressive moving average model

Fisher, J., Black, M. J.

In Proc. IEEE Engineering in Medicine and Biology Society, pages: 1469-1472, September 2005 (inproceedings)

pdf [BibTex]

Fisher, J., Black, M. J. Motor cortical decoding using an autoregressive moving average model In Proc. IEEE Engineering in Medicine and Biology Society, pages: 1469-1472, September 2005 (inproceedings)

pdf [BibTex]

Fields of Experts: A framework for learning image priors

Roth, S., Black, M. J.

In IEEE Conf. on Computer Vision and Pattern Recognition, 2, pages: 860-867, June 2005 (inproceedings)

pdf [BibTex]

Roth, S., Black, M. J. Fields of Experts: A framework for learning image priors In IEEE Conf. on Computer Vision and Pattern Recognition, 2, pages: 860-867, June 2005 (inproceedings)

pdf [BibTex]

On the receptive fields of Markov random fields: Predictions from a probabilistic model of scene statistics

Black, M. J., Roth, S.

COSYNE 2005, Salt Lake City, March 2005 (conference)

abstract [BibTex]

Black, M. J., Roth, S. On the receptive fields of Markov random fields: Predictions from a probabilistic model of scene statistics COSYNE 2005, Salt Lake City, March 2005 (conference)

abstract [BibTex]

On the spatial statistics of optical flow

(Marr Prize, Honorable Mention)

Roth, S., Black, M. J.

In International Conf. on Computer Vision, International Conf. on Computer Vision, pages: 42-49, 2005 (inproceedings)

pdf [BibTex]

Roth, S., Black, M. J. On the spatial statistics of optical flow In International Conf. on Computer Vision, International Conf. on Computer Vision, pages: 42-49, 2005 (inproceedings)

pdf [BibTex]

Modeling neural population spiking activity with Gibbs distributions

Wood, F., Roth, S., Black, M. J.

In Advances in Neural Information Processing Systems 18, pages: 1537-1544, 2005 (inproceedings)

pdf [BibTex]

Wood, F., Roth, S., Black, M. J. Modeling neural population spiking activity with Gibbs distributions In Advances in Neural Information Processing Systems 18, pages: 1537-1544, 2005 (inproceedings)

pdf [BibTex]

Energy-based models of motor cortical population activity

Wood, F., Black, M.

Program No. 689.20. 2005 Abstract Viewer/Itinerary Planner, Society for Neuroscience, Washington, DC, 2005 (conference)

abstract [BibTex]

Wood, F., Black, M. Energy-based models of motor cortical population activity Program No. 689.20. 2005 Abstract Viewer/Itinerary Planner, Society for Neuroscience, Washington, DC, 2005 (conference)

abstract [BibTex]

1997

Robust anisotropic diffusion and sharpening of scalar and vector images

Black, M. J., Sapiro, G., Marimont, D., Heeger, D.

In Int. Conf. on Image Processing, ICIP, 1, pages: 263-266, Vol. 1, Santa Barbara, CA, October 1997 (inproceedings)

Abstract

Relations between anisotropic diffusion and robust statistics are described. We show that anisotropic diffusion can be seen as a robust estimation procedure that estimates a piecewise smooth image from a noisy input image. The "edge-stopping" function in the anisotropic diffusion equation is closely related to the error norm and influence function in the robust estimation framework. This connection leads to a new "edge-stopping" function based on Tukey's biweight robust estimator, that preserves sharper boundaries than previous formulations and improves the automatic stopping of the diffusion. The robust statistical interpretation also provides a means for detecting the boundaries (edges) between the piecewise smooth regions in the image. We extend the framework to vector-valued images and show applications to robust image sharpening.

pdf publisher site [BibTex]

1997

Black, M. J., Sapiro, G., Marimont, D., Heeger, D. Robust anisotropic diffusion and sharpening of scalar and vector images In Int. Conf. on Image Processing, ICIP, 1, pages: 263-266, Vol. 1, Santa Barbara, CA, October 1997 (inproceedings)

pdf publisher site [BibTex]

Robust anisotropic diffusion: Connections between robust statistics, line processing, and anisotropic diffusion

Black, M. J., Sapiro, G., Marimont, D., Heeger, D.

In Scale-Space Theory in Computer Vision, Scale-Space’97, pages: 323-326, LNCS 1252, Springer Verlag, Utrecht, the Netherlands, July 1997 (inproceedings)

pdf [BibTex]

Black, M. J., Sapiro, G., Marimont, D., Heeger, D. Robust anisotropic diffusion: Connections between robust statistics, line processing, and anisotropic diffusion In Scale-Space Theory in Computer Vision, Scale-Space’97, pages: 323-326, LNCS 1252, Springer Verlag, Utrecht, the Netherlands, July 1997 (inproceedings)

pdf [BibTex]

Learning parameterized models of image motion

Black, M. J., Yacoob, Y., Jepson, A. D., Fleet, D. J.

In IEEE Conf. on Computer Vision and Pattern Recognition, CVPR-97, pages: 561-567, Puerto Rico, June 1997 (inproceedings)

Abstract

A framework for learning parameterized models of optical flow from image sequences is presented. A class of motions is represented by a set of orthogonal basis flow fields that are computed from a training set using principal component analysis. Many complex image motions can be represented by a linear combination of a small number of these basis flows. The learned motion models may be used for optical flow estimation and for model-based recognition. For optical flow estimation we describe a robust, multi-resolution scheme for directly computing the parameters of the learned flow models from image derivatives. As examples we consider learning motion discontinuities, non-rigid motion of human mouths, and articulated human motion.

pdf [BibTex]

Black, M. J., Yacoob, Y., Jepson, A. D., Fleet, D. J. Learning parameterized models of image motion In IEEE Conf. on Computer Vision and Pattern Recognition, CVPR-97, pages: 561-567, Puerto Rico, June 1997 (inproceedings)

pdf [BibTex]

Analysis of gesture and action in technical talks for video indexing

Ju, S. X., Black, M. J., Minneman, S., Kimber, D.

In IEEE Conf. on Computer Vision and Pattern Recognition, pages: 595-601, CVPR-97, Puerto Rico, June 1997 (inproceedings)

Abstract

In this paper, we present an automatic system for analyzing and annotating video sequences of technical talks. Our method uses a robust motion estimation technique to detect key frames and segment the video sequence into subsequences containing a single overhead slide. The subsequences are stabilized to remove motion that occurs when the speaker adjusts their slides. Any changes remaining between frames in the stabilized sequences may be due to speaker gestures such as pointing or writing and we use active contours to automatically track these potential gestures. Given the constrained domain we define a simple ``vocabulary'' of actions which can easily be recognized based on the active contour shape and motion. The recognized actions provide a rich annotation of the sequence that can be used to access a condensed version of the talk from a web page.

pdf [BibTex]

Ju, S. X., Black, M. J., Minneman, S., Kimber, D. Analysis of gesture and action in technical talks for video indexing In IEEE Conf. on Computer Vision and Pattern Recognition, pages: 595-601, CVPR-97, Puerto Rico, June 1997 (inproceedings)

pdf [BibTex]

Modeling appearance change in image sequences

Black, M. J., Yacoob, Y., Fleet, D. J.

In Advances in Visual Form Analysis, pages: 11-20, Proceedings of the Third International Workshop on Visual Form, Capri, Italy, May 1997 (inproceedings)

abstract [BibTex]

Black, M. J., Yacoob, Y., Fleet, D. J. Modeling appearance change in image sequences In Advances in Visual Form Analysis, pages: 11-20, Proceedings of the Third International Workshop on Visual Form, Capri, Italy, May 1997 (inproceedings)

abstract [BibTex]

1996

Cardboard people: A parameterized model of articulated motion

Ju, S. X., Black, M. J., Yacoob, Y.

In 2nd Int. Conf. on Automatic Face- and Gesture-Recognition, pages: 38-44, Killington, Vermont, October 1996 (inproceedings)

Abstract

We extend the work of Black and Yacoob on the tracking and recognition of human facial expressions using parameterized models of optical flow to deal with the articulated motion of human limbs. We define a "cardboard person model" in which a person's limbs are represented by a set of connected planar patches. The parameterized image motion of these patches is constrained to enforce articulated motion and is solved for directly using a robust estimation technique. The recovered motion parameters provide a rich and concise description of the activity that can be used for recognition. We propose a method for performing view-based recognition of human activities from the optical flow parameters that extends previous methods to cope with the cyclical nature of human motion. We illustrate the method with examples of tracking human legs over long image sequences.

pdf [BibTex]

1996

Ju, S. X., Black, M. J., Yacoob, Y. Cardboard people: A parameterized model of articulated motion In 2nd Int. Conf. on Automatic Face- and Gesture-Recognition, pages: 38-44, Killington, Vermont, October 1996 (inproceedings)

pdf [BibTex]

Skin and Bones: Multi-layer, locally affine, optical flow and regularization with transparency

(Nominated: Best paper)

Ju, S., Black, M. J., Jepson, A. D.

In IEEE Conf. on Computer Vision and Pattern Recognition, CVPR’96, pages: 307-314, San Francisco, CA, June 1996 (inproceedings)

pdf [BibTex]

Ju, S., Black, M. J., Jepson, A. D. Skin and Bones: Multi-layer, locally affine, optical flow and regularization with transparency In IEEE Conf. on Computer Vision and Pattern Recognition, CVPR’96, pages: 307-314, San Francisco, CA, June 1996 (inproceedings)

pdf [BibTex]

EigenTracking: Robust matching and tracking of articulated objects using a view-based representation

Black, M. J., Jepson, A.

In Proc. Fourth European Conf. on Computer Vision, ECCV’96, pages: 329-342, LNCS 1064, Springer Verlag, Cambridge, England, April 1996 (inproceedings)

pdf video [BibTex]

Black, M. J., Jepson, A. EigenTracking: Robust matching and tracking of articulated objects using a view-based representation In Proc. Fourth European Conf. on Computer Vision, ECCV’96, pages: 329-342, LNCS 1064, Springer Verlag, Cambridge, England, April 1996 (inproceedings)

pdf video [BibTex]

1995

Robust estimation of multiple surface shapes from occluded textures

Black, M. J., Rosenholtz, R.

In International Symposium on Computer Vision, pages: 485-490, Miami, FL, November 1995 (inproceedings)

pdf [BibTex]

1995

Black, M. J., Rosenholtz, R. Robust estimation of multiple surface shapes from occluded textures In International Symposium on Computer Vision, pages: 485-490, Miami, FL, November 1995 (inproceedings)

pdf [BibTex]

The PLAYBOT Project

In Proc. IJCAI Workshop on AI Applications for Disabled People, Montreal, August 1995 (inproceedings)

abstract [BibTex]

Tsotsos, J. K., Dickinson, S., Jenkin, M., Milios, E., Jepson, A., Down, B., Amdur, E., Stevenson, S., Black, M., Metaxas, D., Cooperstock, J., Culhane, S., Nuflo, F., Verghese, G., Wai, W., Wilkes, D., Ye, Y. The PLAYBOT Project In Proc. IJCAI Workshop on AI Applications for Disabled People, Montreal, August 1995 (inproceedings)

abstract [BibTex]

Recognizing facial expressions under rigid and non-rigid facial motions using local parametric models of image motion

Black, M. J., Yacoob, Y.

In International Workshop on Automatic Face- and Gesture-Recognition, Zurich, July 1995 (inproceedings)

video abstract [BibTex]

Black, M. J., Yacoob, Y. Recognizing facial expressions under rigid and non-rigid facial motions using local parametric models of image motion In International Workshop on Automatic Face- and Gesture-Recognition, Zurich, July 1995 (inproceedings)

video abstract [BibTex]

Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion

Black, M. J., Yacoob, Y.

In Fifth International Conf. on Computer Vision, ICCV’95, pages: 347-381, Boston, MA, June 1995 (inproceedings)

Abstract

This paper explores the use of local parametrized models of image motion for recovering and recognizing the non-rigid and articulated motion of human faces. Parametric flow models (for example affine) are popular for estimating motion in rigid scenes. We observe that within local regions in space and time, such models not only accurately model non-rigid facial motions but also provide a concise description of the motion in terms of a small number of parameters. These parameters are intuitively related to the motion of facial features during facial expressions and we show how expressions such as anger, happiness, surprise, fear, disgust and sadness can be recognized from the local parametric motions in the presence of significant head motion. The motion tracking and expression recognition approach performs with high accuracy in extensive laboratory experiments involving 40 subjects as well as in television and movie sequences.

pdf video publisher site [BibTex]

Black, M. J., Yacoob, Y. Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion In Fifth International Conf. on Computer Vision, ICCV’95, pages: 347-381, Boston, MA, June 1995 (inproceedings)

pdf video publisher site [BibTex]

A computational model for shape from texture for multiple textures

Black, M. J., Rosenholtz, R.

Investigative Ophthalmology and Visual Science Supplement, Vol. 36, No. 4, pages: 2202, March 1995 (conference)

abstract [BibTex]

Black, M. J., Rosenholtz, R. A computational model for shape from texture for multiple textures Investigative Ophthalmology and Visual Science Supplement, Vol. 36, No. 4, pages: 2202, March 1995 (conference)

abstract [BibTex]