Decentralized Visual Tracking of Multiple Targets

Tracking multiple targets in video is critical for video monitoring and surveillance. Tracker coalescence, meaning that some targets have multiple tracks while some targets have none (or are lost), is a challenging and common problem in practice. Existing solutions that are based on joint data association are centralized schemes and are in general confronted by their combinatorial complexities.

We give a novel decentralized solution that has a linear complexity and can be easily parallelized so that the accuracy and the capacity of the multiple target tracker can be significantly enhanced. Our decentralized/collaborative solution employs a set of collaborative autonomous trackers in a dynamic ad hoc random field where exclusive motion priors are designed and embedded. This new model enables the competition of these individual trackers that converge at a mean field fixed-point. Our experiments indicate that even simple competition models can lead to significant enhancement in performance. Recently, we have extended this new method to handle a variable number of targets. The new approach that largely overcomes coalescence with linear complexity significantly advances the state-of-the-art of multiple target tracking, and may greatly impact practical problems.


Demo sequences:
 
soccer
hockey
CAVIAR
campus



Publication:
  1. Ting Yu and Ying Wu, "Decentralized Multiple Target Tracking using Netted Collaborative Autonomous Trackers", in Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'05), San Diego, CA, June 20-26, 2005.  [PDF]

  2.  
  3. Ting Yu and Ying Wu, "Collaborative Tracking of Multiple Targets", in Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'04), vol.I, pp. 834-841, Washington, DC, June, 2004.  [PDF]

  4.  
  5. Ting Yu and Ying Wu, "Collaborative Visual Tracking of Multiple Identical Targets", Invited, in Proc. SPIE Conf. on Storage and Retrieval Methods and Applications for Multimedia, San Jose, CA, Jan. 2005.

  6.  
  7. Ying Wu, Gang Hua and Ting Yu, "Tracking Articulated Body by Dynamic Markov Network", In Proc. IEEE Int'l Conf. on Computer Vision (ICCV'03), pp.1094-1101, Nice, France, Oct., 2003. [PDF]
Return to HD-Motion Research
Updated 7/2006. Copyright © 2001-2006 Ying Wu