A Real-time Vision-based Gesture Interface

John Lin has built an impressive real-time system for vision-based gesture interface, through which users are able to manipulate virtual objects, navigate virtual terrian, draw pictures, play video games, etc. The systems demonstrates how user can interact with the computer in various scenarios through the use of the bare hand as a natural means of communication. Through the use of different gestures, users are capable of performing complicated actions and multidimensional control that are difficult to achieve using just the mouse and the keyboard. For details, please refer to Dr. John Lin's Ph.D thesis.


Demos: (please click images to see videos)
 
real-time gesture interface in action (14M wmv)
finger painting (6M mpg)
navigation (5M mpg)
manipulating virtual objects(6M mpg)
palm detection (7M mpg)
fingertip detection (3M mpg)

Return to HCI Research


Updated 09/2005. Copyright © 2001-2006 Ying Wu