Emotional body language constitutes an important channel of nonverbal information. Of this large set, hand-over-face gestures are treated as noise because they occlude facial expressions. In this paper, we propose an alternative facial processing framework where face occlusions instead of being removed, are detected, localized and eventually classified into communicative gestures. We present a ...

This paper describes our ongoing research work on deviceless interaction using hand gesture recognition with a calibrated stereo system. Video-based interaction is one of the most intuitive kinds of Human-Computer-Interaction with Virtual-Reality applications due to the fact that users are not wired to a computer. If interaction with three-dimensional environments is considered, pointing, grabb...

PurposeDevelop an integrated, computer vision-based system to operate a commercial wheelchair-mounted robotic manipulator (WMRM). In addition, a gesture recognition interface system was developed specially for individuals with upper-level spinal cord injuries (SCIs) including object tracking and face recognition to function as an efficient, hands-free WMRM controller. Design/Methodology/Approac...

The Perceptual Computing Section of the Media Laboratory is working to make computers that understand people, and can work with them in the manner of an attentive human-like assistant. To this end we have built a series of interactive of-ce spaces that are used as real-time experimental testbeds. These spaces are instrumented with cameras and microphones, and perform audiovisual interpretation ...

The sense of touch provides fundamental information about the surrounding world, and feedback about our own actions. Although touch is very important during the earliest stages of life, to date no study has investigated infants' abilities to process visual stimuli implying touch. This study explores the developmental origins of the ability to visually recognize touching gestures involving other...