Facial expressions are the facial changes in response to a person’s internal emotional states, intentions, or social communications. Facial expression analysis has been an active research topic for behavioral scientists since the work of Darwin in 1872 [18, 22, 25, 71]. Suwa et al. [76] presented an early attempt to automatically analyze facial expressions by tracking the motion of 20 identifie...

The goal of this special issue is to provide a state-of-the-art overview of new paradigms, methods, and challenges in Automatic Face and Gesture Recognition. As such we have made a selection of the best evaluated papers in The Eighth International Conference on Automatic Face and Gesture Recognition 2008 and we have asked the authors to extend their articles so that they reflect not only the in...

OBJECTIVE The aim of this study was to describe the communication ability of individuals with trisomy 18 and trisomy 13 syndromes. METHODS Parents reported on children's potential communication acts, words, spontaneous gesture, and augmentative and alternative communication (AAC) using a parent report inventory (n = 32; age range 3-35 years). Potential communicative acts are defined as behavi...

As a novel approach to perform user authentication, we propose a multimodal biometric system that uses faces and gestures obtained from a single vision sensor. Unlike typical multimodal biometric systems using physical information, the proposed system utilizes gesture video signals combined with facial images. Whereas physical information such as face, fingerprints, and iris is fixed and not ch...

Modern dialogue systems should interpret the users’ behavior and mind in the same way as human beings do. That means in a multimodal manner, where communication is not limited to verbal utterances, as is the case for most state-of-the-art dialogue systems, several modalities are involved, e.g., speech, gesture, and facial expression. The design of a dialogue system must adapt its concept to mul...

Nowadays accessibility to new technologies for everyone is a task to accomplish. A way to contribute to this aim is creating new interfaces based on computer vision using low cost devices such as webcams. In this paper a face-based perceptual user interface is presented. Our approach is divided in four steps: automatic face detection, best face features detection, feature tracking and face gest...

Modal verbs in English are challenging to learn by speakers of other languages. The purpose of thiswas to shed light on the use of gesture in learning English modal verbs by Persian-speaking children.To achieve this, 60 elementary Iranian learners, studying at some institutes in Karaj took part in thisstudy. The participants were randomly put into one experimental group and one control group. T...

This work presents the design and implementation of corpus recording sessions along with some preliminary processing results. Captured modalities include speech and facial expressions but the focus is on hand gesture expressivity. Thus, this is the primary modality and is recorded using three methods: bare hands, Nintendo Wii remote controls and datagloves. Such a setup allows for multimodal af...

Recent findings point to a perceptive impairment of emotional facial expressions in patients diagnosed with Parkinson disease (PD). In these patients, administration of dopamine can modulate emotional facial recognition. We used fMRI to investigate differences in the functional activation in response to emotional and nonemotional gestures between PD patients and age-matched healthy controls (HC...