Improving Speech Related Facial Action Unit Recognition by Audiovisual Information Fusion
نویسندگان
چکیده
منابع مشابه
Improving Speech Related Facial Action Unit Recognition by Audiovisual Information Fusion
It is challenging to recognize facial action unit (AU) from spontaneous facial displays, especially when they are accompanied by speech. The major reason is that the information is extracted from a single source, i.e., the visual channel, in the current practice. However, facial activity is highly correlated with voice in natural human communications. Instead of solely improving visual observat...
متن کاملAudiovisual Facial Action Unit Recognition using Feature Level Fusion
Recognizing facial actions is challenging, especially when they are accompanied with speech. Instead of employing information solely from the visual channel, this work aims to exploit information from both visual and audio channels in recognizing speech-related facial action units (AUs). In this work, two feature-level fusion methods are proposed. The first method is based on a kind of human-cr...
متن کاملTexture and shape information fusion for facial expression and facial action unit recognition
A novel method based on fusion of texture and shape information is proposed for facial expression and Facial Action Unit (FAU) recognition from video sequences. Regarding facial expression recognition, a subspace method based on Discriminant Non-negative Matrix Factorization (DNMF) is applied to the images, thus extracting the texture information. In order to extract the shape information, the ...
متن کاملUpper Facial Action Unit Recognition
This paper concentrates on the comparisons of systems that are used for the recognition of expressions generated by six upper face action units (AU s) by using Facial Action Coding System (FACS). Haar wavelet, Haar-Like and Gabor wavelet coe cients are compared, using Adaboost for feature selection. The binary classi cation results by using Support Vector Machines (SVM ) for the upper face AU s...
متن کاملImproving 3D Facial Action Unit Detection with Intrinsic Normalization
Data normalization techniques are commonly used to reduce intra-class variance while preserving inter-class differences that aid in classification and regression tasks. Such practices bring all data examples to similar scale and range, and help to decrease the dimensionality of categorization problems. In this paper we describe a novel use of a geometric framework to extend the concept of data ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Cybernetics
سال: 2019
ISSN: 2168-2267,2168-2275
DOI: 10.1109/tcyb.2018.2840090