A Hybrid Latent Space Data Fusion Method for Multimodal Emotion Recognition
نویسندگان
چکیده
منابع مشابه
Fusion of Facial Expressions and EEG for Multimodal Emotion Recognition
This paper proposes two multimodal fusion methods between brain and peripheral signals for emotion recognition. The input signals are electroencephalogram and facial expression. The stimuli are based on a subset of movie clips that correspond to four specific areas of valance-arousal emotional space (happiness, neutral, sadness, and fear). For facial expression detection, four basic emotion sta...
متن کاملPhysio-visual data fusion for emotion recognition
Several approaches have been proposed to recognize human emotions based on facial expressions or physiological signals, relatively rare work as been done to fuse these two, and other, modalities to improve the accuracy and robustness of the emotion recognition system. In this paper, we ropose two methods based on feature-level and decision-level to fuse facial and physiological modalities. At f...
متن کاملA New Information Fusion Method for Bimodal Robotic Emotion Recognition
Emotion recognition has become a popular area in human-robot interaction research. Through recognizing facial expressions, a robot can interact with a person in a more friendly manner. In this paper, we proposed a bimodal emotion recognition system by combining image and speech signals. A novel probabilistic strategy has been studied for a support vector machine (SVM)-based classification desig...
متن کاملData Fusion for Real-time Multimodal Emotion Recognition through Webcams and Microphones in E-Learning
This paper describes the validation study of our software that uses combined webcam and microphone data for real-time, continuous, unobtrusive emotion recognition as part of our FILTWAM framework. FILTWAM aims at deploying a real time multimodal emotion recognition method for providing more adequate feedback to the learners through an online communication skills training. Herein, timely feedbac...
متن کاملMultimodal Emotion Recognition
Multimodal fusion is the process whereby two or more forms of input are gathered together in order to produce a higher overall classification accuracy than individual unimodal systems. This is a popular technique in emotion recognition. In this study, we attempted to discover how much we could improve upon individual unimodal systems using decision level fusion. To accomplish this, we acquired ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2019
ISSN: 2169-3536
DOI: 10.1109/access.2019.2955637