Adaptive Multimodal Emotion Detection Architecture for Social Robots
نویسندگان
چکیده
Emotion recognition is a strategy for social robots used to implement better Human-Robot Interaction and model their behaviour. Since human emotions can be expressed in different ways (e.g., face, gesture, voice), multimodal approaches are useful support the process. However, although there exist studies dealing with emotion robots, they still present limitations fusion process, dropping performance if one or more modalities not have qualities. This common situation robotics, due high variety of sensory capacities robots; hence, flexible models needed. In this context, we propose an adaptive architecture able work multiple sources information manage levels data quality missing data, lead understand mood people given environment accordingly adapt Each modality analyzed independently then aggregate partial results previous proposed method, called EmbraceNet+, which adapted integrated our framework. We also extensive review state-of-the-art methods approaches. evaluate by performing tests several combined classify using four categories (i.e., happiness, neutral, sadness, anger). Results reveal that approach presence modalities. Furthermore, obtained validated compared other similar proposals, obtaining competitive models.
منابع مشابه
Emotion Modelling for Social Robots
This chapter describes current advances in emotion modelling for social robots. It begins by contextualising the role of emotions in social robots, considering the concept of the Affective Loop. It describes a number of elements for the synthesis and expression of emotions through robotic embodiments and provides an overview of the area of emotional adaptation and empathy in social robots.
متن کاملSoftware Architecture for Social Robots
People are striving for easy, natural interfaces. Robotic user interfaces aim at providing this kind of interface by using human like interaction modalities. However, many applications fail, not because of fundamental problems of addressing social interaction but due to an unbalanced design. In this paper we derive a balancing framework for designing robotic user interfaces that balances four k...
متن کاملA Passive Learning Sensor Architecture for Multimodal Image Labeling: An Application for Social Robots
Object detection and classification have countless applications in human-robot interacting systems. It is a necessary skill for autonomous robots that perform tasks in household scenarios. Despite the great advances in deep learning and computer vision, social robots performing non-trivial tasks usually spend most of their time finding and modeling objects. Working in real scenarios means deali...
متن کاملMaster internship position to ll Multimodal merging for social robots
To have a consistent perception of its surrounding world, an agent has to continuously merge the data ows coming from its various sensors. Multiple studies were done in animals and humans to understand this process at the neuronal and behavioral levels [5]. Especially, it looks like humans are able to merge data in a statistically optimal fashion [2]. Through this internship, the selected candi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2022
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2022.3149214