Adaptive Multimodal Emotion Detection Architecture for Social Robots

نویسندگان

چکیده

Emotion recognition is a strategy for social robots used to implement better Human-Robot Interaction and model their behaviour. Since human emotions can be expressed in different ways (e.g., face, gesture, voice), multimodal approaches are useful support the process. However, although there exist studies dealing with emotion robots, they still present limitations fusion process, dropping performance if one or more modalities not have qualities. This common situation robotics, due high variety of sensory capacities robots; hence, flexible models needed. In this context, we propose an adaptive architecture able work multiple sources information manage levels data quality missing data, lead understand mood people given environment accordingly adapt Each modality analyzed independently then aggregate partial results previous proposed method, called EmbraceNet+, which adapted integrated our framework. We also extensive review state-of-the-art methods approaches. evaluate by performing tests several combined classify using four categories (i.e., happiness, neutral, sadness, anger). Results reveal that approach presence modalities. Furthermore, obtained validated compared other similar proposals, obtaining competitive models.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Emotion Modelling for Social Robots

This chapter describes current advances in emotion modelling for social robots. It begins by contextualising the role of emotions in social robots, considering the concept of the Affective Loop. It describes a number of elements for the synthesis and expression of emotions through robotic embodiments and provides an overview of the area of emotional adaptation and empathy in social robots.

متن کامل

Software Architecture for Social Robots

People are striving for easy, natural interfaces. Robotic user interfaces aim at providing this kind of interface by using human like interaction modalities. However, many applications fail, not because of fundamental problems of addressing social interaction but due to an unbalanced design. In this paper we derive a balancing framework for designing robotic user interfaces that balances four k...

متن کامل

A Passive Learning Sensor Architecture for Multimodal Image Labeling: An Application for Social Robots

Object detection and classification have countless applications in human-robot interacting systems. It is a necessary skill for autonomous robots that perform tasks in household scenarios. Despite the great advances in deep learning and computer vision, social robots performing non-trivial tasks usually spend most of their time finding and modeling objects. Working in real scenarios means deali...

متن کامل

Master internship position to ll Multimodal merging for social robots

To have a consistent perception of its surrounding world, an agent has to continuously merge the data ows coming from its various sensors. Multiple studies were done in animals and humans to understand this process at the neuronal and behavioral levels [5]. Especially, it looks like humans are able to merge data in a statistically optimal fashion [2]. Through this internship, the selected candi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2022

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2022.3149214