Facial expressions and speech are elements that provide emotional information about the user through multiple communication channels. In this paper, a novel multimodal emotion recognition system based on visual and auditory information processing is proposed. The proposed approach is used in real affective human robot communication in order to estimate five different emotional states (i.e., hap...

Emotion is often defined as a complex state of feeling that results in physical and psychological changes that influence thought and behaviour. Emotion modelling and recognition has drawn extensive attention from disciplines such as psychology, cognitive science and engineering. The main goal is to identify the emotional or physical state of a human being from his or her voice. A speaker has di...

The automatic recognition of children’s speech is well known to be a challenge, and so is the influence of affect that is believed to downgrade performance of a speech recogniser. In this contribution, we investigate the combination of both phenomena. Extensive test runs are carried out for 1 k vocabulary continuous speech recognition on spontaneous motherese, emphatic, and angry children’s spe...

The importance of incorporating emotional aspect in human computer interaction continues to arise. Unfortunately, exploration of the subject in Indonesian is still very lacking. This paper presents the first study of emotion recognition in Indonesian on conversational speech. We construct our corpus, IDESC, by making use of television talk show recordings in various topics of discussion, yieldi...

There is evidence from neuroimaging and clinical studies that functionally link the basal ganglia to emotional speech processes. However, in most previous studies, explicit tasks were administered. Thus, the underlying mechanisms substantiating emotional speech are not separated from possibly process-related task effects. Therefore, the current study tested emotional speech processing in an eve...

Synthesizing emotional speech by means of conversion from neutral speech allows us to generate emotional speech from many existing Text-to-Speech (TTS) systems. How much of the target emotion can be portrayed by the generated speech is largely dependent on the emotion data used to train the mapping function for voice transformation. In this paper, we introduce a method to pre-process the emotio...

Speech Emotion Recognition (SER) makes it possible for machines to perceive affective information. Our previous research differed from conventional SER endeavours in that focused on recognising unseen emotions speech autonomously through machine learning. Such a step would enable the automatic leaning of unknown emerging emotional states. This type learning framework, however, still relied manu...

Speech interaction with in-car controls is becoming more commonplace as the interaction is considered to be less distracting to the driver. Cars of today are equipped with speech recognition system to dial phone numbers and to control the cockpit environment. Furthermore satellite navigation systems provide the driver with verbal directions to their destination. The paper extends the speech int...

Analysis of speech for recognition of stress is important for identification of emotional state of person. This can be done using ‘Linear Techniques’, which has different parameters like pitch, vocal tract spectrum, formant frequencies, Duration, MFCC etc. which are used for extraction of features from speech. TEO-CB-Auto-Env is the method which is non-linear method of features extraction. Anal...

Cultural differences have been one of the many factors that can cause failures in speech emotion analysis. If this cultural parameter could be regarded as noise artifacts in detecting emotion in speech, we could then extract pure emotion speech signal from the raw emotional speech. In this paper we use the amplitude spectral subtraction (ASS) method to profile the emotion from raw emotional spe...