We present a method for detecting driver frustration from both video and audio streams captured during the driver’s interaction with an in-vehicle voice-based navigation system. The video is of the driver’s face when the machine is speaking, and the audio is of the driver’s voice when he or she is speaking. We analyze a dataset of 20 drivers that contains 596 audio epochs (audio clips, with dur...

Models of phonological development assume that speech perception precedes speech production and that children acquire suprasegmental features earlier than segmental features. Studies of Chinese-speaking children challenge these assumptions. For example, Chinese-speaking children can produce tones before two-and-a-half years but are not able to discriminate the same tones until after 6 years of ...

Currently, Communicative Language Teaching has been popular around the world and has a profound effect on second language acquisition since the 1970s. For Communicative Language Teaching to be successful, there is a need for appropriate teaching materials. This paper analyzes speaking tasks in Chinese and Swedish textbooks for grade 8,Go for it and Magic. The analysis presents content analysis,...

We conducted a comparative analytic study on the contextdependent Gaussian mixture hiddenMarkov model (CD-GMMHMM) and deep neural network hidden Markov model (CDDNN-HMM) with respect to the phone discrimination and the robustness performance. We found that the DNN can significantly improve the phone recognition performance for every phoneme with 15.6% to 39.8% relative phone error rate reductio...

PURPOSE The present study examined whether engaging working memory in a secondary task benefits speech fluency. Effects of dual-task conditions on speech fluency, rate, and errors were examined with respect to predictions derived from three related theoretical accounts of disfluencies. METHOD Nineteen adults who stutter and twenty adults who do not stutter participated in the study. All parti...

Auditory speech is difficult to discern in degraded listening conditions, however the addition of visual speech can improve perception. The Perceptual Assimilation Model [1] suggests that non-native contrasts involving a native phonological difference (two-category assimilation) should be discriminated more accurately than those involving a phonetic goodness-offit difference (category-goodness ...

It is generally assumed that language a purposeful goal-oriented activity; its main objective the internalization of system rules which defines correct linguistic competence accompanied by required communicative competence. Added to that, Language unity four major skills, namely listening, speaking, reading and writing. Recently, it has been argued on both linguistics psychological grounds spea...

It is a difficult problem to recognize baseball live speech because the speech is rather fast, noisy and disfluent due to rephrasing, repetition, mistake and grammatical deviation caused by spontaneous speaking style. To solve these problems, we propose in this paper a speech recognition method of incorporating the baseball game knowledge such as counting of inning, out, strike and ball. Due to...