As a step toward simulating dynamic dialogue between agents and humans in virtual environments, we describe learning a model of social behavior composed of interleaved utterances and physical actions. In our model, utterances are abstracted as {speech act, propositional content, referent} triples. After training a classifier on 100 gameplay logs from The Restaurant Game annotated with dialogue ...

While the dialogue functions of speech in two-party dialogue have been extensively studied, there has been much less work on either multi-party communication, multimodal communication, and especially vision in a multi-party face-to-face setting. In this paper we report on one such effort to apply state of the art real-time visual processing to enhance a dialogue model of multi-party communicati...

Researching second screen interactions that form a social soundtrack concerning a major broadcast media event, we perform statistical analysis on more than 800 K postings and 50 K blogs of Super Bowl XLIX on Instagram and Tumblr respectively for three categories (commercials, music and game) during three phrases (Pre, During, and Post) identifying the influence of different social soundtrack fe...

Bailu Ding, Jiang-Ming Yang, Chong Wang, Rui Cai, Zhiwei Li, Lei Zhang Fudan University, [email protected] Microsoft Research Asia, {jmyang, ruicai, zli, leizhang}@microsoft.com Princeton University, [email protected] 1 Latent Structures of Dialogue Documents Various forms of data that consist of sequential messages abound in social networks, such as citations, mail lists, chats, and fo...

Dialogues are linguistic interactions between people and can provide hints on social relationship and personality. We aim to analyze the social relationships of the characters in TV dramas based on dialogues. In addition to knowing just who talks to whom, the analysis of dialogue content gives more detailed information on the types of interaction, e.g. asking or informing, and the emotional sta...

In this paper, we present a multitask learning method for predicting the resolution status of the issues expressed in social media conversations among customer-care agents and social media users, along with the nature of dialogues of those conversations. Our method extends beyond social media conversation analysis, and is naturally applicable to general multiple sequence labeling tasks where ea...

Spoken dialogue systems are increasingly being used to facilitate and enhance human communication. While these interactive systems can process the linguistic aspects of human communication, they are not yet capable of processing the complex dynamics involved in social interaction. Conversational interaction is a complex dynamic and joint activity where all speakers participate in the constructi...