La linguistique de corpus, c’est à dire les recherches sur le langage portant un matériel écrit ou oral recueilli et conservé, s’est considérablement développée au cours des dernières décennies. Ce développement fait l’aide corpus constitués plus en nombreux importants. L’augmentation la taille a nécessité, pour leur analyse, d’outils automatiques, mais aussi une vraie réflexion nature objectif...

Lexicon development and Part of Speech (POS) tagging are very important for almost all Natural Language Processing(NLP) application areas. The rapid development of these resources and tools using machine learning techniques for less computerized languages requires appropriately tagged corpus. A tagged Bengali news corpus has been developed from the web archive of a widely read Bengali newspaper...

This paper reviews discourse phenomena that occur frequently in task.oriented man.machine dialogs, reporting on a~n empirical study that demonstrates the necessity of handling ellipsis, anaphora, extragrammaticality, inter-sentential metalanguage, and other abbreviatory devices in order to achieve convivial user interaction. Invariably, users prefer to generate terse or fragmentary utterances i...

The CMU Phoenix system is an experiment in understanding spontaneous speech. It has been implemented for the Air Travel Information Service task. In this task, casual users are asked to obtain information from a database of air travel information. Users are not given a vocabulary, grammar or set of sentences to read. They compose queries themselves in a spontaneous manner. This task presents sp...

This paper reviews discourse phenomena that occur frequently in task.oriented man.machine dialogs, reporting on a~n empirical study that demonstrates the necessity of handling ellipsis, anaphora, extragrammaticality, inter-sentential metalanguage, and other abbreviatory devices in order to achieve convivial user interaction. Invariably, users prefer to generate terse or fragmentary utterances i...

One of the most frequently cited sarcasm realizations is the use of positive sentiment within negative context. We propose a novel approach towards modeling a sentiment context of a document via the sequence of sentiment labels assigned to its sentences. We demonstrate that the sentiment flow shifts (from negative to positive and from positive to negative) can be used as reliable classification...

We have analyzed 607 sentences of spontaneous h u m a n compu te r speech d a t a conta in ing repairs (drawn from a corpus of 10,718). We present here cr i ter ia and techniques for au tomat i ca l ly de tec t ing the presence of a repair , i ts locat ion, and making the appropr ia te correct ion. T h e cr i te r ia involve in teg ra t ion of knowledge from several sources: p a t t e r n match...

The paper describes an ongoing project that aims at building a reference corpus of German computer-mediated communication (CMC) as a new component of an already existing reference corpus of written contemporary German. The ‘Deutsches Referenzkorpus zur internetbasierten Kommunikation’ (DeRiK) shall include data from the most prominent CMC genres amongst German Internet users and, thus, close a ...

As our forms of media entertainment and information change, there are more and more examples of non-linear forms within our traditionally linear media. We as a culture are increasingly seeing ourselves as a collection of cultures, each with a voice, each with a story, and each deserving of being a part of every story. The storytelling process includes an author, a story and an audience. When st...

The present paper presents the experience gained at LDC in the collection and transcription of a corpus of conversational telephone speech in dialectal Arabic. The paper will cover the following: (a) Arabic language background; (b) objectives, principles, and methodological choices of dialectal Arabic transcription, (c) conceptualization and design features of LDC’s ‘Arabic Multi-Dialectal Tran...