In this paper the suitability of different document representations for automatic document classification is compared, investigating a whole range of representations between bag-of-words and bag-of-phrases. We look at some of their statistical properties, and determine for each representation the optimal choice of classification parameters and the effect of Term Selection. Phrases are represent...

However, there are also many languages in which it is possible to have noun phrases in which there is no noun or pronoun, in which the only constituents of the noun phrase are words that otherwise occur as modifiers of nouns. For example, in the example in (1) from Nkore-Kiga, a Bantu language spoken in Uganda, the subject omuto ‘young’ is a word that normally functions in the language as an ad...

Most parsing algorithms require phrases that are to be combined to be either contiguous or marked as being ‘extraposed’. The assumption that phrases which are to be combined will be adjacent to one another supports rapid indexing mechanisms: the fact that in most languages items can turn up in unexpected locations cancels out much of the ensuing efficiency. The current paper shows how ‘out of p...

The paper claims that the right attachment rules for phrases originally suggested by Frazier and Fodor are wrong, and that none of the subsequent patchings of the rules by syntactic methods have improved the situation. For each rule there are perfectly straightforward and indefinitely large classes of simple counterexamples. We then examine suggestions by Ford et M., Schubert and Hirst which ar...

This paper describes experiments documenting significant variations in word usage patterns within social subgroups of AI researchers. As some phrases have very different collocational patterns than their constituent words, we look beyond occurrences of individual words, to consider word phrases. The mutual information statistic is used to measure the information content of phrases beyond that o...

Phrases are used in both commercial and experimental search engines. Despite the large amount of work in the area results remain mixed. It is still not clear whether phrases can be used to improve retrieval effectiveness. In this paper, we examine phrases and their properties independently of any specific retrieval approach. We explore phrase usage in text corpora and relevance patterns related...

We assess the use of hedge phrases in “affective” NLG texts. A simple experiment suggests non-native speakers prefer texts that contain hedge phrases, but native speakers prefer texts that do not contain hedge phrases.

A common view of finiteness, particularly prevalent in the transformational grammar traditions, associates it with the marking of tense/aspect/mood and subject agreement on verbs. However, since nominal predicates as well as verbal predicates may be temporally located (e.g. ex-soldier, former friend, future President), there is no reason in principle why nominal predicates might not bear TAM ma...

Linguists draw a distinction between two types of interrogatives: discourse linked (d-linked) phrases such as which man, which implies the existence of a set of contextually determined entities (men) from which the speaker is asking for a choice, and non-d-linked interrogatives such as who, which carry no such implication. Two questionnaires and an on-line reading study showed that readers pref...

In this paper, we describe the architecture of a sub-sentential alignment system that links linguistically motivated phrases in parallel texts. We conceive our sub-sentential aligner as a cascade model consisting of two phases. In the first phase, anchor chunks are linked on the basis of lexical correspondences and syntactic similarity. In the second phase, we will focus on the more complex tra...