Representation and learning of commonsense knowledge is one of the foundational problems in the quest to enable deep language understanding. This issue is particularly challenging for understanding casual and correlational relationships between events. While this topic has received a lot of interest in the NLP community, research has been hindered by the lack of a proper evaluation framework. T...

A readability formula is obtained that can be used by computer programs for style checking of Japanese texts and need not syntactic or semantic information. The formula is derived as a linear combination of tile surface characteristics of the text that are related to its readability: (1) the average number of characters per sentence, (2) for each type of characters (Roman alphabets, kanzis, hir...

Previous studies have shown that comprehenders use rich contextual information to anticipate upcoming input on the fly, but less is known about how comprehenders integrate different sources of information to generate predictions in real time. The current study examines the time course with which the lexical meaning and structural roles of preverbal arguments impact comprehenders’ lexical semant...

Prediction or expectancy is thought to play an important role in both music and language processing. However, prediction is currently studied independently in the two domains, limiting research on relations between predictive mechanisms in music and language. One limitation is a difference in how expectancy is quantified. In language, expectancy is typically measured using the cloze probability...

Cloze tests have been widely used for measuring reading comprehension, readability and language proficiency. There is still much controversy on what it really is that cloze measures. The result of much correlational research is contradictory and very unsatisfactory. Thus, with a qualitative orientation, this study attempts to look at the judgmental validity of cloze as a test of reading compreh...

Fill-in-the-blank questions, or cloze items, are commonly used in language learning applications. The benefits of personalized items, tailored to the user’s interest and proficiency, have motivated research on automatic generation of cloze items. This paper is concerned with generating cloze items for prepositions, whose usage often poses problems for non-native speakers of English. The quality...

1 We report experience in applying techniques for natural language processing to algorithmically generating test items for both reading and listening cloze items. We propose a word sense disambiguationbased method for locating sentences in which designated words carry specific senses, and apply a collocation-based method for selecting distractors that are necessary for multiple-choice cloze ite...

This study aims to examine when and how readers make use of top-down information to predict or integrate upcoming words by utilizing the characteristics of Chinese classifier-noun agreement, as measured by event-related potentials (ERPs). Constraint strength of classifiers (strong and weak) and cloze probability of the pairing noun (high, low, implausible) was manipulated. Weakly constrained cl...

Most of the previous work on cloze prediction focused on grammar testing such as preposition generation. In this paper we explore a different problem on knowledge testing by designing a system to automatically generate blanks for cloze test. We present a cross-document Information Extraction (IE) driven approach, and compare its performance on two different tasks with and without background doc...