We present a strategy to improve the quality of automatically generated cloze and open cloze questions which are used by the REAP tutoring system for assessment in the ill-defined domain of English as a Second Language vocabulary learning. Cloze and open cloze questions are fill-in-the-blank questions with and without multiple choice, respectively. The REAP intelligent tutoring system [1] uses ...

Computer generation of cloze tasks still falls short of full automation; most current systems are used by teachers as authoring aids. Improved methods to estimate cloze quality are needed for full automation. We investigated lexical reading difficulty as a novel automatic estimator of cloze quality, to which cooccurrence frequency of words was compared as an alternate estimator. Rather than rel...

We present evidence for a monitoring process in language perception at the word level, reflected by a P600. This P600 is triggered when a conflict evolves because the brain encounters an unexpected linguistic item when another item is highly expected. To resolve this conflict between representations, the brain monitors the input to check for possible processing errors. A P600 was hypothesized t...

reading comprehension ability consists of multiple cognitive processes, and cloze tests have long been claimed to measure this ability as a whole. however, since the introduction of cloze test, different varieties of it have been proposed by the testers. thus, the present study was an attempt to examine the relatedness of cloze-elide test, multiple-choice (mc) cloze test, and c-test as three di...

The narrative cloze is an evaluation metric commonly used for work on automatic script induction. While prior work in this area has focused on count-based methods from distributional semantics, such as pointwise mutual information, we argue that the narrative cloze can be productively reframed as a language modeling task. By training a discriminative language model for this task, we attain impr...

It has been suggested that the right hemisphere (RH) has a privileged role in the processing of figurative language, including metaphors, idioms, and verbal humor. Previous experiments using hemifield visual presentation combined with human electrophysiology support the idea that the RH plays a special role in joke comprehension. The current study examines metaphoric language. Event-related pot...

Although the pseudo-random cloze procedure has been in use for some twenty-five years as a measure of readability and reading comprehension, little research has been carried out into the effect ofdeleting words from text more or less frequently. This paper reports on an experiment in which the deletion frequency variable was systematically studied. Every 6th, 8th, I 0th and I 2th word was remov...

Cloze tests have been widely used for measuring reading comprehension, readability and language proficiency. There is still much controversy on what it really is that cloze measures. The result of much correlational research is contradictory and very unsatisfactory. Thus, with a qualitative orientation, this study attempts to look at the judgmental validity of cloze as a test of reading compreh...

Fill-in-the-blank questions, or cloze items, are commonly used in language learning applications. The benefits of personalized items, tailored to the user’s interest and proficiency, have motivated research on automatic generation of cloze items. This paper is concerned with generating cloze items for prepositions, whose usage often poses problems for non-native speakers of English. The quality...