We describe a method to semi-automatically generate incorrect choices, or distractors, for cloze (fill-in-the-blank) questions. We generated distractors aimed at revealing what type of misunderstanding a student was having. English as a Second Language learners answered a series of cloze questions that presented distractors generated by our method. We analyzed their answers in order to see how ...

This paper describes an ensemble system submitted as part of the LSDSem Shared Task 2017 the Story Cloze Test. The main conclusion from our results is that an approach based on semantic similarity alone may not be enough for this task. We test various approaches and compare them with two ensemble systems. One is based on voting and the other on logistic regression based classifier. Our final sy...

We use vector space models (VSMs) as explicit models of word relations that influence the N400, and use this connection to predict N400 amplitude in an ERP study by Federmeier and Kutas (1999). We find that the VSM-based model is able to capture key elements of the authors’ manipulations and results, accounting for aspects of the results that are unexplained by cloze probability. This demonstra...

Participants read sentences presented one word at a time, half of which ended with a semantically incongruent ending. 1.5T functional magnetic resonance imaging data were collected from 11 participants, showing that the left posterior inferior temporal region, which has previously been termed the Language Formulation Area (LFA), responded to cloze probability. It is suggested, based on anatomic...

The notion of expectancy grammar as a key to understanding the nature of psychologically real processes that underlie language use is introduced by Oller (1979). A central issue in this notion is that expectancy generating systems are constructed and modified in the course of language acquisition. Thus, one of the characteristics of language proficiency is that it consists of such an expectancy...

Aim To determine whether single-word speechreading is sensitive to prior phrase context. Background We used a well-established Event Related Potential (ERP) paradigm to elicit the N400, a negative wave around 400 ms. The N400 reflects activation by lexical semantic features and is modulated by contextual integration. Methods Seventeen adult native English speakers participated. They were shown ...

More innovative test methods may measure language learners’ test performance more accurately, contributing to much fairer decisions. This study examined Iranian language learners’ performance on cloze-elide test as an innovative, integrative test method. It specifically focused on investigating whether personality types correlated with their performance and whether personality types could predi...

Abstract Theoretical accounts of the N400 are divided as to whether amplitude response a stimulus reflects extent which was predicted, is semantically similar its preceding context, or both. We use state-of-the-art machine learning tools investigate these three best supported by evidence. GPT-3, neural language model trained compute conditional probability any word based on words that precede i...