Measuring the similarity between words, sentences, paragraphs and documents is an important component in various tasks such as information retrieval, document clustering, word-sense disambiguation, automatic essay scoring, short answer grading, machine translation and text summarization. This survey discusses the existing works on text similarity through partitioning them into three approaches;...

Our aim is to investigate computational linguistics (CL) techniques in marking short free text responses automatically. Successful automatic marking of free text answers would seem to presuppose an advanced level of performance in automated natural language understanding. However, recent advances in CL techniques have opened up the possibility of being able to automate the marking of free text ...

Abstract Digital testing, such as multiple-choice questions and final answer items, offers many advantages in higher educational assessment practices. Well-designed digital grading is more reliable faster than hand scalable to larger classes. The validity of open criticism, particularly mathematics where much based on processes reasoning not the achieved. At a technical university Netherlands, ...

Abstract The ’short answer’ question format is a widely used tool in educational assessment, which students write one to three sentences response an open question. answers are subsequently rated by expert graders. agreement between these graders crucial for reliable analysis, both terms of strategies and developing automatic models short answer grading (SAG), active research topic NLP. This mak...

This paper is concerned with the task of automatically assessing the written proficiency level of non-native (L2) learners of English. Drawing on previous research on automated L2 writing assessment following the Common European Framework of Reference for Languages (CEFR), we investigate the possibilities and difficulties of deriving the CEFR level from short answers to open-ended questions, wh...

Short answer scoring (SAS) is the task of grading short text written by a learner. In recent years, deep-learning-based approaches have substantially improved performance SAS models, but how to guarantee high-quality predictions still remains critical issue when applying such models education field. Towards guaranteeing predictions, we present first study exploring use human-in-the-loop framewo...