BACKGROUND Single Best Answer (SBA) questions are widely used in undergraduate and postgraduate medical examinations. Selection of the correct answer in SBA questions may be subject to cueing and therefore might not test the student's knowledge. In contrast to this artificial construct, doctors are ultimately required to perform in a real-life setting that does not offer a list of choices. This...

Markit is an Automated Essay Grading (AEG) system capable of running on typical desktop PC platforms. Its performance compares favourably with human graders and with commercially available systems. A distinct advantage of Markit over existing commercial systems is that it requires only one model answer against which the student essays are compared. In this paper we report on a trial of Markit w...

In this paper, we report on early research to visualize and summarize student responses to short answer questions. Recently published, graph-based multi-sentence compression algorithms have been successfully applied to summarize opinions – a domain area with many similarities to short answer responses. Initial investigations reveal that visual analytics for short answer questions can be derived...

This work describes the first steps towards automatic response analysis. To explain these steps, we describe two systems from the educational domain: on the one hand, a system that uses hierarchical structures to grade answers; and, on the other hand, a system capable of comparing answer segments in order to try to explain the grading. In addition, we analyze an international educational domain...

Please answer to the point, and do not spend time/space giving irrelevant details. Please state any additional assumptions you make while answering the questions. For Questions 1 to 5, 6(b) and 6(c), you need to submit your answers in a single PDF file on autolab, either a scanned handwritten version or a LTEXpdf file. Please make sure you write legibly for grading. For Question 6(a), submit yo...

We present an extrinsic evaluation of a clustering-based approach to computer-assisted scoring of short constructed response items, as encountered in educational assessment. Due to their open-ended nature, constructed response items need to be graded by human readers, which makes the overall testing process costly and time-consuming. In this paper we investigate the prospects for streamlining t...

PURPOSE Disease staging involves the assessment of disease severity or progression and is used for treatment selection. In diabetic retinopathy, disease staging using a wide area is more desirable than that using a limited area. We investigated if deep learning artificial intelligence (AI) could be used to grade diabetic retinopathy and determine treatment and prognosis. METHODS The retrospec...

Automated Essay Scoring (AES) systems involve using a specially designed computing program to mark students’ essays. It is form of online assessment supported by natural language processing (NLP). These seek exploit advanced technologies reduce the time and effort spent on exam scoring process. have been applied in several languages, including Arabic. Nevertheless, applicable NLP techniques Ara...