Applying Part-of-Seech Enhanced LSA to Automatic Essay Grading
نویسندگان
چکیده
Latent Semantic Analysis (LSA) is a widely used Information Retrieval method based on " bag-of-words " assumption. However, according to general conception, syntax plays a role in representing meaning of sentences. Thus, enhancing LSA with part-of-speech (POS) information to capture the context of word occurrences appears to be theoretically feasible extension. The approach is tested empirically on a automatic essay grading system using LSA for document similarity comparisons. A comparison on several POS-enhanced LSA models is reported. Our findings show that the addition of contextual information in the form of POS tags can raise the accuracy of the LSA-based scoring models up to 10.77 per cent.
منابع مشابه
Automatic Essay Grading With Probabilistic Latent Semantic Analysis
Probabilistic Latent Semantic Analysis (PLSA) is an information retrieval technique proposed to improve the problems found in Latent Semantic Analysis (LSA). We have applied both LSA and PLSA in our system for grading essays written in Finnish, called Automatic Essay Assessor (AEA). We report the results comparing PLSA and LSA with three essay sets from various subjects. The methods were found ...
متن کاملComparison of Dimension Reduction Methods for Automated Essay Grading
Automatic Essay Assessor (AEA) is a system that utilizes information retrieval techniques such as Latent Semantic Analysis (LSA), Probabilistic Latent Semantic Analysis (PLSA), and Latent Dirichlet Allocation (LDA) for automatic essay grading. The system uses learning materials and relatively few teacher-graded essays for calibrating the scoring mechanism before grading. We performed a series o...
متن کاملSemi-Automatic Evaluation Features in Computer-assisted Essay Assessment
The role of assessment and evaluation has recently changed in a way which will have fundamental consequences in applying information and communication technologies (ICTs) to analyzing learning outcomes. Rather than helping the teacher only to get her students' final grades from an entirely automated assessment system, the idea is also to support the student to reflect her learning process as ea...
متن کاملOn the Effectiveness of Using Syntactic and Shallow Semantic Tree Kernels for Automatic Assessment of Essays
This paper is concerned with the problem of automatic essay grading, where the task is to grade student written essays given course materials and a set of humangraded essays as training data. Latent Semantic Analysis (LSA) has been used extensively over the years to accomplish this task. However, the major limitation of LSA is that it only retains the frequency of words by disregarding the word...
متن کاملA Hybrid Approach to Content Analysis for Automatic Essay Grading
We present CarmelTC, a novel hybrid text classification approach for automatic essay grading. Our evaluation demonstrates that the hybrid CarmelTC approach outperforms two “bag of words” approaches, namely LSA and a Naive Bayes, as well as a purely symbolic approach.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/cs/0610118 شماره
صفحات -
تاریخ انتشار 2006