Guessing in Multiple Choice Questions: Challenges and Strategies

Authors

  • Jalili, Mohammad MD, Associate Professor, Department of Medical Education, Department of Emergency Medicine, Tehran University of Medical Sciences, Tehran, Iran. Email: [email protected]
Abstract:

Introduction: Guessing is one of the most challenging issues in multiple choice questions. Several strategies, such as negative scoring, have been suggested for preventing students from choosing the right answer just by chance. However, there is no general agreement on using such strategies. The aim of this study was to review the scoring methods which are used for reducing guessing, and evaluate their strengths and weaknesses. Methods: This review study was performed by manual searching (library resources) as well as electronic searching of online databases, such as PubMed, EBSCO, Elsevier, ERIC, and Google Scholar. The key words were guessing, negative scoring, and confidence assessment model and Multiple Choice Questions. All the relevant available articles were retrieved and reviewed. Results: Out of 60 articles found, a number of 43 were selected including, 29 original articles, 11 review articles and 3 letters. Different strategies and scoring methods for preventing guessing were elicited including avoiding erroneous test items, increasing cognitive levels and question taxonomy, increasing the number of choices per question, negative scoring, using "I do not know" option, Reliability Assessment Model, delete option and free choice. Subsequently, the impact of these strategies on students’ scores and the tests’ psychometric properties were discussed. Conclusion: It was concluded that there was no consensus over the utilization and effectiveness of these strategies. Furthermore, these strategies were found to be ineffective in correcting the guessing effect impact on the reliability and validity of tests, as their main function is merely discouraging test takers to guess. Hence, it is suggested that the type of the exam in terms of being formative/summative and norm/criterion-referenced assessment be considered. Also it is necessary to inform students about the specific scoring method used and its consequences before the exam.

Upgrade to premium to download articles

Sign up to access the full text

Already have an account?login

similar resources

The impact of 3-option responses to multiple-choice questions on guessing strategies and cut score determinations

Introduction: Research has asserted MCQ items using threeresponse options (one correct answer with two distractors) iscomparable to, and possibly preferable over, traditional MCQitem formats consisting of four response options (e.g., one correctanswer with three distractors), or five response options (e.g., onecorrect answer with four distractors). Some medical educatorshave also adopted the pr...

full text

the impact of 3-option responses to multiple-choice questions on guessing strategies and cut score determinations

introduction: research has asserted mcq items using three response options (one correct answer with two distractors) is comparable to, and possibly preferable over, traditional mcq item formats consisting of four response options (e.g., one correct answer with three distractors), or five response options (e.g., one correct answer with four distractors). some medical educators have also adopted ...

full text

The Impact of 3-Option Responses to Multiple-Choice Questions on Guessing Strategies and Cut Score Determinations

INTRODUCTION Research has asserted MCQ items using three response options (one correct answer with two distractors) is comparable to, and possibly preferable over, traditional MCQ item formats consisting of four response options (e.g., one correct answer with three distractors), or five response options (e.g., one correct answer with four distractors). Some medical educators have also adopted t...

full text

The Effect of Two Assessment Methods on Exam Preparation and Study Strategies: Multiple Choice and Essay Questions

Introduction: Utilizing appropriate approaches to study and learning can improve students’ academic performance. Recent studies have shown that students’ learning approaches are influenced by several factors including the type of assessment. The aim of this study is to assess the effect of multiple-choice tests (MCQ) and essay tests on the nursing students’ learning approaches. Methods: This q...

full text

A Survey on Distractors in Multiple-choice Questions and its Relationship on Difficulty and Discriminative Indices

Introduction: The distractors have a very important role in Multiple-Choice Question (MCQ) and it can influence the quality of the tests. This study aimed to investigate frequency of functioning and non-functioning distractors and the relationship between the distractors options with difficulty and discrimination in Ahvaz Jundishapur University of Medical sciences in 2017. Methods: In this desc...

full text

Correcting for guessing on multiple-choice exams.

simulation method (bootstrapping) was used by the authors to estimate the parameters for the statistical test of this hypothesis. Parameters (unspecified) of the bootstrap model are critical because of lack of independence among the four examinations (across the same students) and lack of independence among the corrected and uncorrected multiple-choice tests (across the same criterion variable)...

full text

My Resources

Save resource for easier access later

Save to my library Already added to my library

{@ msg_add @}


Journal title

volume 14  issue 7

pages  594- 604

publication date 2014-10

By following a journal you will be notified via email when a new issue of this journal is published.

Keywords

No Keywords

Hosted on Doprax cloud platform doprax.com

copyright © 2015-2023