بررسی تاثیر کارگاه آموزش طراحی سوال بر کیفیت آزمون های کتبی دانشکده دندانپزشکی شهیدبهشتی

Background: Evaluation is a systematic process of gathering, analysing and interpretation of data for assessment and judgement.This study was aimed to evaluate the efficacy of a workshop regarding exam development on quality of final written exams. Methods: In this semi-experimental study, written final exams of all theoretical courses# 2 were gathered before and after presenting a workshop and a booklet regarding “Standard rules of questions”. Taxonomy, content relevance, and content coverage of exams were analyzed by three lecturers of course# 2 of each department. Other indices such as difficulty and differential coefficients, value of distracter and borderline choices, error coefficient, and considering structural rules were calculated by means of Millman’s checklist, and standard formulae. Independent Samples t. Test, Mann-Whitney U Test, and ANOVA were used to analyze the data. Findings: Before intervention, content relevance and difficulty coefficient were in acceptable levels. Proportion of multiple choice questions, content relevance, and differential coefficient increased after intervention, whereas consideration of structural rules, difficulty coefficient, amount of distracters needing revision, error coefficient, amount of questions needing revision, and coverage relevance decreased. Generally, the intervention just decreased the error coefficient practically. Conclusion: A short- term course on standard rules of question development does not affect quality of exam questions considerably, and continuous education is mandatory in this regard.