The reliability of the PLATO rubric is defined using Generalizability Theory and FACETS. Results from two G-Theory analyses reveal that the reliabilities of scores from individual PLATO items and the total score across all items are most strongly affected by the number of segments in which teachers’ performance is observed. For example, it is reported that a single rater should observe at least...

BACKGROUND The outcomes-based assessment rubric is a novel systematic instrument for documenting improvement in clinical learning. APPROACH This article describes the development of a rubric aimed at introducing specific performance indicators to measure the Accreditation Council for Graduate Medical Education competencies. RESULTS The potential benefits and implications for medical educati...

We describe an automated method to assess the expressiveness of children’s oral reading by measuring how well its prosodic contours correlate in pitch, intensity, pauses, and word reading times with adult narrations of the same sentences. We evaluate the method directly against a common rubric used to assess fluency by hand. We also compare it against manual and automated baselines by its abili...

Çalışmada ders kitaplarındaki metinleri değerlendirmek üzere “PISA Ölçütünde Metinsellik Rubriği”nin (PÖMR) geliştirilmesi amaçlanmıştır. Veriler 2019-2020 eğitim-öğretim yılında okutulan ortaokul (5-8. sınıf) Türkçe kitaplarında serbest okuma metni olarak yer alan ve PISA’nın sürekli metin özelliklerini taşıyan 20 metninin 4 bağımsız puanlayıcı tarafından puanlanmasıyla elde edilmiştir. Analit...

Introduction (organization) The introduction is inviting, states the main topic, and previews the structure of the paper. The introduction clearly states the main topic and previews the structure of the paper, but it is not particularly inviting to the reader. The introduction states the main topic, but does not adequately preview the structure of the paper nor is it particularly inviting to th...