In this paper, we report on a post-editing study for general text types from English into Dutch conducted with master's students of translation. We used a fine-grained machine translation (MT) quality assessment method with error weights that correspond to severity levels and are related to cognitive load. Linear mixed effects models are applied to analyze the impact of MT quality on potential ...

OBJECTIVE To explore the evidence translation process during a 1-week national guideline development workshop ("Child Health Evidence Week") in Kenya. STUDY DESIGN AND SETTING Nonparticipant observational study of the discussions of a multidisciplinary guideline development panel in Kenya. Discussions were aided by GRADE (Grading of Recommendations Assessment, Development, and Evaluation) gri...

Monolingual evaluation of Machine Translation (MT) aims to simplify human assessment by requiring assessors to compare the meaning of the MT output with a reference translation, opening up the task to a much larger pool of genuinely qualified evaluators. Monolingual evaluation runs the risk, however, of bias in favour of MT systems that happen to produce translations superficially similar to th...

Evaluation of machine translation (MT) is a difficult task, both for humans, and using automatic metrics. The main difficulty lies in the fact that there is not one single correct translation, but many alternative good translation options. MT systems are often evaluated using automatic metrics, which commonly rely on comparing a translation to only a single human reference translation. An alter...

One of the key requirements for demonstrating the validity and reliability of an assessment method is that annotators be able to apply it consistently. Automatic measures such as BLEU traditionally used to assess the quality of machine translation gain reliability by using human-generated reference translations under the assumption that mechanical similar to references is a valid measure of tra...

Crowd-sourced assessments of machine translation quality allow evaluations to be carried out cheaply and on a large scale. It is essential, however, that the crowd’s work be filtered to avoid contamination of results through the inclusion of false assessments. One method is to filter via agreement with experts, but even amongst experts agreement levels may not be high. In this paper, we present...

abstract background: inflammatory bowel disease (ibd) is a group of inflammatory conditions of the colon and small intestine that may have critical consequences on patient’s quality of life (qol). many disease-specific qol tools have been developed recently. the mcmaster inflammatory bowel disease questionnaire (ibdq) is one of them. the aim of this study was to translate into persian and evalu...