This paper presents the results of the WMT17 Metrics Shared Task. We asked participants of this task to score the outputs of the MT systems involved in the WMT17 news translation task and Neural MT training task. We collected scores of 14 metrics from 8 research groups. In addition to that, we computed scores of 7 standard metrics (BLEU, SentBLEU, NIST, WER, PER, TER and CDER) as baselines. The...

make career decisions during their training be improved? Experience elsewhere suggests that unless such support is developed to meet the specific requirements of doctors and medical students, it is unlikely to achieve all its objectives. This NICEC Briefing summarises the key findings from a research study that set out to find out exactly what these requirements were and how best they might be ...

1 This research was supported by NSF Grants SBR 9730364 and SBR 9730187. Many thanks to Vince Crawford, Drew Fudenberg, David Hsia, John Kagel, and Xin Wang for discussions and help. Helpful comments were also received from seminar participants at Berkeley, Caltech, Harvard, Hong Kong UST, and Wharton. Division of Humanities and Social Sciences, California Institute of Technology, Pasadena, Cal...

As accountability systems have increased demands for evidence of student learning, the use of data in education has become more prevalent in many countries. Although school and administrative leaders are recognizing the need to provide support to teachers on how to interpret and respond to data, there is little theoretically sound research on data-driven decision making (DDDM) to guide their ef...

In response to the Institute of Medicine's To Err Is Human report on the prevalence of medical errors, the Leapfrog Group, an organization that promotes hospital safety and quality, established a voluntary hospital survey assessing compliance with several safety standards. Using data from the period 2002-07, we conducted the first longitudinal assessment of how hospitals in specific cities and ...

Since fall 2009, reference librarians at The George Washington University's Himmelfarb Health Sciences Library have been embedded in online classes through Blackboard within the School of Nursing and School of Medicine and Health Sciences. The authors sought to determine the types of questions asked of the librarian, with the goal of informing future interactions with distance education classes...