Title of dissertation: AN INVESTIGATION OF THE RELATIONSHIP BETWEEN AUTOMATED MACHINE TRANSLATION EVALUATION METRICS AND USER PERFORMANCE ON AN INFORMATION EXTRACTION TASK Calandra Rilette Tate, Doctor of Philosophy, 2007 Dissertation directed by: Professor Eric V. Slud Department of Mathematics & co-directed by: Professor Bonnie J. Dorr Department of Computer Science This dissertation applies ...

Abstract Recently proposed BERT-based evaluation metrics for text generation perform well on standard benchmarks but are vulnerable to adversarial attacks, e.g., relating information correctness. We argue that this stems (in part) from the fact they models of semantic similarity. In contrast, we develop based Natural Language Inference (NLI), which deem a more appropriate modeling. design prefe...

AbstractMany important tasks such as forensic signature verification, calligraphy synthesis, etc., rely on handwriting trajectory recovery of which, however, even an appropriate evaluation metric is still missing. Indeed, existing metrics only focus the writing orders but overlook fidelity glyphs. Taking both facets into account, we come up with two new metrics, adaptive intersection union (AIo...

As the outsourcing industry matures, there is a growing recognition that a more holistic evaluation of outsourcing performance is required. The parameters and the criteria for evaluation would change in a long-term strategic oriented outsourcing partnership. This paper attempts to examine how performance measures used by customers change during a long-term partnership. It is an exploratory stud...

Focusing on software productivity and software quality control has spurred the research on software metrics technology. The increasing importance being placed on object-oriented software development has led to the research on the object-oriented software metrics and the development of automated tools to support object-oriented metrics. To effectively aid the software evaluation, a software metr...