Research in natural language processing (NLP) has both scientific and technological dimensions. In both cases, it is necessary to evaluate the implemented systems in order to assess the success of a study. This article, grounded in the ISO framework for software evaluation, introduces a typology of NLP systems based on the role of language as input or output data, in order to analyze the centra...

Sociology, computer networking and operations research provide evidence of the importance of fairness in queuing disciplines. Currently, there is no accepted model for characterizing fairness in parallel job scheduling. We introduce two fairness metrics intended for parallel job schedulers, both of which are based on models from sociology, networking, and operations research. The first metric i...

Software metrics are acknowledged by both software engineering researchers and educators as being of great importance in improving the software development process. Unfortunately, the current practice in industry is to largely ignore metrics and work at an instinctive level [1]. The best way of improving industry practice seems to be to indoctrinate current software engineering students into ac...

We investigate the notion of distance on domains. In particular, we show that measurement is a fundamental concept underlying partial metrics by proving that a domain in its Scott topology is partially metrizable only if it admits a measurement. Conversely, the natural notion of a distance associated with a measurement not only yields meaningful partial metrics on domains of essential importanc...

User-perceived software quality is subjective, and thus difficult to be measured. Its importance however in user-centric, web-based systems such as ecommerce systems is huge. How can one measure the subjective? Metrics are one of the most powerful weapons in the arsenal for measuring quality. For such a weapon to be put in good use, guidelines for use should be available. In this paper we prese...

Within NASA, there is an increasing awareness that software is of growing importance to the success of missions. Much data has been collected, and many theories have been advanced on how to reduce or eliminate errors in code. However, learning requires experience. This article documents a new NASA initiative to build a centralized repository of software defect data; in particular, it documents ...

The research on open source software has attracted a great deal of attention during the past decades for its wide applications in both academia and industry. Among the research topics related to open source software, the usefulness of software network metrics for fault prediction has been received much attention recently. In order to verify the importance of software network metrics in the perf...