We introduce a theory of ranking sets of accomplishments in the presence of objectively incomparable marginal contributions (apples and oranges). Our theory recommends benchmarking, a method under which an individual is deemed more accomplished than another if and only if she has achieved more benchmarks, or important accomplishments. We show that benchmark rules are characterized by four axiom...

In this paper a benchmarking system for watermarking algorithms is described. The proposed benchmarking system can be used to evaluate the performance of watermarking methods used for copyright protection, authentication, fingerprinting, etc. Although the system described in the paper is used for image watermarking, the general framework can be used, by introducing a different set of attacks, f...

Modern SAT solvers are highly dependent on heuristics. Therefore, benchmarking is of prime importance in evaluating the performances of different solvers. However, relevant benchmarking is not necessarily straightforward. We present our experiments using the IBM CNF Benchmark on several SAT solvers. Using the results, we attempt to define guidelines for a relevant benchmarking methodology, usin...

This paper addresses the benchmarking of mobile networks in terms of QoS, facilitating a service quality comparison of one mobile network with another. A framework for mobile network QoS benchmarking is proposed and suitable performance indicators are identified. Recommended QoS performance values are described that offer an industry benchmarking target.

BACKGROUND Benchmarking is one of the methods used in business that is applied to hospitals to improve the management of their operations. International comparison between hospitals can explain performance differences. As there is a trend towards specialization of hospitals, this study examines the benchmarking process and the success factors of benchmarking in international specialized cancer ...

In this article we present the software architecture and implementation of GridBench, an extensible tool for benchmarking and testing grid resources. We give an overview of GridBench services and tools, which support the easy definition, invocation and management of benchmarking experiments. We also show how the tool can be used in the analysis of benchmarking results and how the measurements c...

Properly benchmarking a system is a difficult and intricate task. Unfortunately, even a seemingly innocuous benchmarking mistake can compromise the guarantees provided by a given systems security defense and also put its reproducibility and comparability at risk. This threat is particularly insidious as it is generally not a result of malice and can easily go undetected by both authors and revi...

Digital watermarking is envisaged as a potential technology for copyright protection and manipulation recognition. A key issue in the usage of robust watermarking is the evaluation of robustness and security. StirMark Benchmarking has been taken to set a benchmarking suite for audio watermarking in addition to existing still image evaluation solutions. In particular we give an overview of recen...

Copyright© 2005, Academy of Managed Care Pharmacy. All rights reserved. Author Efforts to provide optimal care while controlling overall costs have led multiple health care disciplines to invest in outcomes evaluation and monitoring. The comparison of outcomes to internal and external measures is known as benchmarking. Benchmarking, a well-known business tool, is a term used to describe ongoing...