Benchmarking Evolutionary Algorithms: Towards Exploratory Landscape Analysis
نویسندگان
چکیده
We present methods to answer to basic questions that arise when benchmarking optimization algorithms. The first one is: which algorithm is the ‘best’ one? and the second one: which algorithm should I use for my real world problem? Both are connected and neither is easy to answer. We present methods which can be used to analyse the raw data of a benchmark experiment and derive some insight regarding the answers to these questions. We employ the presented methods to analyse the BBOB’09 benchmark results and present some initial findings.
منابع مشابه
Towards unbiased benchmarking of evolutionary and hybrid algorithms for real-valued optimisation
The success of evolutionary algorithms and their hybrids on many difficult real-valued optimisation problems has led to an explosion in the number of algorithms and variants proposed. In order for the field to advance it is necessary to carry out effective camparative evaluations of these algorithms, and thereby better identify and understand those properties that optimise performance. This pap...
متن کاملBenchmarking Evolutionary Algorithms: The Huygens Suite
The success (and, importantly, potential success) of randomised population-based algorithms and their hybrids on ever more difficult optimisation problems has led to an explosion in the number of algorithms and variants proposed. It is difficult to definitively compare the range of algorithms proposed, and therefore to advance the field. In this paper we discuss the difficulties of providing wi...
متن کاملTowards improved benchmarking of black-box optimization algorithms using clustering problems
The field of Metaheuristics has produced a large number of algorithms for continuous, black-box optimization. In contrast, there are few standard benchmark problem sets, limiting our ability to gain insight into the empirical performance of these algorithms. Clustering problems have been used many times in the literature to evaluate optimization algorithms. However, much of this work has occurr...
متن کاملNovel Hybrid Fuzzy-Evolutionary Algorithms for Optimization of a Fuzzy Expert System Applied to Dust Phenomenon Forecasting Problem
Nowadays, dust phenomenon is one of the important challenges in warm and dry areas. Forecasting the phenomenon before its occurrence helps to take precautionary steps to prevent its consequences. Fuzzy expert systems capabilities have been taken into account to assist and cope with the uncertainty associated to complex environments such as dust forecasting problem. This paper presents novel hyb...
متن کاملNovel Hybrid Fuzzy-Evolutionary Algorithms for Optimization of a Fuzzy Expert System Applied to Dust Phenomenon Forecasting Problem
Nowadays, dust phenomenon is one of the important challenges in warm and dry areas. Forecasting the phenomenon before its occurrence helps to take precautionary steps to prevent its consequences. Fuzzy expert systems capabilities have been taken into account to assist and cope with the uncertainty associated to complex environments such as dust forecasting problem. This paper presents novel hyb...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010