Heuristics for Inductive Learning
نویسنده
چکیده
A number of heuristics have been developed which greatly reduce the search space a learning program must consider in its attempt to construct hypotheses about why a failure occurred. These heuristics have been implemented in the HANDICAPPER system [Salzberg 1983, Atkinson & Salzberg 1984], in which they significantly improved predictive ability while demonstrating a remarkable learning curve The rationalization process has been developed as a verification system for the hypotheses suggested by the heuristics. Rationalization uses the causal knowledge of the system to ascertain whether or not a hypothesis is reasonable. If the hypothesis is not supported by causal knowledge, it is discarded and another hypothesis must be generated by the heuristics. The resulting learning system, by integrating causal knowledge w i th heuristic search, has quickly gone from essentially random predictive accuracy to a system which consistently outperforms the experts at predicting events in its problem
منابع مشابه
The role of feature construction in inductive rule learning
This paper proposes a unifying framework for inductive rule learning algorithms. We suggest that the problem of constructing an appropriate inductive hypothesis (set of rules) can be broken down in the following subtasks: rule construction, body construction, and feature construction. Each of these subtasks may have its own declarative bias, search strategies, and heuristics. In particular, we ...
متن کاملProof Tree Kernels: a Candidate Ingredient for Intelligent Optimization
Reactive search techniques typically rely on the search history in order to adapt heuristics to the local conformation of the search space. By viewing search history as the trace of the optimization program, we aim to apply strategies for learning from example-traces, as developed in the fields of machine learning and inductive logic programming. We believe that Proof Tree Kernels, which we rec...
متن کاملAn Empirical Comparison of Hill-Climbing and Exhaustive Search in Inductive Rule Learning An Empirical Comparison of Hill-Climbing and Exhaustive Search in Inductive Rule Learning
Most commonly used inductive rule learning algorithms employ a hill-climbing search, whereas local pattern discovery algorithms employ exhaustive search. In this paper, we evaluate the spectrum of different search strategies to see whether separate-and-conquer rule learning algorithms are able to gain performance in terms of predictive accuracy or theory size by using more powerful search strat...
متن کاملExperimenting with Machine Learning in Automatic Theorem Proving
First the notion of the heuristic and its importance for automatic theorem proving is explained. The question of how to construct a useful system of heuristics and notions is posed, and it is argued for the importance of learning. A simple example of learning a lemma is shown using the Inductive Logic Programming system Progol. Second a general framework for learning heuristics is discussed and...
متن کاملIntegrating EBL and ILP to Acquire Control Rules for Planning*
Most approaches to learning control information in pla~nlng systems use explanation-based learning to generate control rules. Unfortunately, EBL alone often produces overly complex rules that actually decrease planning efficiency. This paper presents a novel learning approach for control knowledge acquisition that integrates explanation-based learning with techniques from inductive logic progra...
متن کاملMultiple-Instance Learning Based Heuristics for Mining Chemical Compound Structure
Inductive Logic Programming (ILP) is a combination of inductive learning and first-order logic aiming to learn first-order hypotheses from training examples. ILP has a serious bottleneck in an intractably enormous hypothesis search space. This makes existing approaches perform poorly on large-scale real-world datasets. In this research, we propose a technique to make the system handle an enormo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1985