Quantifying the Inductive Bias in Concept Learning (Extended Abstract)

نویسنده

  • David Haussler
چکیده

We show that the notion of bias in inductive concept learning can be quantified in a way that directly relates to learning performance, and that this quantitative theory of bias can provide guidance in the design of effective learning algorithms. We apply this idea by measuring some common language biases, including restriction to conjunctive concepts and conjunctive concepts with internal disjunction, and, P uided by these measurements, develop learning algorithms or these classes of concepts that have provably good convergence properties.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The Inductive Bias in Concept Learning (extended Abstract)

We show that the notion of bias in inductive concept learning can be quantified in a way that directly relates to learning performance, and that this quantitative theory of bias can provide guidance in the design of effective learning algorithms. We apply this idea by measuring some common language biases, including restriction to conjunctive concepts and conjunctive concepts with internal disj...

متن کامل

The 2005 AAAI Classic Paper Awards

approximately correct learning). At the same time, his paper and his subsequent research applied that theoretical framework to analyze the properties of specific machine learning algorithms. At the time of Haussler’s paper, one informal notion popular in machine learning was the “inductive bias” of a learner; that is, the set of assumptions that, together with the training data, logically entai...

متن کامل

Quantifying Inductive Bias: AI Learning Algorithms and Valiant's Learning Framework

We show that the notion of inductive bias in concept learning can be quantified in a way that directl_v relates to learning performance in the framework recently introduced by Valiant. Our measure of bias is based on the growth function introduced by Vapnik and Chervonenkis, and on the Vapnik-Chervonenkis dimension. We measure some common language biases, including restriction to conjunctive co...

متن کامل

Adjusting Bias in Concept Learning

We approach concept learning as a heuristic search through a space of concepts for a concept that satisfies the learning task at hand The heuristics represent bias that the concept learning program employs when forming an inductive generalization. We present a model of bias adjustment and report our experience with an implementation of the model. A major objective in research on inductive conce...

متن کامل

Quantifying the Value of Constructive Induction, Knowledge, and Noise Filtering on Inductive Learning

Quantifying the Value of Constructive Induction, Knowledge, and Noise Filtering on Inductive Learning Abstract Learning research, as one of its central goals, tries to measure, model, and understand how learning-problem properties effect average-case learning performance. For example, we would like to quantify the value of constructive construction, noise filtering, and background knowledge. Th...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1986