Computing Hierarchical Finite State Controllers With Classical Planning
نویسندگان
چکیده
منابع مشابه
Hierarchical Finite State Controllers for Generalized Planning
Finite State Controllers (FSCs) are an effective way to represent sequential plans compactly. By imposing appropriate conditions on transitions, FSCs can also represent generalized plans that solve a range of planning problems from a given domain. In this paper we introduce the concept of hierarchical FSCs for planning by allowing controllers to call other controllers. We show that hierarchical...
متن کاملSynthesis of Hierarchical Finite-State Controllers for POMDPs
We develop a hierarchical approach to planning for partially observable Markov decision processes (POMDPs) in which a policy is represented as a hierarchical finite-state controller. To provide a foundation for this approach, we discuss some extensions of the POMDP framework that allow us to formalize the process of abstraction by which a hierarchical controller is constructed. Then we describe...
متن کاملBounded Finite State Controllers
We describe a new approximation algorithm for solving partially observable MDPs. Our bounded policy iteration approach searches through the space of bounded-size, stochastic finite state controllers, combining several advantages of gradient ascent (efficiency, search through restricted controller space) and policy iteration (less vulnerability to local optima).
متن کاملFrom Classical to State-Feedback-Based Controllers
A utomatic control teaching can be fragmented, comprising different streams that seem to be disconnec t ed or even competing. The appeal of new theories and concepts may encourage students to forget that the key issue in the discipline is the control design problem. If two or more different approaches provide a good solution to that problem, then a strong connection should exist between them. I...
متن کاملLearning Finite State Controllers from Simulation
We propose a methodology to automatically generate agent controllers, represented as state machines, to act in partially observable environments. We define a multi-step process, in which increasingly accurate models generally too complex to be used for planning are employed to generate possible traces of execution by simulation. Those traces are then utilized to induce a state machine, that rep...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Artificial Intelligence Research
سال: 2018
ISSN: 1076-9757
DOI: 10.1613/jair.1.11227