Risk-Sensitive Planning with Probabilistic Decision Graphs
نویسندگان
چکیده
Probabilistic AI planning methods that minimize expected execution cost have a neutral attitude towards risk. We demonstrate how one can transform planning problems for risk-sensitive agents into equivalent ones for risk-neutral agents provided that exponential utility functions are used. The transformed planning problems can then be solved with these existing AI planning methods. To demonstrate our ideas, we use a probabilistic planning framework (\probabilistic decision graphs") that can easily be mapped into Markov decision problems. It allows one to describe probabilistic e ects of actions, actions with di erent costs (resource consumption), and goal states with di erent rewards. We show the use of probabilistic decision graphs for nding optimal plans for risk-sensitive agents in a stochastic blocksworld domain.
منابع مشابه
Probabilistic Planning with Risk-Sensitive Criterion
Probabilistic planning models and, in particular, Markov Decision Processes (MDPs), Partially Observable Markov Decision Processes (POMDPs) and Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) have been extensively used by AI and Decision Theoretic communities for planning under uncertainty. Typically, the solvers for probabilistic planning models find policies that min...
متن کاملCost-Sensitive Reachability Heuristics for Probabilistic Planning
Reachability heuristics have lead to impressive scale-ups in deterministic planning making their application to probabilistic planning a promising research direction. We describe how one such reachability heuristic (based on planning graphs) can be extended to handle a class of cost-sensitive probabilistic planning problems. Specifically, we address the problem of conformant (non-observable) pr...
متن کاملRisk-Sensitive Planning with One-Switch Utility Functions: Value Iteration
Decision-theoretic planning with nonlinear utility functions is important since decision makers are often risk-sensitive in high-stake planning situations. One-switch utility functions are an important class of nonlinear utility functions that can model decision makers whose decisions change with their wealth level. We study how to maximize the expected utility of a Markov decision problem for ...
متن کاملHPGP: An Abstraction-Based Framework for Decision-Theoretic Planning
This paper is a report on research towards the development of an abstraction-based framework for decision-theoretic planning. We make use of two planning approaches in the context of probabilistic planning: planning by abstraction and planning graphs. To create abstraction hierarchies our planner uses an adapted version of a hierarchical planner under uncertainty, and to search for plans, we pr...
متن کاملProbabilistic planning with non-linear utility functions and worst-case guarantees
Markov Decision Processes are one of the most widely used frameworks to formulate probabilistic planning problems. Since planners are often risk-sensitive in high-stake situations, non-linear utility functions are often introduced to describe their preferences among all possible outcomes. Alternatively, risk-sensitive decision makers often require their plans to satisfy certain worst-case guara...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1994