Risk-Sensitive Planning with Probabilistic Decision Graphs

نویسندگان

  • Sven Koenig
  • Reid G. Simmons
چکیده

Probabilistic AI planning methods that minimize expected execution cost have a neutral attitude towards risk. We demonstrate how one can transform planning problems for risk-sensitive agents into equivalent ones for risk-neutral agents provided that exponential utility functions are used. The transformed planning problems can then be solved with these existing AI planning methods. To demonstrate our ideas, we use a probabilistic planning framework (\probabilistic decision graphs") that can easily be mapped into Markov decision problems. It allows one to describe probabilistic e ects of actions, actions with di erent costs (resource consumption), and goal states with di erent rewards. We show the use of probabilistic decision graphs for nding optimal plans for risk-sensitive agents in a stochastic blocksworld domain.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Probabilistic Planning with Risk-Sensitive Criterion

Probabilistic planning models and, in particular, Markov Decision Processes (MDPs), Partially Observable Markov Decision Processes (POMDPs) and Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) have been extensively used by AI and Decision Theoretic communities for planning under uncertainty. Typically, the solvers for probabilistic planning models find policies that min...

متن کامل

Cost-Sensitive Reachability Heuristics for Probabilistic Planning

Reachability heuristics have lead to impressive scale-ups in deterministic planning making their application to probabilistic planning a promising research direction. We describe how one such reachability heuristic (based on planning graphs) can be extended to handle a class of cost-sensitive probabilistic planning problems. Specifically, we address the problem of conformant (non-observable) pr...

متن کامل

Risk-Sensitive Planning with One-Switch Utility Functions: Value Iteration

Decision-theoretic planning with nonlinear utility functions is important since decision makers are often risk-sensitive in high-stake planning situations. One-switch utility functions are an important class of nonlinear utility functions that can model decision makers whose decisions change with their wealth level. We study how to maximize the expected utility of a Markov decision problem for ...

متن کامل

HPGP: An Abstraction-Based Framework for Decision-Theoretic Planning

This paper is a report on research towards the development of an abstraction-based framework for decision-theoretic planning. We make use of two planning approaches in the context of probabilistic planning: planning by abstraction and planning graphs. To create abstraction hierarchies our planner uses an adapted version of a hierarchical planner under uncertainty, and to search for plans, we pr...

متن کامل

Probabilistic planning with non-linear utility functions and worst-case guarantees

Markov Decision Processes are one of the most widely used frameworks to formulate probabilistic planning problems. Since planners are often risk-sensitive in high-stake situations, non-linear utility functions are often introduced to describe their preferences among all possible outcomes. Alternatively, risk-sensitive decision makers often require their plans to satisfy certain worst-case guara...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1994