On Some Optimal Stopping Problems with Constraint

نویسندگان

  • José-Luis Menaldi
  • M. Robin
چکیده

We consider the optimal stopping problem of a Markov process {xt : t ≥ 0} when the controller is allowed to stop only at the arrival times of a signal, that is, at a sequence of instants {τn : n ≥ 1} independent of {xt : t ≥ 0}. We solve in detail this problem for general Markov– Feller processes with compact state space when the interarrival times of the signal are independent identically distributed random variables. In addition, we discuss several extensions to other signals and to other cases of state spaces. These results generalize the works of several authors where {xt : t ≥ 0} was a diffusion process and where the signal arrives at the jump times of a Poisson process.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On Some Impulse Control Problems with Constraint

The impulse control of a Markov–Feller process is considered when the impulses are allowed only when a signal arrives. This is referred to as an impulse control problem with constraint. A detailed setting is described, a characterization of the optimal cost is obtained using previous results of the authors on optimal stopping problems with constraint, and an optimal impulse control is identified.

متن کامل

On approximative solutions of optimal stopping problems

In this paper some extensions are given of the method to approximate optimal discrete time stopping problems by related limiting stopping problems for Poisson type processes. In particular we establish detailed results for the solutions of the differential equations characterizing the optimal stopping curves in the limiting stopping problem. These allow to determine explicit approximative optim...

متن کامل

A Hierarchical Cognitive Threshold Model of Human Decision Making on Different Length Optimal Stopping Problems

In optimal stopping problems, people are asked to choose the maximum out of a sequence of values, under the constraint that a number can only be chosen when it is presented. We present a series of threshold models of human decision making on optimal stopping problems, including a new hierarchical model that assumes individual differences in threshold setting are controlled by deviations or bias...

متن کامل

A Note on Optimal Stopping in Models with Delay

It is known that optimal stopping problems form an important class of optimal control problems having applications in stochastic calculus (maximal inequalities), statistics (sequential analysis) and mathematical finance (American options). The results about the relationship between optimal stopping problems for Markov processes and free-boundary problems for partial differential equations often...

متن کامل

VARIATIONAL DISCRETIZATION AND MIXED METHODS FOR SEMILINEAR PARABOLIC OPTIMAL CONTROL PROBLEMS WITH INTEGRAL CONSTRAINT

The aim of this work is to investigate the variational discretization and mixed finite element methods for optimal control problem governed by semi linear parabolic equations with integral constraint. The state and co-state are approximated by the lowest order Raviart-Thomas mixed finite element spaces and the control is not discreted. Optimal error estimates in L2 are established for the state...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • SIAM J. Control and Optimization

دوره 54  شماره 

صفحات  -

تاریخ انتشار 2016