Constrained Markov decision processes (MDPs) are MDPs optimizing an objective function while satisfying additional constraints. We study a class of infinite-horizon constrained MDPs with nonstationary problem data, finite state space, and discounted cost criterion. This problem can equivalently be formulated as a countably infinite linear program (CILP), i.e., a linear program (LP) with a count...

Constrained multidimensional patterns differ from the well-known frequent patterns from a conceptual and logical points of view because they are provided with a common structure and support various types of constraints. Classical data mining techniques are based on the power set lattice of binary attributes and, even extended, are not suitable when addressing the discovery of constrained multid...

We consider the problem of generating optimal stochastic policies for Constrained Stochastic Shortest Path problems, which are a natural model for planning under uncertainty for resourcebounded agents with multiple competing objectives. While unconstrained SSPs enjoy a multitude of efficient heuristic search solution methods with the ability to focus on promising areas reachable from the initia...

Modern geometric approaches to analytical mechanics rest on a bundle structure of the configuration space. The connection this allows for an intrinsic splitting reduced Euler-Lagrange equations. Hamel's equations, other hand, provide universal approach non-holonomic in local coordinates. link between formulation and coordinates has not been discussed sufficiently. equations as well curvature co...

PURPOSE Acceleration of magnetic resonance (MR) thermometry is desirable for several applications of MR-guided focused ultrasound, such as those requiring greater volume coverage, higher spatial resolution, or higher frame rates. METHODS We propose and validate a constrained reconstruction method that estimates focal temperature changes directly from k-space without spatial or temporal regula...

The frequency-domain constrained broadband space-time beamformer has been widely used in many fields because of its excellent performance and no need for pre-steering delay. However, the beam response depends heavily on phase center location array. wrong array will lead to undesirable wide main lobe high side lobe. To choose correctly, this paper makes an in-depth theoretical discussion depende...