In this paper, we consider the problem of optimizing the quantiles of the cumulative rewards of Markov Decision Processes (MDP), to which we refers as Quantile Markov Decision Processes (QMDP). Traditionally, the goal of a Markov Decision Process (MDP) is to maximize expected cumulative reward over a defined horizon (possibly to be infinite). In many applications, however, a decision maker may ...

A 3D stochastic Navier-Stokes equation with a suitable non degenerate additive noise is considered. The regularity in the initial conditions of every Markov transition kernel associated to the equation is studied by a simple direct approach. A by-product of the technique is the equivalence of all transition probabilities associated to every Markov transition kernel.

In the present thesis, a theoretical framework for the analysis of spatial queues is developed. Spatial queues are a generalization of the classical concept of queues as they provide the possibility of assigning properties to the users. These properties may influence the queueing process, but may also be of interest for themselves. As a field of application, mobile communication networks are mo...