We present a data-driven stochastic optimal control framework that is derived using the path integral (PI) control approach. We find iterative control laws analytically without a priori policy parameterization based on probabilistic representation of the learned dynamics model. The proposed algorithm operates in a forward-backward sweep manner which differentiate it from other PI-related method...

A new approach is used to determine the transient probability functions of Markov processes. This new solution method is a sample path counting approach and uses dual processes and randomization. The approach is illustrated by determining transient probability functions for a three-state Markov process. This approach also provides a way to calculate transient probability functions for Markov pr...

We consider a stochastic flow driven by a finite-dimensional Brownian motion. We show that almost every realization of such a flow exhibits strong statistical properties such as the exponential convergence of an initial measure to the equilibrium state and the central limit theorem. The proof uses new estimates of the mixing rates of the multi-point motion.

We consider the sample paths of the order statistics of independent and identically distributed random variables with common distribution function F . If F is strictly increasing but possibly having discontinuities, we prove that the sample paths of the order statistics satisfy the large deviation principle in the Skorokhod M1 topology. Sanov’s theorem is deduced in the SkorokhodM ′ 1 topology ...

We study online learning where a decision maker interacts with Nature with the objective of maximizing her long-term average reward subject to some sample path average constraints. We define the reward-in-hindsight as the highest reward the decision maker could have achieved, while satisfying the constraints, had she known Nature’s choices in advance. We show that in general the reward-in-hinds...

This paper provides experimental data on the effective use of a new lubricating composition, which includes industrial oil any brand with addition nanometal component friction pair, has lower hardness. It is shown that this composition significantly reduces wear resistance rails and wheels rolling stock during operation, prevents electrochemical corrosion pair wheel–rail and, most importantly, ...

In this paper, it is explicitly determined the r-dynamic chromatic number of direct product any given path with either a complete graph or wheel graph. Illustrative examples are shown for each one cases that studied throughout paper.

Using the contraction principle, in this paper we derive a set of closure properties for sample path large deviations. These properties include sum, reduction, composition and reeection mapping. Using these properties, we show that the exponential decay rates of the steady state queue length distributions in an intree network with routing can be derived by a set of recursive equations. The solu...

Let B = { B(t), t ∈ R+ } be a bifractional Brownian motion in R. We prove that B is strongly locally nondeterministic. Applying this property and a stochastic integral representation of B , we establish Chung’s law of the iterated logarithm for B , as well as sharp Hölder conditions and tail probability estimates for the local times of B . We also consider the existence and the regularity of th...