Recently, there has been growing interest in average-reward reinforcement learning (ARL), an undiscounted optimality framework that is applicable to many diierent control tasks. ARL seeks to compute gain-optimal control policies that maximize the expected payoo per step. However, gain-optimality has some intrinsic limitations as an optimality criterion, since for example, it cannot distinguish ...

It is not uncommon that two or more related process quality characteristics are needed to be monitored simultaneously in production for most of time. Meanwhile, the observations obtained online often serially autocorrelated due high sampling frequency and dynamics. This goes against statistical I.I.D assumption using multivariate control charts, which may lead performance charts collapse soon. ...

One of the most powerful tools in quality control is the statistical control chart. First developed in the 1920's by Walter Shewhart, the control chart found widespread use during World War II and has been employed, with various modifications ever since. The drawbacks to multivariate charting schemes is their inability to identify which variable was the source of the signal. The multivariate ex...

The FM-index is a succinct text index needing only O(Hkn) bits of space, where n is the text size and Hk is the kth order entropy of the text. FM-index assumes constant alphabet; it uses exponential space in the alphabet size, σ. In this paper we show how the same ideas can be used to obtain an index needing O(Hkn) bits of space, with the constant factor depending only logarithmically on σ. Our...

explicitly evaluable functions. For example, the M-ary error probability is expressed as a quadrature in Lindsey's equation (17), PE(M) = 1 [I-2 lrn Qi(h, $;) exp (-g) dz] z/d eeL s m =22/;;moe-(1+d)s~41-'2@3(1, 1 + M, s, sL) d.s, (5) where, following Lindsey, h2/2 has been replaced by L to simplify the notation. From the series form of @3, it is obvious that the integral gives an additional do...

Methodology is presented for the design of single and double compressed limit Sequential Probability Ratio Tests (SPRT) and Cumulative Sum (CUSUM) control charts to detect one-sided mean shifts in a symmetric probability distribution. We also show how to evaluate the average run length properties with the Fast Initial Response (FIR) feature. The resulting CUSUM plans have a simple scoring proce...