The advent of fast tunable optical transceivers makes it feasible to dynamically update the connectivity of multihop WDM networks to accommodate tra c demands that vary over time. Of major concern in such design is how the connectivity should react to changes in tra c patterns. We formulate the problem as a Markovian Decision Process, and we develop heuristics to obtain good recon guration poli...

UNDER INCOMPLETE OBSERVATION PART n Hajime Kawai University of Osaka Prefecture (Received July 6, 1982; Revised June 29, 1983) We consider an optimal ordering and replacement policy of a discrete time Markovian deterioration system when the observation of the system is incomplete. The problem is to examine the structure of an optimal policy which minimizes the total expected discounted cost in ...

Wireless communication technology has been increasingly adopted in various business environments of supply chains. Radio frequency identification technology enables to obtain the real-time information of the dynamics associated with vehicle shipment operations. This paper presents a Markov decision process model for dynamically building the shipment loads using the real-time information of the ...

EMPA enhances the expressiveness of classical process algebras by integrating functional and performance descriptions of concurrent systems. This is achieved by ooering, besides passive actions (useful for pure nondeterminism), actions whose duration is exponentially distributed as well as immediate actions (useful for performance abstraction), parametrized by priority levels (hence prioritized...

Characterization protocols have so far played a central role in the development of noisy intermediate-scale quantum (NISQ) computers capable impressive feats. This trajectory is expected to continue building next generation devices—ones that can surpass classical for particular tasks—but progress characterization must keep up with complexities intricate device noise. A missing piece zoo procedu...

Consider a production system where products are produced continuously and screened for conformance with their specification limits. When product performance falls below a lower specification limit or above an upper limit, a decision is made to rework or scrap the product. The majority of the process target models in the literature deal with a single-stage production system. In the real-world in...

We review high-level speciication formalisms for Markovian performability models, thereby emphasising the role of structuring concepts as realised par excellence by stochastic process algebras. Symbolic representations based on decision diagrams are presented, and it is shown that they quite ideally support compositional model construction and analysis.

A simulation method is developed, to find an optimal policy for the expected average reward of a Markovian Decision Process. It is shown that the method is consistent, in the sense that it produces solutions arbitrarily close to the optimal. Various types of estimation errors are examined, and bounds are developed.

We study decision timing problems on finite horizon with Poissonian information arrivals. In our model, a decision maker wishes to optimally time her action in order to maximize her expected reward. The reward depends on an unobservable Markovian environment, and information about the environment is collected through a (compound) Poisson observation process. Examples of such systems arise in in...