User context monitoring using sensors on mobile devices benefits end-users unobtrusively and in real-time by providing information support to various kinds of mobile applications and services. A pervasive question, however, is how the sensors on a mobile device could be scheduled more efficiently such that they can detect more user information with as little energy usage as possible. In this pa...

Article history: Received 14 April 2009 Available online 17 November 2009

We present the generalized semi-Markov decision process (GSMDP) as a natural model for stochastic decision processes with asynchronous events in hope to spur interest in asynchronous models, often overlooked in AI literature.

In this paper we introduce a correlated input process model SSMP (Special Semi-Markov Process) for telecommunication networks. Many other models, including the two-state Markov modulated Poisson process MMPP(2), separately treated in the literature are shown to be special cases. The SSMP can be applied for directly modeling discrete-time input processes which are important for the future broadb...