Markov decision process (MDP) framework for software power optimization using call profiles on mobile phones

نویسندگان

  • Eric Jung
  • Frank Maker
  • Tang Lung Cheung
  • Xin Liu
  • Venkatesh Akella
چکیده

We present an optimization framework for delay-tolerant data applications on mobile phones based on the Markov decision process (MDP). This process maximizes an application specific reward or utility metric, specified by the user, while still meeting a talk-time constraint, under limited resources such as battery life. This approach is novel for two reasons. First, it is user profile driven, which means that the user’s history is an input to help predict and reserve resources for future talk-time. It is also dynamic: an application will adapt its behavior to current phone conditions such as battery level or time before the next recharge period. We propose efficient techniques to solve the optimization problem based on dynamic programming and illustrate how it can be used to optimize realistic applications. We also present a heuristic based on the MDP framework that performs well and is highly scalable for multiple applications. This approach is demonstrated using two applications: Email and Twitter synchronization with different priorities. We present experimental results based on Google’s Android platform running on an Android Develepor Phone 1 (HTC Dream) mobile phone. Tang Lung Cheung · Xin Liu Dept. of Computer Science, University of California, Davis, CA 95616, USA Tang Lung Cheung E-mail: [email protected] Xin Liu E-mail: [email protected] Eric Jung · Frank Maker · Venkatesh Akella Dept. of Electrical and Computer Engineering, University of California, Davis, CA 95616, USA Eric Jung E-mail: [email protected] Frank Maker E-mail: [email protected] Venkatesh Akella E-mail: [email protected]

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Optimizing Red Blood Cells Consumption Using Markov Decision Process

In healthcare systems, one of the important actions is related to perishable products such as red blood cells (RBCs) units that its consumption management in different periods can contribute greatly to the optimality of the system. In this paper, main goal is to enhance the ability of medical community to organize the RBCs units’ consumption in way to deliver the unit order timely with a focus ...

متن کامل

Communication Networks CAC and routing for multi-service networks with blocked wide-band calls delayed, Part II: approximative link MDP framework

In this paper, we study the call admission control (CAC) and routing issue in multi-service networks. Two categories of calls are considered: a narrow-band with blocked calls cleared and a wide-band with blocked calls delayed. The optimisation is subject to several quality of service (QoS) constraints, either on the packet or call level. The objective function is formulated as reward maximisati...

متن کامل

Communication Networks A new reward model for MDP state aggregation with application to CAC and Routing

An optimal solution of the call admission control and routing problem in multi-service loss networks, in terms of average reward per time unit, is possible by modeling the network behavior as a Markov decision process (MDP). However, even after applying the standard link independence assumption, the solution of the corresponding set of link problems may involve considerable numerical computatio...

متن کامل

Approaches to macro decompositions of large Markov decision process planning problems

Mobile robot navigation tasks are subject to motion stochasticity arising from the robot’s local controllers, which casts the navigational task into a Markov decision process framework. The MDP may, however, be intractably large; in this work we consider the prioritized package delivery problem which yields an exponentially large state space. We demonstrate that the bulk of this state space is ...

متن کامل

Communication Networks CAC and routing for multi-service networks with blocked wide-band calls delayed, part I: exact link MDP framework

In this paper, we study the call admission control (CAC) and routing issue in multi-service networks. Two categories of calls are considered: a narrow-band (NB) with blocked calls cleared and a wide-band (WB) with blocked calls delayed. The objective function is formulated as reward maximisation with penalty for delay. The optimisation is subject to quality of service (QoS) constraints and, pos...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Design Autom. for Emb. Sys.

دوره 14  شماره 

صفحات  -

تاریخ انتشار 2010