The main purpose of this paper is to study the functional equation arising in dynamic programming of multistage decision processes f x opty∈Dopt{p x, y , q x, y f a x, y , r x, y f b x, y , s x, y f c x, y } for all x ∈ S. A few iterative algorithms for solving the functional equation are suggested. The existence, uniqueness and iterative approximations of solutions for the functional equation ...

Estimating loadability of a generation and transmission system is of practical importance in power system operations and planning. This paper presents a new formulation for the problem using mathematical programming theory. Both steady-state and dynamic security are taken into account in the proposed formulation. The difference between the proposed formulation and existing ones is that dynamic ...

dam reservoirs supplies water resources for drinking, agriculture, and industry almost in all parts of iran. lack of proper utilization rules and unbalanced demands versus available water has led to many problems regarding to ineffective use of the water resources. precipitation and flow rate are stochastic phenomena. therefore, multi-step processes related to the water use efficiency should be...

Irrigation scheduling is an important issue for crop management, in a general context of limited water resources and increasing concern about agricultural productivity. Methods to optimize crop irrigation should take into account the impact of water stress on plant growth and the water balance in the plant-soil-atmosphere system. In this article, we propose a methodology to solve the irrigation...

Editor’s Summary: This chapter considers temporal difference algorithms within the context of infinite-horizon finite-state dynamic programming problems with discounted cost and linear cost function approximation. This problem arises as a subproblem in the policy iteration method of dynamic programming. Additional discussions of such problems can be found in Chapters 12 and 6. The advantage of ...

In this paper a new iterative heuristic dynamic programming (HDP) algorithm is proposed to solve the optimal control problem for a class of nonlinear discrete time-delay systems with saturating actuators. Considering the saturation nonlinearity in the actuators, a nonquadratic performance index function is introduced. In the meantime, a state modification is used to deal with the obstacle induc...

Networks of embedded systems, in the form of cell phones, PDAs, wearable computers, and sensors connected through wireless networking technology, are emerging as an important computing platform. The ubiquitous nature of such a platform promises exciting applications. This paper presents a new programming model for a network of embedded systems, called Spatial Views, targeting its dynamic, space...

Recognizing the context of use is important in making mobile devices as simple to use as possible. Finding out what the user’s situation is can help the device and underlying service in providing an adaptive and personalized user interface. The device can infer parts of the context of the user from sensor data: the mobile device can include sensors for acceleration, noise level, luminosity, hum...

  In this paper, we review novel techniques in the emerging field of spatiotemporal 4D PET imaging. We will discuss existing limitations in conventional dynamic PET imaging which involves independent reconstruction of dynamic PET datasets. Various approaches that seek to attempt some or all of these limitations are reviewed in this work, including techniques that util...