In this paper, a new generalized value iteration algorithm is developed to solve infinite horizon optimal control problems for discrete-time nonlinear systems. The idea is to use iterative adaptive dynamic programming (ADP) to obtain the iterative control law which makes the iterative performance index function reach the optimum. The generalized value iteration algorithm permits an arbitrary po...

The heuristic k-means algorithm, widely used for cluster analysis, does not guarantee optimality. We developed a dynamic programming algorithm for optimal one-dimensional clustering. The algorithm is implemented as an R package called Ckmeans.1d.dp. We demonstrate its advantage in optimality and runtime over the standard iterative k-means algorithm.

We present a continuous-time contract whereby a top-level player can incentivize a hierarchy of players below him to act in his best interest despite only observing the output of his direct subordinate. This paper extends Sannikov’s approach from a situation of asymmetric information between a principal and an agent to one of hierarchical information between several players. We develop an itera...

in this paper, we review novel techniques in the emerging field of spatiotemporal 4d pet imaging. we will discuss existing limitations in conventional dynamic pet imaging which involves independent reconstruction of dynamic pet datasets. various approaches that seek to attempt some or all of these limitations are reviewed in this work, including techniques that utilize iterative temporal smooth...