The Markov Chain Monte Carlo (MCMC) technique provides a means to generate a random sequence of model realizations that sample the posterior probability distribution of a Bayesian analysis. That sequence may be used to make inferences about the model uncertainties that derive from measurement uncertainties. This paper presents an approach to improving the eeciency of the Metropolis approach to ...

BACKGROUND Cardiac diseases represent the leading cause of sudden death worldwide. During the development of cardiac diseases, the left ventricle (LV) changes obviously in structure and function. LV motion estimation plays an important role for diagnosis and treatment of cardiac diseases. To estimate LV motion accurately for cine magnetic resonance (MR) cardiac images, we develop an algorithm b...

Although quasi-Newton algorithms generally converge in fewer iterations than conjugate gradient algorithms, they have the disadvantage of requiring substantially more storage. An algorithm will be described which uses an intermediate (and variable) amount of storage and which demonstrates convergence which is also intermediate, that is, generally better than that observed for conjugate gradient...

Mixture of experts (ME) is a modular neural network architecture for supervised learning. A double-loop Expectation-Maximization (EM) algorithm has been introduced to the ME architecture for adjusting the parameters and the iteratively reweighted least squares (IRLS) algorithm is used to perform maximization in the inner loop [Jordan, M.I., Jacobs, R.A. (1994). Hierarchical mixture of experts a...

This paper analyzes local convergence rates of primal-dual interior point methods for general nonlinearly constrained optimization problems. For this purpose, we first discuss modified Newton methods and modified quasi-Newton methods for solving a nonlinear system of equations, and show local and Qquadratic/Q-superlinear convergence of these methods. These methods are characterized by a perturb...

In this paper, we propose an approach to the multichannel blind deconvolution problem, based on the mutual information criterion and more generally on an appropriate system of estimating equations. Formulas for the quasiNewton algorithm and the asymptotic covariance matrix of the estimator are provided. More interesting results have been obtained in the pure deconvolution case. By a clever para...

The problem of minimizing an L2-sensitivity measure subject to L2norm dynamic-range scaling constraints for state-space digital filters is formulated. It is shown that the problem can be converted into an unconstrained optimization problem by using linear-algebraic techniques. Next, the unconstrained optimization problem is solved by applying an efficient quasi-Newton algorithm with closed-form...

In this paper we propose a subspace limited memory quasi-Newton method for solving large-scale optimization with simple bounds on the variables. The limited memory quasi-Newton method is used to update the variables with indices outside of the active set, while the projected gradient method is used to update the active variables. The search direction consists of three parts: a subspace quasi-Ne...

A variable parametrization scheme is developed and demonstrated for shape optimization using quasi-Newton methods. The scheme performs adaptive parametrization refinement while preserving the approximate Hessian of the shape optimization problem and enables free-form shape design using quasi-Newton optimization methods. Using a Bspline parametrization, the scheme is validated using a 1-D shape ...