Asynchronous parallel optimization received substantial successes and extensive attention recently. One of core theoretical questions is how much speedup (or benefit) the asynchronous parallelization can bring to us. This paper provides a comprehensive and generic analysis to study the speedup property for a broad range of asynchronous parallel stochastic algorithms from the zeroth order to the...

We propose a new parallelized high-dimensional single-query path planning technique that uses a coupled forest of random trees (i.e., instead of a single tree). We present both theoretical and experimental results that show using forests of random trees can lead to expected super linear speedup, with respect to the number of trees in the forest. In other words, with T trees running in parallel,...

We propose a new parallelized high-dimensional single-query path planning technique that uses a coupled forest of random trees (i.e., instead of a single tree). We present both theoretical and experimental results that show using forests of random trees can lead to expected super linear speedup, with respect to the number of trees in the forest. In other words, with T trees running in parallel,...

Multithreading has become a dominant paradigm in general purpose MIMD parallel computation. To execute a multithreaded computation on a parallel computer, a scheduler must order and allocate threads to run on the individual processors. The scheduling algorithm dramatically a ects both the speedup attained and the space used when executing the computation. We consider the problem of scheduling m...