This paper presents algorithms for parallelization of inference in hidden Markov models (HMMs). In particular, we propose parallel backward-forward type filtering and smoothing algorithm as well Viterbi-type maximum-a-posteriori (MAP) algorithm. We define associative elements operators to pose these problems parallel-prefix-sum computations sum-product max-product parallelize them using paralle...