Abstract We develop a new Bayesian modelling framework for the class of higher-order, variable-memory Markov chains, and introduce an associated collection methodological tools exact inference with discrete time series. show that version context tree weighting alg-orithm can compute prior predictive likelihood exa-ctly (averaged over both models parameters), two related algorithms are introduce...