This paper proposes a joint random field (JRF) model for moving vehicle detection in video sequences. The JRF model extends the conditional random field (CRF) by introducing auxiliary latent variables to characterize the structure and evolution of visual scene. Hence detection labels (e.g. vehicle/roadway) and hidden variables (e.g. pixel intensity under shadow) are jointly estimated to enhance...