This paper describes how a virtual agent assists a huam user in collaborative construction tasks by combining manipulative capabilities for assembly actions with conversational capabilities for mixed-initiative dialogue. We present an interaction model for representing the evolving information states of the participants in this interaction. It includes multiple dimensions along which an interac...