This paper describes a knowledge-based approach to automatic 3D reconstruction of buildings from aerial imagery. The approach relies upon the use of 2D GIS map and knowledge about the imaging geometry and acquisition parameters. We show that by integrating knowledge from the images and the GIS map, the complexity of the building reconstruction process can be greatly reduced. In the first stage ...