Enhancement of Visual Realism with BRDF for Patient Specific Bronchoscopy Simulation

This paper presents a novel method for photorealistic rendering of the bronchial lumen by directly deriving matched shading and texture parameters from video bronchoscope images. 2D/3D registration is used to match video bronchoscope images with 3D CT scan of the same patient, such that patient specific modelling and simulation with improved visual realism can be achieved. With the proposed method, shading parameters are recovered by modelling the bidirectional reflectance distribution function (BRDF) of the visible surfaces by exploiting the restricted lighting configurations imposed by the bronchoscope. The derived BRDF is then used to predict the expected shading intensity such that a texture map independent of lighting conditions can be extracted. This allows the generation of new views not captured in the original bronchoscopy video, thus allowing free navigation of the acquired 3D model with enhanced photo-realism.