Real time face and mouth recognition using radial basis function neural networks

This paper presents a method for automatic real time face and mouth recognition using radial basis function neural networks (RBFNN). The proposed method uses the motion information to localize the face region, and the face region is processed in YCrCb color space to determine the locations of the eyes. The center of the mouth is determined relative to the locations of the eyes. Facial and mouth features are extracted using multiscale morphological erosion and dilation operations, respectively. The facial features are extracted relative to the locations of the eyes, and mouth features are extracted relative to the locations of the eyes and mouth. The facial and mouth features are given as input to radial basis function neural networks. The RBFNN is used to recognize a person in video sequences using face and mouth modalities. The evidence from face and mouth modalities are combined using a weighting rule, and the result is used for identification and authentication. The performance of the system using facial and mouth features is evaluated in real time in the laboratory environment, and the system achieves a recognition rate (RR) of 99.0% and an equal error rate (EER) of about 0.73% for 50 subjects. The performance of the system is also evaluated for XM2VTS database, and the system achieves a recognition rate (RR) of 100% an equal error rate (EER) of about 0.25% for 50 subjects. 2008 Elsevier Ltd. All rights reserved.