In this paper we present details on the joint submission of TU Berlin and Fraunhofer FIRST to the ImageCLEF 2011 Photo Annotation Task. We sought to experiment with extensions of Bag-of-Words (BoW) models at several levels and to apply several kernel-based learning methods recently developed in our group. For classifier training we used non-sparse multiple kernel learning (MKL) and an efficient...

This thesis explores use of machine learning for multimedia content management involving single/multiple features, modalities and concepts. We introduce shape based feature for binary patterns and apply it for recognition and retrieval application in single and multiple feature based architecture. The multiple feature based recognition and retrieval frameworks are based on the theory of multipl...

Real-world recognition system often encounters the challenge of unseen labels. To identify such labels, multi-label zero-shot learning (ML-ZSL) focuses on transferring knowledge by a pre-trained textual label embedding (e.g., GloVe). However, methods only exploit single-modal from language model, while ignoring rich semantic information inherent in image-text pairs. Instead, recently developed ...

Multi-modal control is a commonly used design tool for breaking up complex control tasks into sequences of simpler tasks. In this paper, we show that by viewing the control space as a set of such tokenized instructions rather than as real-valued signals, reinforcement learning becomes applicable to continuous-time control systems. In fact, we show how a combination of state-space exploration an...

Multi-modal tabletop applications offer excellent opportunities for enriching the education of young children. Read-It is an example of an interactive game with a multi-modal tangible interface that was designed to combine the advantages of current physical games and computer exercises. It is a novel approach for supporting children who learn to read. The first experimental evaluation has demon...

The biometrics authentication systems take attentions to cover the weakness of password authentication system. In this paper, we focus attention on the multi modal-biometrics of behavior characteristics. For the integration of multi modal biometrics, some variations of Self Organizing maps and its incremental learning method for implementing adaptive authentication system are implemented and th...

This paper presents an approach to accurate and scalable multiple-model state estimation for hybrid systems with intermittent, multi-modal dynamics. The approach consists of using discrete-state estimation to identify a system’s behavioral context and determine which motion models appropriately represent current dynamics, and which multiple-model filters are appropriate for state estimation. Th...

In this paper, we present a framework for range flow estimation from Microsoft’s multi-modal imaging device Kinect. We address all essential stages of the flow computation process, starting from the calibration of the Kinect, over the alignment of the range and color channels, to the introduction of a novel multi-modal range flow algorithm which is robust against typical (technology dependent) ...

With the fast development of data collection techniques, a huge amount of complex multi-modal data are generated, shared and stored on the Internet. The burden of extracting multi-modal features for test instances in data analysis becomes the main fact that hurts the efficiency of prediction. In this paper, in order to reduce the modal extraction cost in serialized classification system, we pro...