We describe an on-going project whose primary aim is to establish the technology of producing closed captions for TV news programs efficiently using natural language processing and speech recognition techniques for the benefit of the hearing impaired in Japan. The project is supported by the Telecommunications Advancement Organisation of Japan with the help of the ministry of Posts and Telecomm...

In recent years, the amount of streaming video has grown rapidly on the Web. Often, retrieving these streaming videos offers the challenge of indexing and analyzing the media in real time because the streams must be treated as effectively infinite in length, thus precluding offline processing. Generally speaking, captions are important semantic clues for video indexing and retrieval. However, e...

Recently, image caption which aims to generate a textual description for an image automatically has attracted researchers from various fields. Encouraging performance has been achieved by applying deep neural networks. Most of these works aim at generating a single caption which may be incomprehensive, especially for complex images. This paper proposes a topic-specific multi-caption generator, ...

In this paper, an approach to detection of caption text in video frames is described. Text recognition in video can be applied to various applications, however there are still problematic issues such as insufficient resolution, complexity of layouts and backgrounds. This study attempts to solve these problems with a segmentation-free approach, called MAP matching method. Besides extending the m...

The original article [1] contains an error whereby Fig. 2a and b are mistakenly swapped with each other, and thus do not correspond to their correct respective sub-headings in the caption.

In order for ATSC DTV receivers to operate properly, the PSIP/PSI data in the broadcast stream must be correct, complete, and internally consistent. This paper describes a graphical approach to showing the interrelationships among the PSIP/PSI tables in a DTV broadcast stream and highlighting any inconsistencies. Key aspects of this approach are: (1) the use of color coding to provide an “at a ...

In this paper, we describe a system that jointly extracts entities appearing in images and mentioned in their accompanying captions. As input, the entity linking program takes a segmented image together with its caption. It consists of a sequence of processing steps: partof-speech tagging, dependency parsing, and coreference resolution that enables us to identify the entities as well as possibl...