Human conversation is a complex mechanism with subtle nuances. It is hence an ambitious goal to develop artificial intelligence agents that can participate fluently in a conversation. While we are still far from achieving this goal, recent progress in visual question answering, image captioning, and visual question generation shows that dialog systems may be realizable in the not too distant fu...

As a fine-grained video understanding task, dense video captioning involves first localizing events in a video and then generating captions for the identified events. We present the Joint Event Detection and Description Network (JEDDi-Net) that solves the dense captioning task in an end-to-end fashion. Our model continuously encodes the input video stream with three-dimensional convolutional la...

While question answering (QA) with neural network, i.e. neural QA, has achieved promising results in recent years, lacking of large scale real-word QA dataset is still a challenge for developing and evaluating neural QA system. To alleviate this problem, we propose a large scale human annotated real-world QA dataset WebQA with more than 42k questions and 556k evidences. As existing neural QA me...

Automatically generating product reviews is a meaningful, yet not well-studied task in sentiment analysis. Traditional natural language generation methods rely extensively on hand-crafted rules and predefined templates. This paper presents an attention-enhanced attribute-to-sequence model to generate product reviews for given attribute information, such as user, product, and rating. The attribu...

The automatic generation of image captions has received considerable attention. The problem of evaluating caption generation systems, though, has not been that much explored. We propose a novel evaluation approach based on comparing the underlying visual semantics of the candidate and ground-truth captions. With this goal in mind we have defined a semantic representation for visually descriptiv...

Wind and Solar Energy resources are an increasingly large fraction of generation in global electricity systems. However, the variability of these resources necessitates new datasets and tools for understanding their economics and integration in electricity systems. To enable such analyses and more, we have developed a free web-based tool (Global Renewable Energy Atlas & Time-series, or GRETA) t...

Efficient algorithms to mine frequent patterns are crucial to many tasks in data mining. Since the Apriori algorithm was proposed in 1994, there have been several methods proposed to improve its performance. However, most still adopt its candidate set generation-and-test approach. In addition, many methods do not generate all frequent patterns, making them inadequate to derive association rules...

This paper describes the generation of a national three-dimensional (3D) dataset representing the virtual and landscape model. The 3D model is produced automatically by fusing a two-dimensional (2D) national object-oriented database describing the physical landscape and the national high-resolution height model of the Netherlands. Semantic constraints are introduced to correctly model 3D object...

As the pace of Linked data generation and usage increases, so does the interest in intelligent, usable, and scalable browsing tools. Faceted browsing has potential to provide a foundation for effective dataset navigation. In this paper, we will discuss some of the anticipated benefits along with some associated challenges in building the next-generation faceted browsing system for the Web of Li...