Recent advances in corpus-based Natural Language Generation (NLG) hold the promise of being easily portable across domains, but require costly training data, consisting of meaning representations (MRs) paired with Natural Language (NL) utterances. In this work, we propose a novel framework for crowdsourcing high quality NLG training data, using automatic quality control measures and evaluating ...

Advances in information technologies and analytic tools have dramatically increased our ability to obtain accurate data on billions of economic decisions almost the instant that they are made. Services such as Google Trends aggregate billions of search queries and provide information about the search volume of different terms. This information from the “crowd”, had been successfully used to acc...

Norwegian National ICT has implemented a national governance scheme for archetypes. The scheme uses openEHR, and is possibly the first of its kind worldwide. It introduces several new processes and methods for crowd sourcing clinician input. It has spent much of its first year establishing practical processes and recruiting clinicians, and only a few archetypes has been reviewed and approved. S...

Online data collection has begun to revolutionize the behavioral sciences. However, conducting carefully controlled behavioral experiments online introduces a number of new of technical and scientific challenges. The project described in this paper, psiTurk, is an open-source platform which helps researchers develop experiment designs which can be conducted over the Internet. The tool primarily...

This paper introduces the enviroCar project which aims at crowd sourcing the collection of environmental and traffic data. For this purpose a data collection architecture relying on onboard sensors of cars, mobile phones and web services has been developed. Besides providing drivers with precise information about their driving style and its environmental/economical impact, the enviroCar system ...

The Multilingual Visual Sentiment Ontology (MVSO) consists of 15,600 concepts in 12 different languages that are strongly related to emotions and sentiments expressed in images. These concepts are defined in the form of Adjective-Noun Pair (ANP), which are crawled and discovered from online image forum Flickr. In this work, we used Amazon Mechanical Turk as a crowd-sourcing platform to collect ...

We propose a methodology to study the occurrence of fires through image posts on Flickr; crowd-sourcing information from a noisy social media dataset can estimate the presence of fires. We collect several years worth of photos and associated metadata using fire-related search terms. We use an image classification model to detect geotagged photos that are further analysed to determine if a fire ...

Hand-over-face gestures, a subset of emotional body language, are overlooked by automatic affect inference systems. We propose the use of hand-over-face gestures as a novel affect cue for automatic inference of cognitive mental states. Moreover, affect recognition systems rely on the existence of publicly available datasets, often the approach is only as good as the data. We present the collect...

The personal web vision promises to give users a highly personalized experience on the web. This paper proposes and describes a Personal Web Workflow Methodology, designed to elicit, operationalize and execute a personal web user’s goals. Our approach relies heavily on our prior research in goal modeling and operationalization, model matching and merging, and web service monitoring and recovery...