A central question of crowd-sourcing is how to elicit expertise from agents. This is even more difficult when answers cannot be directly verified. A key challenge is that sophisticated agents may strategically withhold effort or information when they believe their payoff will be based upon comparison with other agents whose reports will likely omit this information due to lack of effort or expe...

This report describes the development of efficient second language (L2) writing assessment tasks designed specifically for low‐proficiency learners English to be included in TOEFL® Essentials™ test. Based on can‐do descriptors Common European Framework Reference Languages A1 through B1 levels proficiency, four task types were identified prototypical candidate target test‐taker population (i.e.,...

Modeling what makes an advertisement persuasive, i.e., eliciting the desired response from consumer, is critical to study of propaganda, social psychology, and marketing. Despite its importance, computational modeling persuasion in computer vision still infancy, primarily due lack benchmark datasets that can provide persuasion-strategy labels associated with ads. Motivated by literature psychol...

Expert judgements are routine in biosecurity risk analysis. This report reviews methods for eliciting probabilities, quantities, and conceptual models. It defines ‘expert’ status, reviews the literature on biases and heuristics in expert judgements and outlines methods for detecting and eliciting values, attitudes and motivations. The report describes direct and indirect techniques for elicitin...

One may produce the qth harmonic of a string of length π by applying the ‘correct touch’ at the node π/q during a simultaneous pluck or bow. This notion was made precise by a model of Bamberger, Rauch and Taylor. Their ‘touch’ is a damper of magnitude b concentrated at π/q. The ‘correct touch’ is that b for which the modes, that do not vanish at π/q, are maximally damped. We here examine the as...

Collusion is covert co-operation between participants of a game. It poses technical, game design, and communal problems to multiplayer games that do not allow the players to share knowledge or resources with other players. In this paper, we analyse experimental data from a simple twodimensional game using synthetic players to elicit features that indicate collusion.

Title: Using the repertory grid and laddering technique to determine the user's evaluative model of search engines. Purpose This study explores a method for the determination of users' representations of search engines, formed during their interaction with these systems. The purpose is to determine the extent to which these elicited 'mental models' indicate the system aspects of importance to t...

Eliciting Private Information from Selfish Agents