Note: This is a draft as of October 3, 2014 of a survey article now under review for the Companion to Semantics being prepared for Wiley by L. Matthewson, C. Meier, H. Rullmann, and E. Zimmermann. The intention is for the article to be engaging and accessible to students with 1 or 2 courses in formal semantics, so I’ve tried to keep it as non-technical and empiricallyoriented as possible. Sugge...

BACKGROUND Previous literature suggests that those with reading disability (RD) have more pronounced deficits during semantic processing in reading as compared to listening comprehension. This discrepancy has been supported by recent neuroimaging studies showing abnormal activity in RD during semantic processing in the visual but not in the auditory modality. Whether effective connectivity betw...

All randomized studies published on the medical treatment of transient ischemic attacks in which controls received no treatment or placebo and in which mortality was reported were reviewed. Using the odds ratio method, we analyzed the results to determine if treatment had an effect on expected mortality. Studies were analyzed separately according to the treatment modality used. Chronic anticoag...

An input (e.g., airplane takeoff sound) to a sensory modality can suppress the percept of another input (e.g., talking voices of neighbors) of the same modality. This perceptual suppression effect is evidence that neural responses to different inputs closely interact with each other in the brain. While recent studies suggest that close interactions also occur across sensory modalities, crossmod...

Experimental efforts to meliorate the modality effect have included attempts to make the visual stimulus more distinctive. McDowd and Madigan (1991) failed to find an enhanced recency effect in serial recall when the last item was made more distinct in terms of its color. In an attempt to extend this finding, three experiments were conducted in which visual distinctiveness was manipulated in a ...

This paper presents results from a project on phonetic convergence in German spontaneous speech. We used linear mixed models to examine 22 unimodal and 24 multimodal dialogs for articulation rate. We show that speakers’ local articulation rates are influenced by the preceding rates of their interlocutors, and that the direction of this influence (i.e., divergence or convergence) depends on soci...

It was examined whether stimulus modality (auditory vs. visual) affects the retrieval of subjective duration from memory. In 2 experiments a temporal generalization paradigm was used. Participants had to decide whether the previously learned standard duration (400 ms) occurred in the context of comparison stimuli. Two major results were found. (1) Performance was unaffected by the modality of t...

Direct manipulation is the key concept of interaction with systems that use graphics to communicate with the user. The latest generation of such systems supports also interaction with other modalities, i.e., text and figure captions. However, the effects of interaction within one modality must be reflected in the other modalities in order to keep the presentation consistent. Although some appro...

As embodied theories of cognition are increasingly formalized and tested, care must be taken to make informed assumptions regarding the nature of concepts and representations. In this study, we outline three reasons why one cannot, in effect, represent the same concept twice. First, online perception affects offline representation: Current representational content depends on how ongoing demands...

We investigate deep generative models that can exchange multiple modalities bi-directionally, e.g., generating images from corresponding texts and vice versa. A major approach to achieve this objective is to train a model that integrates all the information of different modalities into a joint representation and then to generate one modality from the corresponding other modality via this joint ...