Papers

2016

Delaney-Busch, N., Wilkie, G., & Kuperberg, G. R. (2016). Vivid: How valence and arousal influence word processing under different task demands. Cognitive, Affective, & Behavioral Neuroscience, 16(3), 413-432.

In this study, we used event-related potentials to examine how different dimensions of emotion—valence and arousal—influence different stages of word processing under different task demands. In two experiments, two groups of participants viewed the same single emotional and neutral words while carrying out different tasks. In both experiments, valence (pleasant, unpleasant, and neutral) was fully crossed with arousal (high and low). We found that the task made a substantial contribution to how valence and arousal modulated the late positive complex (LPC), which is thought to reflect sustained evaluative processing (particularly of emotional stimuli). When participants performed a semantic categorization task in which emotion was not directly relevant to task performance, the LPC showed a larger amplitude for high-arousal than for low-arousal words, but no effect of valence. In contrast, when participants performed an overt valence categorization task, the LPC showed a large effect of valence (with unpleasant words eliciting the largest positivity), but no effect of arousal. These data show not only that valence and arousal act independently to influence word processing, but that their relative contributions to prolonged evaluative neural processes are strongly influenced by the situational demands (and by individual differences, as revealed in a subsequent analysis of subjective judgments).

Lau, E. F., Weber, K., Gramfort, A., Hämäläinen, M. S., & Kuperberg, G. R. (2016). Spatiotemporal Signatures of Lexical-Semantic Prediction. Cerebral Cortex, 26(4), 1377-87. https://doi.org/10.1093/cercor/bhu219

Although there is broad agreement that top-down expectations can facilitate lexical-semantic processing, the mechanisms driving these effects are still unclear. In particular, while previous electroencephalography (EEG) research has demonstrated a reduction in the N400 response to words in a supportive context, it is often challenging to dissociate facilitation due to bottom-up spreading activation from facilitation due to top-down expectations. The goal of the current study was to specifically determine the cortical areas associated with facilitation due to top-down prediction, using magnetoencephalography (MEG) recordings supplemented by EEG and functional magnetic resonance imaging (fMRI) in a semantic priming paradigm. In order to modulate expectation processes while holding context constant, we manipulated the proportion of related pairs across 2 blocks (10 and 50% related). Event-related potential results demonstrated a larger N400 reduction when a related word was predicted, and MEG source localization of activity in this time-window (350-450 ms) localized the differential responses to left anterior temporal cortex. fMRI data from the same participants support the MEG localization, showing contextual facilitation in left anterior superior temporal gyrus for the high expectation block only. Together, these results provide strong evidence that facilitatory effects of lexical-semantic prediction on the electrophysiological response 350-450 ms postonset reflect modulation of activity in left anterior temporal cortex.

2015

Language and thought dysfunction are central to the schizophrenia syndrome. They are evident in the major symptoms of psychosis itself, particularly as disorganized language output (positive thought disorder) and auditory verbal hallucinations (AVHs), and they also manifest as abnormalities in both high-level semantic and contextual processing and low-level perception. However, the literatures characterizing these abnormalities have largely been separate and have sometimes provided mutually exclusive accounts of aberrant language in schizophrenia. In this review, we propose that recent generative probabilistic frameworks of language processing can provide crucial insights that link these four lines of research. We first outline neural and cognitive evidence that real-time language comprehension and production normally involve internal generative circuits that propagate probabilistic predictions to perceptual cortices - predictions that are incrementally updated based on prediction error signals as new inputs are encountered. We then explain how disruptions to these circuits may compromise communicative abilities in schizophrenia by reducing the efficiency and robustness of both high-level language processing and low-level speech perception. We also argue that such disruptions may contribute to the phenomenology of thought-disordered speech and false perceptual inferences in the language system (i.e., AVHs). This perspective suggests a number of productive avenues for future research that may elucidate not only the mechanisms of language abnormalities in schizophrenia, but also promising directions for cognitive rehabilitation.

Fields, E. C., & Kuperberg, G. R. (2015). Loving yourself more than your neighbor: ERPs reveal online effects of a self-positivity bias. Social Cognitive and Affective Neuroscience, 10(9), 1202-9. https://doi.org/10.1093/scan/nsv004

A large body of social psychological research suggests that we think quite positively of ourselves, often unrealistically so. Research on this ’self-positivity bias’ has relied mainly on self-report and behavioral measures, but these can suffer from a number of problems including confounds that arise from the desire to present oneself well. What has not been clearly assessed is whether the self-positivity bias influences the processing of incoming information as it unfolds in real time. In this study, we used event-related potentials to address this question. Participants read two-sentence social vignettes that were either self- or other-relevant. Pleasant words in self-relevant contexts evoked a smaller negativity between 300 and 500 ms (the N400 time window) than the same words in other-relevant contexts, suggesting that comprehenders were more likely to expect positive information when a scenario referred to themselves. This finding indicates that the self-positivity bias is available online, acting as a general schema that directly influences real-time comprehension.

Xiang, M., & Kuperberg, G. R. (2015). Reversing expectations during discourse comprehension. Language, Cognition, and Neuroscience, 30(6), 648-672.

In two event-related potential experiments, we asked whether comprehenders used the concessive connective, even so, to predict upcoming events. Participants read coherent and incoherent scenarios, with and without even so, e.g. ‘Elizabeth had a history exam on Monday. She took the test and aced/failed it. (Even so), she went home and celebrated wildly’, as they rated coherence (Experiment 1) or simply answered intermittent comprehension questions (Experiment 2). The semantic function of even so was used to reverse real-world knowledge predictions, leading to an attenuated N400 to coherent versus incoherent target words (‘celebrated’). Moreover, its pragmatic communicative function enhanced predictive processing, leading to more N400 attenuation to coherent targets in scenarios with than without even so. This benefit however, did not come for free: the detection of failed event predictions triggered a later posterior positivity and/or an anterior negativity effect, and

2014

Wittenberg, E., Jackendoff, R., Kuperberg, G., Paczynski, M., Snedeker, J., Wiese, H., & Wittenberg, E. (2014). The processing and representation of light verb constructions. In Bachrach, A., Roy, I. and Stockall, L. (Eds): Structuring the Argument: Multidisciplinary research on verb argument structure (pp. 61-80). John Benjamins Publishing Company.
Cohn, N., Jackendoff, R., Holcomb, P. J., & Kuperberg, G. R. (2014). The grammar of visual narrative: Neural evidence for constituent structure in sequential image comprehension. Neuropsychologia, 64, 63-70. https://doi.org/10.1016/j.neuropsychologia.2014.09.018

Constituent structure has long been established as a central feature of human language. Analogous to how syntax organizes words in sentences, a narrative grammar organizes sequential images into hierarchic constituents. Here we show that the brain draws upon this constituent structure to comprehend wordless visual narratives. We recorded neural responses as participants viewed sequences of visual images (comics strips) in which blank images either disrupted individual narrative constituents or fell at natural constituent boundaries. A disruption of either the first or the second narrative constituent produced a left-lateralized anterior negativity effect between 500 and 700ms. Disruption of the second constituent also elicited a posteriorly-distributed positivity (P600) effect. These neural responses are similar to those associated with structural violations in language and music. These findings provide evidence that comprehenders use a narrative structure to comprehend visual sequences and that the brain engages similar neurocognitive mechanisms to build structure across multiple domains.

Paczynski, M., Jackendoff, R., & Kuperberg, G. R. (2014). When events change their nature: The neurocognitive mechanisms underlying aspectual coercion. The Journal of Cognitive Neuroscience, 29(9), 1905-17.

The verb “pounce” describes a single, near-instantaneous event. Yet, we easily understand that, “For several minutes the cat pounced…” describes a situation in which multiple pounces occurred, although this interpretation is not overtly specified by the sentence s syntactic structure or by any of its individual words—a phenomenon known as “aspectual coercion.” Previous psycholinguistic studies have reported processing costs in association with aspectual coercion, but the neurocognitive mechanisms giving rise to these costs remain contentious. Additionally, there is some controversy about whether readers commit to a full interpretation of the event when the aspectual information becomes available, or whether they leave it temporarily underspecified until later in the sentence. Using ERPs, we addressed these questions in a design that fully crossed context type (punctive, durative, frequentative) with verb type (punctive, durative). We found a late, sustained negativity to punctive verbs in durative contexts, but not in frequentative (e.g., explicitly iterative) contexts. This effect was distinct from the N400 in both its time course and scalp distribution, suggesting that it reflected a different underlying neurocognitive mechanism. We also found that ERPs to durative verbs were unaffected by context type. Together, our results provide strong evidence that neural activity associated with aspectual coercion is driven by the engagement of a morphosyntactically unrealized semantic operator rather than by violations of real-world knowledge, more general shifts in event representation, or event iterativity itself. More generally, our results add to a growing body of evidence that a set of late-onset sustained negativities reflect elaborative semantic processing that goes beyond simply combining the meaning of individual words with syntactic structure to arrive at a final representation of meaning.

Wittenberg, E., Paczynski, M., Wiese, H., Jackendoff, R., & Kuperberg, G. R. (2014). The difference between “giving a rose” and “giving a kiss”: A sustained anterior negativity to the light verb construction. Journal of Memory and Language, 73, 31-42.

We used event-related potentials (ERPs) to investigate the neurocognitive mechanisms associated with processing light verb constructions such as “give a kiss”. These constructions consist of a semantically underspecified light verb (“give”) and an event nominal that contributes most of the meaning and also activates an argument structure of its own (“kiss”). This creates a mismatch between the syntactic constituents and the semantic roles of a sentence. Native speakers read German verb-final sentences that contained light verb constructions (e.g., “Julius gave Anne a kiss”), non-light constructions (e.g., “Julius gave Anne a rose”), and semantically anomalous constructions (e.g., *“Julius gave Anne a conversation”). ERPs were measured at the critical verb, which appeared after all its arguments. Compared to non-light constructions, the light verb constructions evoked a widely distributed, frontally focused, sustained negative-going effect between 500 and 900 ms after verb onset. We interpret this effect as reflecting working memory costs associated with complex semantic processes that establish a shared argument structure in the light verb constructions.

2013