ERP

2018

Kuperberg, G. R., Delaney-Busch, N., Fanucci, K., & Blackford, T. (2018). Priming Production: Neural evidence for enhanced automatic semantic activity immediately preceding language production in schizophrenia. NeuroImage:Clinical, 18, 74-85.

Introduction: Lexico-semantic disturbances are considered central to schizophrenia. Clinically, their clearest manifestation is in language production. However, most studies probing their underlying mechanisms have used comprehension or categorization tasks. Here, we probed automatic semantic activity prior to language production in schizophrenia using event-related potentials (ERPs). Methods: 19 people with schizophrenia and 16 demographically-matched healthy controls named target pictures that were very quickly preceded by masked prime words. To probe automatic semantic activity prior to production, we measured the N400 ERP component evoked by these targets. To determine the origin of any automatic semantic abnormalities, we manipulated the type of relationship between prime and target such that they overlapped in (a) their semantic features (semantically related, e.g. “cake” preceding a <picture of a pie>, (b) their initial phonemes (phonemically related, e.g. “stomach” preceding a <picture of a starfish>), or (c) both their semantic features and their orthographic/phonological word form (identity related, e.g. “socks” preceding a <picture of socks>). For each of these three types of relationship, the same targets were paired with unrelated prime words (counterbalanced across lists). We contrasted ERPs and naming times to each type of related target with its corresponding unrelated target.  Results: People with schizophrenia showed abnormal N400 modulation prior to naming identity related (versus unrelated) targets: whereas healthy control participants produced a smaller amplitude N400 to identity related than unrelated targets, patients showed the opposite pattern, producing a larger N400 to identity related than unrelated targets. This abnormality was specific to the identity related targets. Just like healthy control participants, people with schizophrenia produced a smaller N400 to semantically related than to unrelated targets, and showed no difference in the N400 evoked by phonemically related and unrelated targets. There were no differences between the two groups in the pattern of naming times across conditions. Conclusion: People with schizophrenia can show abnormal neural activity associated with automatic semantic processing prior to language production. The specificity of this abnormality to the identity related targets suggests that that, rather than arising from abnormalities of either semantic features or lexical form alone, it may stem from disruptions of mappings (connections) between the meanings of words and their form.

Kuperberg, G. R., Ditman, T., & Perrachione, A. C. (2018). When proactivity fails: An electrophysiological study of establishing reference in schizophrenia. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 3(1), 77-87.

Background: Schizophrenia is characterized by abnormalities in referential communication, which may be linked to more general deficits in proactive cognitive control. We used event-related potentials (ERPs) to probe the timing and nature of the neural mechanisms engaged as people with schizophrenia linked pronouns to their preceding referents during word-by-word sentence comprehension.Methods: We measured ERPs to pronouns in two-clause sentences from 16 people with schizophrenia and 20 demographically-matched control participants. Our design crossed the number of potential referents (1-referent, 2-referent) with whether the pronoun matched the gender of its preceding referent(s) (matching, mismatching). This gave rise to four conditions: (1) 1-referent matching (“…Edward took courses in accounting but he…”), (2) 2-referent matching (“…Edward and Phillip took courses but he…”), (3) 1-referent mismatching (“…Edward took courses in accounting but she…”), and (4) 2-referent mismatching (“…Edward and Phillip took courses but she…”).Results: Consistent with previous findings, healthy controls produced a larger left anteriorly-distributed negativity between 400-600ms to 2-referent matching than to 1-referent matching pronouns (the “Nref effect”). In contrast, people with schizophrenia produced a larger centro-posterior positivity effect between 600-800ms. Both patient and control groups produced a larger positivity between 400-800ms to mismatching than to matching pronouns.Conclusions: These findings suggest that proactive mechanisms of referential processing, reflected by the Nref effect, are impaired in schizophrenia, while reactive mechanisms, reflected by the positivity effects, are relatively spared. Indeed, patients may compensate for proactive deficits by retro-actively engaging with context to influence the processing of inputs at a later stage of analysis.

2017

The extent to which language processing involves prediction of upcoming inputs remains a question of ongoing debate. One important data point comes from DeLong et al. (2005) who reported that an N400-like event-related potential correlated with a probabilistic index of upcoming input. This result is often cited as evidence for gradient probabilistic prediction of form and/or semantics, prior to the bottom-up input becoming available. However, a recent multi-lab study reports a failure to find these effects (Nieuwland et al., 2017). We review the evidence from both studies, including differences in the design and analysis approach between them. Building on over a decade of research on prediction since DeLong et al. (2005)’s original study, we also begin to spell out the computational nature of predictive processes that one might expect to correlate with ERPs that are evoked by a functional element whose form is dependent on an upcoming predicted word. For paradigms with this type of design, we propose an index of anticipatory processing, Bayesian surprise, and apply it to the updating of semantic predictions. We motivate this index both theoretically and empirically. We show that, for studies of the type discussed here, Bayesian surprise can be closely approximated by another, more easily estimated information theoretic index, the surprisal (or Shannon information) of the input. We re-analyze the data from Nieuwland and colleagues using surprisal rather than raw probabilities as an index of prediction. We find that surprisal is gradiently correlated with the amplitude of the N400, even in the data shared by Nieuwland and colleagues. Taken together, our review suggests that the evidence from both studies is compatible with anticipatory semantic processing. We do, however, emphasize the need for future studies to further clarify the nature and degree of form prediction, as well as its neural signatures, during language comprehension.

2016

Fields, E. C., & Kuperberg, G. R. (2016). Dynamic Effects of Self-Relevance and Task on the Neural Processing of Emotional Words in Context. Frontiers in Psychology, 6, 2003. https://doi.org/10.3389/fpsyg.2015.02003

We used event-related potentials (ERPs) to examine the interactions between task, emotion, and contextual self-relevance on processing words in social vignettes. Participants read scenarios that were in either third person (other-relevant) or second person (self-relevant) and we recorded ERPs to a neutral, pleasant, or unpleasant critical word. In a previously reported study (Fields and Kuperberg, 2012) with these stimuli, participants were tasked with producing a third sentence continuing the scenario. We observed a larger LPC to emotional words than neutral words in both the self-relevant and other-relevant scenarios, but this effect was smaller in the self-relevant scenarios because the LPC was larger on the neutral words (i.e., a larger LPC to self-relevant than other-relevant neutral words). In the present work, participants simply answered comprehension questions that did not refer to the emotional aspects of the scenario. Here we observed quite a different pattern of interaction between self-relevance and emotion: the LPC was larger to emotional vs. neutral words in the self-relevant scenarios only, and there was no effect of self-relevance on neutral words. Taken together, these findings suggest that the LPC reflects a dynamic interaction between specific task demands, the emotional properties of a stimulus, and contextual self-relevance. We conclude by discussing implications and future directions for a functional theory of the emotional LPC.

Delaney-Busch, N., Wilkie, G., & Kuperberg, G. R. (2016). Vivid: How valence and arousal influence word processing under different task demands. Cognitive, Affective, & Behavioral Neuroscience, 16(3), 413-432.

In this study, we used event-related potentials to examine how different dimensions of emotion—valence and arousal—influence different stages of word processing under different task demands. In two experiments, two groups of participants viewed the same single emotional and neutral words while carrying out different tasks. In both experiments, valence (pleasant, unpleasant, and neutral) was fully crossed with arousal (high and low). We found that the task made a substantial contribution to how valence and arousal modulated the late positive complex (LPC), which is thought to reflect sustained evaluative processing (particularly of emotional stimuli). When participants performed a semantic categorization task in which emotion was not directly relevant to task performance, the LPC showed a larger amplitude for high-arousal than for low-arousal words, but no effect of valence. In contrast, when participants performed an overt valence categorization task, the LPC showed a large effect of valence (with unpleasant words eliciting the largest positivity), but no effect of arousal. These data show not only that valence and arousal act independently to influence word processing, but that their relative contributions to prolonged evaluative neural processes are strongly influenced by the situational demands (and by individual differences, as revealed in a subsequent analysis of subjective judgments).

2015

Fields, E. C., & Kuperberg, G. R. (2015). Loving yourself more than your neighbor: ERPs reveal online effects of a self-positivity bias. Social Cognitive and Affective Neuroscience, 10(9), 1202-9. https://doi.org/10.1093/scan/nsv004 (Original work published 2015)

A large body of social psychological research suggests that we think quite positively of ourselves, often unrealistically so. Research on this ’self-positivity bias’ has relied mainly on self-report and behavioral measures, but these can suffer from a number of problems including confounds that arise from the desire to present oneself well. What has not been clearly assessed is whether the self-positivity bias influences the processing of incoming information as it unfolds in real time. In this study, we used event-related potentials to address this question. Participants read two-sentence social vignettes that were either self- or other-relevant. Pleasant words in self-relevant contexts evoked a smaller negativity between 300 and 500 ms (the N400 time window) than the same words in other-relevant contexts, suggesting that comprehenders were more likely to expect positive information when a scenario referred to themselves. This finding indicates that the self-positivity bias is available online, acting as a general schema that directly influences real-time comprehension.

Xiang, M., & Kuperberg, G. R. (2015). Reversing expectations during discourse comprehension. Language, Cognition, and Neuroscience, 30(6), 648-672.

In two event-related potential experiments, we asked whether comprehenders used the concessive connective, even so, to predict upcoming events. Participants read coherent and incoherent scenarios, with and without even so, e.g. ‘Elizabeth had a history exam on Monday. She took the test and aced/failed it. (Even so), she went home and celebrated wildly’, as they rated coherence (Experiment 1) or simply answered intermittent comprehension questions (Experiment 2). The semantic function of even so was used to reverse real-world knowledge predictions, leading to an attenuated N400 to coherent versus incoherent target words (‘celebrated’). Moreover, its pragmatic communicative function enhanced predictive processing, leading to more N400 attenuation to coherent targets in scenarios with than without even so. This benefit however, did not come for free: the detection of failed event predictions triggered a later posterior positivity and/or an anterior negativity effect, and

2014

Cohn, N., Jackendoff, R., Holcomb, P. J., & Kuperberg, G. R. (2014). The grammar of visual narrative: Neural evidence for constituent structure in sequential image comprehension. Neuropsychologia, 64, 63-70. https://doi.org/10.1016/j.neuropsychologia.2014.09.018 (Original work published 2014)

Constituent structure has long been established as a central feature of human language. Analogous to how syntax organizes words in sentences, a narrative grammar organizes sequential images into hierarchic constituents. Here we show that the brain draws upon this constituent structure to comprehend wordless visual narratives. We recorded neural responses as participants viewed sequences of visual images (comics strips) in which blank images either disrupted individual narrative constituents or fell at natural constituent boundaries. A disruption of either the first or the second narrative constituent produced a left-lateralized anterior negativity effect between 500 and 700ms. Disruption of the second constituent also elicited a posteriorly-distributed positivity (P600) effect. These neural responses are similar to those associated with structural violations in language and music. These findings provide evidence that comprehenders use a narrative structure to comprehend visual sequences and that the brain engages similar neurocognitive mechanisms to build structure across multiple domains.

Wittenberg, E., Paczynski, M., Wiese, H., Jackendoff, R., & Kuperberg, G. R. (2014). The difference between “giving a rose” and “giving a kiss”: A sustained anterior negativity to the light verb construction. Journal of Memory and Language, 73, 31-42.

We used event-related potentials (ERPs) to investigate the neurocognitive mechanisms associated with processing light verb constructions such as “give a kiss”. These constructions consist of a semantically underspecified light verb (“give”) and an event nominal that contributes most of the meaning and also activates an argument structure of its own (“kiss”). This creates a mismatch between the syntactic constituents and the semantic roles of a sentence. Native speakers read German verb-final sentences that contained light verb constructions (e.g., “Julius gave Anne a kiss”), non-light constructions (e.g., “Julius gave Anne a rose”), and semantically anomalous constructions (e.g., *“Julius gave Anne a conversation”). ERPs were measured at the critical verb, which appeared after all its arguments. Compared to non-light constructions, the light verb constructions evoked a widely distributed, frontally focused, sustained negative-going effect between 500 and 900 ms after verb onset. We interpret this effect as reflecting working memory costs associated with complex semantic processes that establish a shared argument structure in the light verb constructions.

Paczynski, M., Jackendoff, R., & Kuperberg, G. R. (2014). When events change their nature: The neurocognitive mechanisms underlying aspectual coercion. The Journal of Cognitive Neuroscience, 29(9), 1905-17.

The verb “pounce” describes a single, near-instantaneous event. Yet, we easily understand that, “For several minutes the cat pounced…” describes a situation in which multiple pounces occurred, although this interpretation is not overtly specified by the sentence s syntactic structure or by any of its individual words—a phenomenon known as “aspectual coercion.” Previous psycholinguistic studies have reported processing costs in association with aspectual coercion, but the neurocognitive mechanisms giving rise to these costs remain contentious. Additionally, there is some controversy about whether readers commit to a full interpretation of the event when the aspectual information becomes available, or whether they leave it temporarily underspecified until later in the sentence. Using ERPs, we addressed these questions in a design that fully crossed context type (punctive, durative, frequentative) with verb type (punctive, durative). We found a late, sustained negativity to punctive verbs in durative contexts, but not in frequentative (e.g., explicitly iterative) contexts. This effect was distinct from the N400 in both its time course and scalp distribution, suggesting that it reflected a different underlying neurocognitive mechanism. We also found that ERPs to durative verbs were unaffected by context type. Together, our results provide strong evidence that neural activity associated with aspectual coercion is driven by the engagement of a morphosyntactically unrealized semantic operator rather than by violations of real-world knowledge, more general shifts in event representation, or event iterativity itself. More generally, our results add to a growing body of evidence that a set of late-onset sustained negativities reflect elaborative semantic processing that goes beyond simply combining the meaning of individual words with syntactic structure to arrive at a final representation of meaning.