Canada

Several popular sequence-based and pretrained language models have been found to be successful for text-driven prediction of brain activations. However, these models still lack long-term cognitive plausibility as well as insights on the underlying neural substrate mechanisms. This paper studies the influence of context representations of different language models such as sequence-based models: Long short-term memory networks (LSTMs) and ELMo, and popular pretrained Transformer language model (Longformer). In particular, we study how the internal hidden representations align with the brain activity observed via fMRI when the subjects listen to several narrative stories. We use brain imaging recordings of subjects listening to narrative stories to interpret word and sequence embeddings. We further investigate how the representations of language models layers reveal better semantic context during listening. Experiments across all language model representations provide the following cognitive insights: (i) the representations of LSTM cell states are better aligned with brain recordings than LSTM (hidden state), the cell state activity can represent more long-term information, (ii) the representations of ELMo and Longformer display a good predictive performance across brain regions for listening stimuli; (iii) Posterior Medial Cortex (PMC), Temporo-Parieto-Occipital junction (TPOJ), and Dorsal Frontal Lobe (DFL) have higher correlation versus Early Auditory (EAC) and Auditory Association Cortex (AAC).

CogSci 2022

Long-Term Plausibility of Language Models and Neural Dynamics during Narrative Listening

## Welcome to NAACL 2022!
The Annual Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL) is taking place July 10-15, 2022 as a hybrid event, in Seattle, WA and online. We are happy to welcome all of you to conference! 
 
The main conference program features oral presentations, in-person and virtual posters and demo sessions, a plenary session for our best paper presentations and awards, keynote presentations, a plenary panel on the place of linguistics and symbolic structures in NLP, and an Industrial Track panel on Careers in NLP.
 
Posters (including Findings of NAACL 2022) and demos are grouped by areas for both the in-person and the virtual sessions. For the virtual component, the talks will be on Zoom and the posters and the demos will be in GatherTown. The Student Research Workshop and will have an oral session and a poster session.
 
The program also features 6 Tutorials and 26 Workshops.
 
 We wish you a wonderful conference!
 
[The NAACL 2022 Organizing Committee](https://2022.naacl.org/committees/organization/)

NAACL 2022

2022 Annual Conference of the North American Chapter of the Association for Computational Linguistics

technical paper

Join us for CogSci2022! Our 44th Annual Conference will be centered around the theme of diversity, with an accompanying range of keynotes and invited speakers who themselves highlight the diversity of our field. Our three symposia are Cognition across Diverse Populations, Cognition within Diverse Societies, and Global Challenges for Cognitive Science. The conference is being offered in a fully hybrid environment for onsite and online attendees.
 
 [**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2022/07/Cogsci-2022-PAAG-Detailed-July-12final-1.pdf)
 [**The Detailed Program can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2022/08/DeArmond-CogSci2022-program-v113-final.pdf)

This conference requires a registration to attend. Please use the link below to secure your ticket. The website will be available to all registered attendees on July 25th. 

[Register to Attend](https://cognitivesciencesociety.org/registration/)

Registration Is Required

The 44th Annual Meeting of the Cognitive Science Society highlighted research on the theme Cognitive Diversity in addition to the full breadth and diversity of research topics offered by the society’s membership. 





Intuitive explanations for natural phenomena are typically our default explanations, even after we have learned more accurate, scientific explanations (Shtulman & Valcarcel, 2012). The current study examined whether priming students with scientific images improves their ability to verify counterintuitive scientific statements, like “bacteria need nutrients” and “bubbles have weight.” Participants (100 college undergraduates) verified scientific statements interspersed with images relevant to the predicates of those statements; the images depicted either schematic diagrams (scientific primes) or everyday scenes (intuitive primes). Scientific primes increased the accuracy of participants’ responses, relative to intuitive primes, but not the speed of those responses, indicating that scientific primes facilitate a preference for scientific ideas over intuitive ones but do not eliminate the initial conflict between them.

Priming Counterintuitive Scientific Ideas

Sequential learning in artificial neural networks is known to trigger catastrophic interference (CI), where previously learned skills are forgotten after learning new skills. This is in direct contrast to humans’ ability to learn increasingly complex skills across the lifespan without major instances of CI. The present work builds on techniques for mitigating CI that have been proposed in prior work. Anderson and Schooler (1991) first documented that the memory environment has a lawful structure. Following from their observation, we constructed a training environment where previously mastered tasks (Boolean functions) decrease in frequency over time according to a power law. It was predicted that training in this environment would (1) mitigate CI, (2) replicate human performance in learning curves following a power law of practice, and (3) promote positive transfer of training to new skills, all without the need to posit additional mechanisms. The present results support all three predictions.

Catastrophic interference in neural network models is mitigated when the training data reflect a power-law environmental structure

Research shows the existence of a small-number system (~1-3) invoking parallel individuation, and a large-number system (~4+) based on Weberian magnitude estimation. A 128-channel EEG system was used to investigate ERPs while participants detected numerical changes in dot arrays during an oddball task.
During “No Change” trials, the N170 over the parietal-occipital-temporal areas showed distinct waveforms to the habituation of small (but not large) numbers, indicating that more items encoded in working memory leads to stronger N170 amplitudes. We also observed decreased accuracy for increasing vs. decreasing changes in magnitude.
Converging over the mid-parietal area (Pz), lower P3b amplitudes were observed for harder, numerically-larger conditions, while Increasing-Large changes showed longer reaction times compared to Decreasing-Large.
Our findings suggest a neurobehavioral differentiation in perceiving small vs. large numbers and increasing vs. decreasing change at early stages of processing, and a later stage that involves higher-order numerical processing linked to context-updating.

The Neurobehavioral Basis of Parallel Individuation and Numerical Approximation

Research shows that participants predict their memory performance to be lower when they experience disfluencies during encoding, even though encoding disfluency does not always affect actual memory performance. Bizarre statements are typically encoded slower than common statements, which constitutes an example of an encoding disfluency. The current study investigated how disfluencies during encoding for bizarre and common statements affect actual and predicted memory performance from a metacognitive perspective. Across two experiments under intentional learning instructions, participants made either memory predictions or vividness ratings for bizarre and common statements, followed by a free recall task. Participants predicted to remember common statements more than bizarre statements for both Experiment 1 (self-paced encoding) and Experiment 2 (experimenter-paced encoding), even though the actual memory performance was higher for bizarre than common statements. This demonstrates a metacognitive illusion for the bizarreness effect, similar to other manipulations of encoding disfluency.

Bizarreness Effect and Its Relation to Memory and Metamemory

The new Sans Forgetica (SF) typeface was designed to promote desirable difficulty. Here, we investigate whether SF improves memory for words with within-subject designs. Participants studied words in Arial and SF (Exp 1 and 2) and completed old-new recognition tests where words retained their study fonts (Exp 1) or were in either Arial or SF (Exp 2). They had significantly better recognition (hit rate) in SF than in Arial (Exp 1) and significantly higher sensitivity indexes (d’) when words were tested in SF than in Arial (Exp 2). While encouraging, further examination of these results (e.g., response bias) suggest a less straightforward interpretation. Thus, we have reservations for the effectiveness and use of SF for improving word memory.

Does Sans Forgetica font facilitate word memory?

Making judgments of learning (JOLs) can sometimes directly modify subsequent memory, which is termed JOL reactivity. To explain this phenomenon, the changed-goal hypothesis posits that JOLs increase participants’ awareness of differences in item difficulties and prompt them to focus more on easier items at the cost of harder items. The cue-strengthening hypothesis states that making JOLs enhances cues that inform JOLs and benefits memory performance if memory tests are sensitive to those cues. In Experiment 1, we found that immediate JOLs produced positive reactivity for related word pairs but prestudy JOLs did not, although both types of JOLs signaled differences in item difficulty. In Experiment 2, we manipulated target-target relatedness between consecutive word pairs and administered either free or associative recall tests. Only list-level but not item-level JOLs produced positive reactivity for target-target related pairs with free recall. Thus, both experiments support the cue-strengthening hypothesis more than the changed-goal hypothesis.

Changed-goal or cue-strengthening? An investigation into the underlying mechanisms of judgment of learning reactivity

Studying false recognition is highly important not only in furthering our general understanding of memory but also in applied situations like eyewitness testimony. The Deese Roediger McDermott (DRM) paradigm, utilizing study lists of words all semantically related to a theme word that is not actually presented, has been shown to be highly likely to produce false recognition of the theme word (critical lure) at test (Roediger & McDermott, 1995). Prior studies have aimed to combat this error by providing feedback, however the feedback provided was either delayed or only given for errors to the critical lure. Our study provides immediate feedback for every memory judgment given in a DRM recognition task, allowing subjects to evaluate their active memory traces. The results suggest that immediate feedback (compared to delayed) is more effective at reducing false recognitions, possibly due to a learned reliance on memory features that are diagnostic of true memories.

Immediate Feedback Decreases False Recognition in the DRM Paradigm

Failing to come up with a word or name is a fairly common experience that is exacerbated in older adulthood and among populations with language impairments, and yet the mechanisms underlying lexical retrieval remain fairly understudied. In this work, we introduce and evaluate a series of nested computational models of lexical retrieval that combine semantic representations derived from a distributional semantic model with a process model to account for behavioral performance in a primed lexical retrieval task. The models were tested on a behavioral data set where participants attempted to retrieve answers to descriptions of low-frequency words and were provided a semantically and/or phonologically related prime word before the retrieval attempt. Model comparisons indicated that a model that emphasized semantic activations from the description and phonological activations from the prime word best accounted for the overall data. Additionally, incorrect responses and metacognitive judgments indicating that participants had other words in mind were associated with models that instead emphasized semantic activations from the prime word. Taken together, these results identify the locus of lexical retrieval failures and offer the opportunity to investigate broader questions about semantic memory retrieval.

Finding the right words: A computational model of cued lexical retrieval

The MINERVA 2 (Hintzman, 1984) model of human memory has been used to simulate a variety of cognitive phenomena. These simulations, however, describe cogni-tive phenomena at Marr’s (1982) representation/algorithm level, with little effort to link the core assumptions of the model to an underlying neural implementation (however, see Kelly et al., 2017). This article describes a possible neural implementation of MINERVA 2—one that is sim-ple and arguably biologically plausible. This implementa-tion suggests a novel method for generating response la-tencies and provides a concrete example to support Marr’s claim that the representations and algorithms that mediate human performance in a variety of different cognitive tasks (e.g., decision making; Dougherty, Gettys, & Ogden, 1999) can be investigated and simulated without reference to their underlying neural implementation.

Premium content

Downloads

Next from CogSci 2022

Priming Counterintuitive Scientific Ideas

Similar lecture

Neural Language Taskonomy: Which NLP Tasks are the most Predictive of fMRI Brain Activity?