CogSci 2025

•

August 01, 2025

•

San Francisco, United States

keywords:

predictive processing

language comprehension

linguistics

Surprisal theory holds that the processing difficulty of a word is determined by its predictability in context (Hale, 2001; Levy, 2008). However, memory limitations hinder the integration of the full context, as evidenced by dependency locality effects (Gibson 1998). We propose that the local context for predictive processing may be established by cortical tracking of perceptual chunks, which are periodically occurring linguistic units (Giraud & Poeppel, 2012). We identified perceptual chunks in 97 extracts of natural speech using behavioural data. For each word, we derived surprisal values from GPT-2 based on three contexts: the full extract, the current perceptual chunk, and the previous three words. Surprisal conditioned on the chunk context was higher than on the full extract but lower than on the previous three words. This suggests that perceptual chunking may offer an optimal window for predictive processing within working memory capacity.

Downloads

Paper

Next from CogSci 2025

Ensemble Physics: Perceiving the Mass of Groups of Objects is More Than the Sum of Its Parts
poster

Ensemble Physics: Perceiving the Mass of Groups of Objects is More Than the Sum of Its Parts

CogSci 2025

Vivian C. Paulun
+1
Vicente Vivanco and 3 other authors

01 August 2025

Similar lecture

Testing the Predictions of Surprisal Theory in 11 Languages
poster

Testing the Predictions of Surprisal Theory in 11 Languages

EMNLP 2023

Ryan Cotterell
Roger Levy
+2
Cui Ding and 4 other authors

08 December 2023