Netherlands

Polysemy is pervasive in modern language and represents one key factor that allows for the unlimited expressive potential of human language. One important process of historical meaning extension is that of metaphor (Anderson 2017). Recently, the paradigm of Experimental Semiotics has been proposed as a novel methodology to investigate semantic change (Bowerman &amp; Smith 2022). In experimental semiotics, participants have to converge on a novel signalling system in the absence of a shared language. Here we adopt this approach to experimentally investigate the role of metaphor in meaning extensions. Specifically, we will present results of a study in which participants have to communicate about a novel meaning space in a referential communication game. Importantly, participants will only be able to use symbols for which they have previously established symbol-meaning mappings in a prior game. The results show to which degree participants make use of metaphor in in this task.

**Authors:**

Michael Pleyer: Nicolaus Copernicus University in Toruń; Darya Namednikava: Centre for Language Evolution Studies, Nicolaus Copernicus University ; Klaudia Karkowska: Nicolaus Copernicus University; Svetlana Kuleshova: Nicolaus Copernicus University in Torun; Marek Placiński: Nicolaus Copernicus University in Toruń; Slawomir Wacewicz: Nicolaus Copernicus University

CogSci 2024

An Experimental-Semiotic Approach to the Emergence of Metaphor and Polysemy in Interaction

The 46th Annual Meeting of the Cognitive Science Society was an in-person meeting held in Rotterdam, The Netherlands at the Postillion Hotel & Conference Centre.

**ON-DEMAND PROGRAM ACCESS AFTER THE CONFERENCE** 
Recordings of the invited program are now available. You can access them by clicking on the 'Schedule' icon on the left. Select view by week and navigate to the day and time slot of the recording you wish to view. Click on the time slot to access the recording.

Recordings available (click on each recording to view):

**Thursday, July 25** 
0900: [Keynote Speaker Morgan Barense on Enhancing real-world event memory](https://underline.io/events/465/sessions/17997/lecture/99084-dynamics-between-minds-and-the-environment) 
1000: [Gleitman Award Winner Isabelle Dautriche on Language Foundations: Insights from acquisition, communication, cognition, and more](https://underline.io/events/465/sessions/18000/lecture/99085-gleitman-talk) 
1415: [Invited Symposium: Dynamics between minds and the environment](https://underline.io/events/465/sessions?eventSessionId=18016&searchGroup=lecture) 
1700: [Rumelhart Prize Presentation Speaker Alison Gopnik on Exploit, explore, empower: Three ages and three intelligences](https://underline.io/events/465/sessions/18028/lecture/99161-rp1-rumelhart-prize-presentation) 

**Friday, July 26** 
0900: [C.L. de Carvalho-Heineken Prize Keynote Speaker Kia Nobre on Focusing in memory](https://underline.io/events/465/sessions/18035/lecture/99162-hp1-c-l-de-carvalho-heineken-prize-keynote-address) 
1030: [Rumelhart Symposium: Childhood as exploration](https://underline.io/events/465/sessions/18038/lecture/100346-childhood-as-exploration) 
1415: [Elman Prize Symposium](https://underline.io/events/465/sessions?eventSessionId=18053&searchGroup=lecture) 
1600: [Invited Symposium: Dynamics between minds](https://underline.io/events/465/sessions?eventSessionId=18065&searchGroup=lecture) 
1745: [Keynote Speaker Andrea E. Martin on Neural dynamics encode the structure and statistics of language](https://underline.io/events/465/sessions/18077/lecture/99271-neural-dynamics-encode-the-structure-and-statistics-of-language) 

**Saturday, July 27** 
0900: [Keynote Speaker Gregor Schöner on How higher cognition emerges from the dynamics of strongly interacting neural populations](https://underline.io/events/465/sessions/18083/lecture/99273-dynamics-within-the-mind) 
1000: [Glushko Talks](https://underline.io/events/465/sessions?eventSessionId=18086&searchGroup=lecture) 
1500: [Invited Symposium: Dynamics within minds](https://underline.io/events/465/sessions?eventSessionId=18100&searchGroup=lecture) 


#### **CogSci 2024 Program Book**
<div style="position:relative;padding-top:0;width:900px;height:500px;"><iframe style="position:absolute;border:none;width:100%;height:100%;left:0;top:0;" src="https://online.fliphtml5.com/ebtyf/cble/" seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe></div>


**The Program Book can be downloaded [here](https://drive.google.com/file/d/1yRVp1cBqRnAbdYi4GXWV_pZeyWNsRquv/view?usp=sharing).**

#### **Letter from the President**

Welcome to the 2024 Meeting of the Cognitive Science Society in Rotterdam! CogSci 2024 brings together a large community of cognitive scientists who have traveled here from around the world, as well as a smaller group of remote presenters. I would like to extend an especially warm welcome to our first-time CogSci meeting attendees, and hope that 
their experience inspires them to join our future meetings for many years to come.

I want to thank this year’s conference co-chairs, Larissa K Samuelson, Stefan Frank, Mariya Toneva, Allyson Mackey, and Eliot Hazeltine, for putting together an amazing series of invited talks and symposia around the theme of Dynamics of Cognition. The co-chairs also deserve credit for handling a record-breaking number of submissions and producing a truly exciting conference program 

Beyond the invited talks and symposia dedicated to this year’s conference theme, I would like to highlight the presentations and events honoring the 
Rumelhart, Elman, Gleitman and C .L . de Carvalho Heineken prize winners, including the Rumelhart reception on Thursday. As you may know, we are recording all of the invited talks and symposia, and all prize-winners’ talks, and will be making this content available after the conference. 

The Cognitive Science Society relies on the volunteer efforts of our Governing Board members who work on matters related to our membership; conference policies; diversity and inclusion, international, and outreach initiatives; prizes and much more. We welcome interest from Society members who would like to become more involved in what we do. The 
Society is deeply grateful to Rick Dale and Andrea Bender, who serve as editors of the two Society journals, Cognitive Science and Topics in Cognitive Science respectively. We especially acknowledge our editors’ generosity in donating their stipends each year to D&I and outreach efforts. 

This year’s Annual Meeting depends critically on the support of Marischal De Armond and his team at Podium Conference Specialists: Sharon Zwack, Cendrine De Vis, Sarah-Kate Burke, and Rachel Waller worked tirelessly to secure the venue and handled a multitude of logistical and organizational issues, from arranging coffee breaks and receptions to making sure that a huge number of posters fits comfortably into the available space. Finally, and importantly, I would like to acknowledge the Cognitive Science Society Executive Officer, Erica Wojcik, for managing the complex and ever expanding sphere of our Society’s activities.

I hope you enjoy this year’s meeting and the many different opportunities to engage with the vibrant community of cognitive scientists gathered here. I also hope you get a chance to explore the great city of Rotterdam with its many attractions, museums, restaurants and scenic views. If you’d like to talk more about our Society, or simply want to say hello, please stop by!

![](https://assets.underline.io/markdown_image/1/image/3c66d0e21fff30e204df1138ffd15173.jpeg)

**Anna Papafragou** 
President, Cognitive Science 
Society 2023-2024

**CODE OF CONDUCT** 
By attending the CogSci 2024 Conference, you are required to adhere to the society’s [Code of Conduct](https://drive.google.com/file/d/16-6KkptF0Gn3ZYGJDlpqpwTdImw45Ng0/view?usp=drive_link).

**ABOUT THE COGNITIVE SCIENCE SOCIETY** 
The Cognitive Science Society brings together researchers from around the world who hold a common goal: understanding the nature of the human mind. The mission of the Society is to promote Cognitive Science as a discipline, and to foster scientific interchange among researchers in various areas of study, including Artificial Intelligence, Linguistics, Anthropology, Psychology, Neuroscience, Philosophy, and Education.

The Society is a non-profit professional organization and its activities include sponsoring an annual conference and publishing the journals Cognitive Science and TopiCS.

You need to log in with the email address you registered with. Access credentials have been sent to your email. 

Please be sure to check your spam and other email folders if you do not see an email confirmation right away.

Please log in to explore this event.

It looks like you are not registered for this event. 

To access the site please register [**here**](https://cognitivesciencesociety.org/registration/). 

Please register!

The 46th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

Polysemy is pervasive in modern language and represents one key factor that allows for the unlimited expressive potential of human language. One important process of historical meaning extension is that of metaphor (Anderson 2017). Recently, the paradigm of Experimental Semiotics has been proposed as a novel methodology to investigate semantic change (Bowerman & Smith 2022). In experimental semiotics, participants have to converge on a novel signalling system in the absence of a shared language. Here we adopt this approach to experimentally investigate the role of metaphor in meaning extensions. Specifically, we will present results of a study in which participants have to communicate about a novel meaning space in a referential communication game. Importantly, participants will only be able to use symbols for which they have previously established symbol-meaning mappings in a prior game. The results show to which degree participants make use of metaphor in in this task.

**Authors:**

Michael Pleyer: Nicolaus Copernicus University in Toruń; Darya Namednikava: Centre for Language Evolution Studies, Nicolaus Copernicus University ; Klaudia Karkowska: Nicolaus Copernicus University; Svetlana Kuleshova: Nicolaus Copernicus University in Torun; Marek Placiński: Nicolaus Copernicus University in Toruń; Slawomir Wacewicz: Nicolaus Copernicus University

poster

Experiments in psycholinguistics allow us to test hypotheses and build theories. However, psycholinguistic experiments often suffer from low ecological validity, because participants are often required to perform an unusual task in the face of unusual materials. In the current experiment, we test the predictions of Noisy Channel Processing in a naturalistic task: identifying the lyrics of a song. We conducted an experiment where participants heard short excerpts from songs and then indicated which one out of four possible transcriptions they had heard. We found that the predictions of Noisy Channel Processing bear out: options with higher prior and likelihood were chosen more often by participants as the heard song lyrics. Thus, Noisy Channel Processing is successful in explaining the everyday phenomenon of misheard song lyrics. More broadly, this suggests that Noisy Channel Processing captures everyday language processing, and that it is not dependent on unnatural experimental tasks and materials.

**Authors:**

Moshe Poliak: MIT; Hannah Kimura: MIT; Edward Gibson: Massachusetts of Institute Technology

Mis-Heard Lyrics: an Ecologically-Valid Test of Noisy Channel Processing

This paper presents prevalence norms collected from a representative sample of Singapore English speakers for a set of 240 concepts unique to Singapore English. Prevalence refers to the proportion of people who know or recognize a particular concept. Because large-scale, diachronic language corpora are scarce for non-standard varieties of English, the present study aims to establish the collection of prevalence norms from a cross-sectional sample as a potential alternative for tracking changes in word usage patterns over time. Preliminary analyses indicate that lexical knowledge of Singapore English concepts differs across gender, age, and ethnic groups. In particular, while most concepts are generally well known, some concepts are better known by younger participants and others are better known by older participants. These results underline the dynamic nature of Singapore English vocabulary and demonstrate how simple psycholinguistic tasks could be used to study lexical change in under-resourced languages and varieties.

**Authors:**

Cynthia S.Q. Siew: National University of Singapore

Tracking Lexical Knowledge of Concepts Unique to Singapore English Among Speakers of Singapore English

We investigated the processing and interpretation of aspectual coercion in the case of non-culminating accomplishments in English and German, two languages which differ in interesting ways in their aspectual properties. Two offline experiments employing an inference rating task provide evidence that non-culminating accomplishments in both languages actually involve a shift in interpretation. Four self-paced reading experiments furthermore show that this type of coercion isn't costly - neither in German, a language lacking grammatical aspect, nor in English with an aspectual opposition between progressive and perfective simple past forms. This lack of online effect in processing coercion was obtained in a first pair experiments using adverbial modification (sentence-internally) within the verb phrase and in a second pair of experiments in which aspectual coercion was triggered in a subsequent discourse unit. Finding no processing difficulty is in line with previous results for this type of aspectual coercion in German, but is inconsistent with findings reported for English (Bott & Hamm, 2014). A final stops-making-sense experiment replicates the lack of effect for English and furthermore shows that the processing of non-culminating accomplishments does not incur a processing effect even in a task calling for immediate full interpretation. The present study thus adds to existing evidence that aspectual coercion does not necessarily incur processing costs (Pickering, McElree, Frisson, Chen &Traxler, 2006).

**Authors:**

Oliver Bott: Bielefeld University; Torgrim Solstad: Bielefeld University; Jens Michaelis: Bielefeld University

Processing non-culminating accomplishments across languages

This research explores the potential of machine learning (ML) in identifying vocal markers for schizophrenia. While previous research showed that voice-based ML models can accurately predict schizophrenia diagnosis and symptoms, it is unclear to what extent such ML markers generalize to different clinical subpopulations and languages: the assessment of generalization performance is however crucial for testing their clinical applicability.
We systematically examined voice-based ML model performance on a large cross-linguistic dataset (3 languages: Danish, German, Chinese). Employing a rigorous pipeline to minimize overfitting, including cross-validated training sets and multilingual models, we assessed generalization on participants with schizophrenia and controls speaking the same or different languages. Model performance was comparable to state-of-the art findings (F1-score ~ 0.75) within the same language; however, models did not generalize well - showing a substantial decrease - when tested on new languages, and the performance of multilingual models was also generally low (F1-score ~ 0.50).

**Authors:**

Alberto Parola: Copenhagen University; Astrid Rybner: Aarhus University; Emil Trenckner Jessen: Aarhus University; Stine Nyhus Larsen: Aarhus University; Marie Damsgaard Mortensen: Aarhus University; Arndis Simonsen: Aarhus University; Yuan Zhou: Chinese Academy of Sciences; Katja Koelkebeck: Hospital and Institute of the University of Duisburg-Essen; Vibeke Bliksted: Aarhus University; Riccardo Fusaroli: Aarhus University

Voice markers of schizophrenia: assessing the generalizability of machine learning models and their clinical applicability

Most Chinese words are compounds formed through the combination of meaningful characters. Yet, due to compositional complexity, it is poorly understood how this compositional process would affect the access to the whole-word meaning. In the present study, we turned to the recent development in compositional distributional semantics (Marelli et al., 2017), and employed a deep neural network to learn the less-than-systematic relationship between the constituent characters and the compound words. Based on the composed representations as derived from the computational model, we quantified the extent to which the compound meaning can be predicted by nonlinearly combining the constituent meanings, i.e., the degree to which the characters could provide reliable information to access the compound meaning. We observed the effect of compositionality, as operationalized by the computed metrics, on compound recognition, over and above the effects of constituent character properties and compound properties. More importantly, we found that this effect was increasingly stronger when holistic access to the compound meaning became more challenging. These findings therefore, from a computational perspective, provided new evidence for the compositional process involved in Chinese word recognition, which also shed light on the universal process of compound comprehension.

**Authors:**

Tianqi Wang: The University of Hong Kong; Xu Xu: Shanghai Jiao Tong University

Composition as nonlinear combination in semantic space: Exploring the effect of compositionality on Chinese compound recognition

People sometimes explicitly announce that they are being sarcastic. The announcement appears to be particularly common in text-based conversations where prosodic cues are more difficult to identify. In certain cases, the tone of a comment is sufficient to determine non-literal meaning. But what happens in the absence of these features, or when context forces us to explicitly caveat our sarcasm? In this study, we examine Reddit comments from \texttt{r/AskReddit} to see the features that are present in comments tagged with \say{/s}, a convention on the platform for users to denote sarcasm. We found that a host of cues which mimic prosody, and other aspects of figures of speech, were inconsistent predictors of announced sarcasm. In contrast, when talking about sociomoral topics such as politics or race, users were more likely to tag their comments with \say{/s}. This suggests that we are more likely to announce sarcasm in text-based conversations where misinterpretation would be detrimental.

**Authors:**

Joshua Hew: University of Edinburgh; Aida Tarighat: University of Edinburgh; Martin Corley: University of Edinburgh; Zachary Horne: University of Edinburgh

Examining structural and semantic predictors of announced sarcasm on r/AskReddit

Extensive evidence from diverse areas of the cognitive sciences suggests that iconicity—the resemblance between form and its meaning—is pervasive and plays a pivotal role in the processing, memory, and evolution of human language. However, despite its acknowledged importance, iconicity in language models remains notably underexplored. This paper examines whether language models learn iconic associations between shape and sound, known as the bouba/kiki (or maluma/takete) effect, which has been widely observed in human language as well as English and multilingual vision-and-language models, including Finnish, Indonesian, Hungarian, and Lithuanian models in previous studies, using Japanese models. A comparison between the current results and the previous studies revealed that Japanese models learn language-specific aspects of iconicity, such as the associations between /p/ and roundness, and /ɡ/ and hardness, reflecting sound symbolic system in Japanese.

**Authors:**

Hinano Iida: Nagoya University; Hayate Funakura: Kyoto University

Investigating Iconicity in Vision-and-Language Models: A Case Study of the Bouba/Kiki Effect in Japanese Models

Spatial cognition and spatial language are a core site for diversity, both within and across language communities. For instance, when describing motion events, speakers through speech and gesture may anchor information either (egocentrically) to their body or (allocentrically) to geographical landmarks in the environment. Here we investigate whether the use of such egocentric versus allocentric frames of reference in co-speech gesture indeed depends on both bodily and environmental axes. In a real-world experiment, members from the traditionally allocentric Balinese community were shown small-scale motion events and asked to retell them. To evaluate the potential influence of both types of axes on gestural frame of reference use, in a 2x2 between-participant design they were assigned to conditions that contrasted the body-anchored axis the motion events unfolded on with the underlying geographical environment-anchored axis. It was observed that the type of body-anchored axis significantly predicted frame of reference representation in participants’ gestures, consistent with previous research. The type of environment-anchored axes, however, did not affect characteristics of participants’ gestures. These findings advance our understanding of the intricate interplay between language, space, culture, and environment.

**Authors:**

Danielle Naegeli: Tilburg University; David Peeters: Tilburg University; Emiel Krahmer: Tilburg University; Marieke Schouwstra: University of Amsterdam; Made Sri Satyawati: Universitas Udayana; Connie De Vos: Tilburg University

Use of spatial reference frames for motion events in Balinese co-speech gesture

Children’s spatial and numerical skills are highly related, and predictive of concurrent and future mathematical ability (Lourenco et al., 2018). The number line estimation (NLE) task, in which children indicate the spatial positions of numbers on a line, is a commonly used index of spatial-numerical ability. Critically, training studies have demonstrated a causal link between NLE and math ability (Ramani & Siegler, 2008). Nonetheless, there is extensive debate about the role of numerical and domain-general abilities in the NLE task. Here, we used fMRI with young children to assess the neural mechanisms supporting NLE performance. Whole-brain and ROI analyses yielded significant activation in bilateral intraparietal sulcus (IPS) during the NLE task, relative to matched control conditions. Moreover, we found a positive association between neural maturity in bilateral IPS during the NLE task and behavioral measures of math ability (Cantlon & Li, 2013), controlling for analogical reasoning and spatial working memory.

**Authors:**

Lauren Aulet: Carnegie Mellon University; Caroline Kaicher: Carnegie Mellon University; Jessica Cantlon: Carnegie Mellon

Converging neural evidence for number-specific mechanisms supporting number line estimation

Success in competitive matches hinges on psychological and mental preparations, such as strategic decision and emotional control. Although relevant cognitive functions and corresponding neural activity have been reported in a simple short-term laboratory task, the contribution of neural activity to the outcome of a more complex and prolonged match-format task has not been examined. Therefore, we focused on esports players engaged in a fighting video game (FVG). We examined the association between electroencephalography results in the pre-round of FVGs and consequences of the rounds. The results showed that parietal beta and frontal alpha/gamma activities are associated with winning and losing, respectively, depending on the match’s situation. Furthermore, parietal beta activity exhibited approximately 80% accuracy in win-loss predictions using machine learning. Our findings suggest that the performance of skilled video game players is influenced by psychological and mental preparations with fluctuations in neural oscillations.

**Authors:**

Sorato Minami: Kashino Diverse Brain Research Laboratory, NTT Communication Science Laboratories; Ken Watanabe: WASEDA University; Naoki Saijo: NTT Communication Science Laboratories; Makio Kashino: NTT Communication Science Laboratories

Best brain conditions for winning an esports competition: Electroencephalography amplitude in the frontal and parietal cortices associated with esports competition results

Premium content

Downloads

Next from CogSci 2024

Mis-Heard Lyrics: an Ecologically-Valid Test of Noisy Channel Processing

Similar lecture

The relationship between non-verbal alignment and cooperativeness in a game theory-based TV show