United States

There is an apparent discrepancy between visual perception, which is colorful, complete, and in high resolution, and the saccadic, and spatially heterogeneous retinal input data. In this work, we computationally emulated foveated color maps and intensity channels as well as intra-saccadic motion data using a neuromorphic event camera. We used a convolutional neural network, U-Net, and adversarial optimization to demonstrate how retinal inputs can be used for the reconstruction of colorful images in high resolution. Our model may set the groundwork toward the development of biologically plausible neural networks for computational vision perception.

CogSci 2023

Perceptual colorization of the peripheral retinotopic visual field using adversarially-optimized neural networks

The 46th Annual Meeting of the Cognitive Science Society was an in-person meeting held in Rotterdam, The Netherlands at the Postillion Hotel & Conference Centre.

**ON-DEMAND PROGRAM ACCESS AFTER THE CONFERENCE**<br>
Recordings of the invited program are now available. You can access them by clicking on the 'Schedule' icon on the left. Select view by week and navigate to the day and time slot of the recording you wish to view. Click on the time slot to access the recording.

Recordings available (click on each recording to view):

**Thursday, July 25**<br>
0900: [Keynote Speaker Morgan Barense on Enhancing real-world event memory](https://underline.io/events/465/sessions/17997/lecture/99084-dynamics-between-minds-and-the-environment)<br>
1000: [Gleitman Award Winner Isabelle Dautriche on Language Foundations: Insights from acquisition, communication, cognition, and more](https://underline.io/events/465/sessions/18000/lecture/99085-gleitman-talk)<br>
1415: [Invited Symposium: Dynamics between minds and the environment](https://underline.io/events/465/sessions?eventSessionId=18016&searchGroup=lecture)<br>
1700: [Rumelhart Prize Presentation Speaker Alison Gopnik on Exploit, explore, empower: Three ages and three intelligences](https://underline.io/events/465/sessions/18028/lecture/99161-rp1-rumelhart-prize-presentation)<br>

**Friday, July 26**<br>
0900: [C.L. de Carvalho-Heineken Prize Keynote Speaker Kia Nobre on Focusing in memory](https://underline.io/events/465/sessions/18035/lecture/99162-hp1-c-l-de-carvalho-heineken-prize-keynote-address)<br>
1030: [Rumelhart Symposium: Childhood as exploration](https://underline.io/events/465/sessions/18038/lecture/100346-childhood-as-exploration)<br>
1415: [Elman Prize Symposium](https://underline.io/events/465/sessions?eventSessionId=18053&searchGroup=lecture)<br>
1600: [Invited Symposium: Dynamics between minds](https://underline.io/events/465/sessions?eventSessionId=18065&searchGroup=lecture)<br>
1745: [Keynote Speaker Andrea E. Martin on Neural dynamics encode the structure and statistics of language](https://underline.io/events/465/sessions/18077/lecture/99271-neural-dynamics-encode-the-structure-and-statistics-of-language)<br>

**Saturday, July 27**<br>
0900: [Keynote Speaker Gregor Schöner on How higher cognition emerges from the dynamics of strongly interacting neural populations](https://underline.io/events/465/sessions/18083/lecture/99273-dynamics-within-the-mind)<br>
1000: [Glushko Talks](https://underline.io/events/465/sessions?eventSessionId=18086&searchGroup=lecture)<br>
1500: [Invited Symposium: Dynamics within minds](https://underline.io/events/465/sessions?eventSessionId=18100&searchGroup=lecture)<br>


#### **CogSci 2024 Program Book**
<div style="position:relative;padding-top:0;width:900px;height:500px;"><iframe style="position:absolute;border:none;width:100%;height:100%;left:0;top:0;" src="https://online.fliphtml5.com/ebtyf/cble/"  seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe></div>


**The Program Book can be downloaded [here](https://drive.google.com/file/d/1yRVp1cBqRnAbdYi4GXWV_pZeyWNsRquv/view?usp=sharing).**

#### **Letter from the President**

Welcome to the 2024 Meeting of the Cognitive Science Society in Rotterdam! CogSci 2024 brings together a large community of cognitive scientists who have traveled here from around the world, as well as a smaller group of remote presenters. I would like to extend an especially warm welcome to our first-time CogSci meeting attendees, and hope that 
their experience inspires them to join our future meetings for many years to come.

I want to thank this year’s conference co-chairs, Larissa K Samuelson, Stefan Frank, Mariya Toneva, Allyson Mackey, and Eliot Hazeltine, for putting together an amazing series of invited talks and symposia around the theme of Dynamics of Cognition. The co-chairs also deserve credit for handling a record-breaking number of submissions and producing a truly exciting conference program 

Beyond the invited talks and symposia dedicated to this year’s conference theme, I would like to highlight the presentations and events honoring the 
Rumelhart, Elman, Gleitman and C .L . de Carvalho Heineken prize winners, including the Rumelhart reception on Thursday. As you may know, we are recording all of the invited talks and symposia, and all prize-winners’ talks, and will be making this content available after the conference. 

The Cognitive Science Society relies on the volunteer efforts of our Governing Board members who work on matters related to our membership; conference policies; diversity and inclusion, international, and outreach initiatives; prizes and much more. We welcome interest from Society members who would like to become more involved in what we do. The 
Society is deeply grateful to Rick Dale and Andrea Bender, who serve as editors of the two Society journals, Cognitive Science and Topics in Cognitive Science respectively. We especially acknowledge our editors’ generosity in donating their stipends each year to D&I and outreach efforts. 

This year’s Annual Meeting depends critically on the support of Marischal De Armond and his team at Podium Conference Specialists: Sharon Zwack, Cendrine De Vis, Sarah-Kate Burke, and Rachel Waller worked tirelessly to secure the venue and handled a multitude of logistical and organizational issues, from arranging coffee breaks and receptions to making sure that a huge number of posters fits comfortably into the available space. Finally, and importantly, I would like to acknowledge the Cognitive Science Society Executive Officer, Erica Wojcik, for managing the complex and ever expanding sphere of our Society’s activities.

I hope you enjoy this year’s meeting and the many different opportunities to engage with the vibrant community of cognitive scientists gathered here. I also hope you get a chance to explore the great city of Rotterdam with its many attractions, museums, restaurants and scenic views. If you’d like to talk more about our Society, or simply want to say hello, please stop by!

![](https://assets.underline.io/markdown_image/1/image/3c66d0e21fff30e204df1138ffd15173.jpeg)

**Anna Papafragou**  
President, Cognitive Science 
Society 2023-2024

**CODE OF CONDUCT**<br>
By attending the CogSci 2024 Conference, you are required to adhere to the society’s [Code of Conduct](https://drive.google.com/file/d/16-6KkptF0Gn3ZYGJDlpqpwTdImw45Ng0/view?usp=drive_link).

**ABOUT THE COGNITIVE SCIENCE SOCIETY**<br>
The Cognitive Science Society brings together researchers from around the world who hold a common goal: understanding the nature of the human mind. The mission of the Society is to promote Cognitive Science as a discipline, and to foster scientific interchange among researchers in various areas of study, including Artificial Intelligence, Linguistics, Anthropology, Psychology, Neuroscience, Philosophy, and Education.

The Society is a non-profit professional organization and its activities include sponsoring an annual conference and publishing the journals Cognitive Science and TopiCS.
<br><br>

You need to log in with the email address you registered with. Access credentials have been sent to your email. 

Please be sure to check your spam and other email folders if you do not see an email confirmation right away.

Please log in to explore this event.

It looks like you are not registered for this event. 

To access the site please register [**here**](https://cognitivesciencesociety.org/registration/). 

Please register!

CogSci 2024

The 46th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

poster

The 45th Annual Meeting of the Cognitive Science Society will take place in Sydney, Australia as a modified hybrid conference. Presentations from the main-session room will be live-streamed every day for all events. This will include all invited talks and award sessions. Recordings of all CogSci 2023 sessions will be made available for on-demand viewing after the conference.<br>
The in-person component will be held at the International Convention Centre Sydney at Darling Harbour. The Conference will take place Wednesday July 26th – Saturday July 29th, 2023 (Wednesday, July 26th is the Workshops Day).

Join us!

<br>[**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2023/07/COgSci-PAAG-V2.pdf)
<br>[**The Detailed Program can be found here**](https://online.fliphtml5.com/ebtyf/mswz/)
<br><br>

#### **CogSci 2023 Program Book**
<iframe style="width:700px;height:400px" src="https://online.fliphtml5.com/ebtyf/tzgk/"  seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe>
<br>

The 45th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

Deep convolutional neural networks (DCNNs) have been found to demonstrate hierarchical mapping to human brain regions on tasks such as object recognition. However, it remains unclear if such hierarchical mapping also applies to action recognition, which involves dynamic visual information processing. Here, we compared action representations of two-stream DCNNs to the human visual system. Five visual areas that are associated with object and action processing were selected. Nine human action categories were adopted from three semantic classes to examine the action representations of both DCNNs and human visual areas. In two fMRI experiments, actions were presented in the forms of Maya-rendered videos and point-light biological motion videos. Results showed that although two-stream DCNNs demonstrated hierarchical representations of actions as layers grow deeper, DCNNs lack a hierarchical mapping to human visual areas. Consistently across different video displays and DCNN pathways, only the top DCNN layers demonstrated high similarity to representations in the human visual system. The results suggest that the dynamic representations of human actions may be different in DCNNs compared to the human visual system, even after big-data training.

Mapping between the Human Visual System and Two-stream DCNNs in Action Representation

It has been argued that semantic systems reflect pressure for efficiency, and a current debate concerns the cultural evolutionary process that produces this pattern. We consider efficiency as instantiated in the Information Bottleneck (IB) principle, and a model of cultural evolution that combines iterated learning and communication. We show that this model, instantiated in neural networks, converges to color naming systems that are efficient in the IB sense and similar to human color naming systems. We also show that iterated learning alone, and communication alone, do not yield the same outcome as clearly.

Iterated learning explains aspects of color naming beyond those explained by efficiency

How do humans get better at planning? Previous work postulated that the improvement of cognitive strategies occurs through feedback-based metacognitive reinforcement learning (MCRL). However, it is not clear whether and, if so, how people can learn planning strategies without reinforcement. To answer these questions, we experimentally investigated the effect of frequency of feedback on people's ability to learn adaptive planning strategies. We found that participants receiving feedback only 25\% of the time nonetheless learned about as well as participants receiving constant feedback. Quantitative modelling of the data revealed that state-of-the-art MCRL models cannot explain this finding. However, extending these models by a mechanism generating an additional learning signal through self-evaluation of plan quality can account for people's ability to learn planning strategies without feedback. The findings of this research have implications for the design of learning environments and enabling people and machines to self-sufficiently improve their strategies in naturalistic settings.

Learning planning strategies without feedback

In psychology, simple tasks that are designed to tap a particular feature of cognition are used without considering the other mechanisms that might be at play. For example, the delayed-match-to-sample (DMTS) task is often used to examine short-term memory; however, there are a number of cognitive mechanisms interacting to produce the observed behaviour, such as decision-making and attention processes. As these simple tasks form the basis of more complex psychological experiments and theories, it is critical to understand what strategies might be producing the recorded behaviour. The current paper seeks to extend the GEMS methodology, a system that generates models of cognition using genetic programming, for differing DMTS experimental conditions. This allows us to investigate the strategies that participants might be using, while looking at differences in strategy depending on task variations. We also discuss possible weaknesses with the methodology.

Genetic Programming for Developing Simple Cognitive Models

Neural Probabilistic Learner and Sampler (NPLS) is an algorithm
that has simulated children’s non-symbolic probability
learning from visual stimuli such as collections of different
colors of marbles. Although NPLS closely simulates the
cognitive process of probability learning, the training of such
learning algorithms often uses binary encoding of inputs that
represent the perceived visual stimuli, avoiding simulation of
the visual perception of the stimuli. Here, the computer vision
technique You Only Look Once (YOLO) (Jocher et al.,
2021; Redmon et al., 2016), is integrated into the workflow
of an NPLS simulation probability learning experiments with
children. YOLO is a convolutional neural network (CNN) designed
to detect objects. The model’s performance on marble
datasets is tested through an analysis of precision and recall.
Results indicate that the YOLO model, when trained sufficiently,
outputs predictions on marble image datasets with high
accuracy and precision. We also analyze YOLO’s suitability as
a biologically plausible model of visual processing, interfering
with YOLO’s training process by shortening the training time
to examine the effects of perceptual errors on simulated probabilistic
reasoning.


A Perceptual Front-End for Probability Learning: Object Detection with YOLO

Autonomy support is an interpersonal tone of support and understanding. Teachers' instructional behaviors with autonomy support facilitate students' inner motivational resources and enhance their engagement in learning activities. Identifying these behaviors is vital in terms of teaching effects on students' academic performance and behaviors. However, existing methods heavily rely on psychological questionnaires or observers, which are time consuming and difficult to apply in large scale teaching scenarios. In this work, we combine deep neural networks with psychology to achieve automatically identifying the behaviors. To this end, we create the first Chinese instructional behavior dataset for deep learning, and then construct a BERT-based network for modeling psychological features and identifying behaviors. Since frequencies of different behaviors are highly imbalanced, we further design a novel loss function to adaptively optimize training weights for each behavior. Extensive experiments verify the effectiveness of our method and explain how the behaviors are identified.

Automatically Identifying Teachers' Autonomy Support using Text Classification on Imbalanced Data

We propose the predictive forward-forward (PFF) algorithm for conducting credit assignment in neural systems. Specifically, we design a novel, dynamic recurrent neural system that learns a directed generative circuit jointly and simultaneously with a representation circuit, integrating learnable lateral competition and elements of predictive coding, an emerging and viable neurobiological process theory of cortical function, with the forward-forward (FF) adaptation scheme. Furthermore, PFF efficiently learns to propagate learning signals and updates synapses with forward passes only, eliminating key structural and computational constraints imposed by a backprop-based scheme. Besides computational advantages, the PFF process could prove useful for understanding the learning mechanisms behind biological neurons that use local signals despite missing feedback connections. We run experiments on image data and demonstrate that the PFF procedure works as well as backprop, offering a promising brain-inspired learning algorithm for classifying, reconstructing, and synthesizing data patterns.

The Predictive Forward-Forward Algorithm

Sentiment and emotion embody intrinsic experience of human cognition, both of which have the profoundly influence on the cognitive processes in humans. The commonality between sentiment and emotion leads to the fact that sentiment classification and emotion recognition are two correlated tasks in cognitive science and artifical intellignce (AI). One task improves its performance by leveraging similarities and differences across tasks. However, recent works have often treated them as two separately different tasks, where their commonalities have largely been neglected. To fill this gap, we propose a multi-task interactive graph attention network with position encodings, termed MIP-GAT. The main proposal is a multi-interactive graph interaction layer where a syntactic dependency connection, a cross-task connection and position encodings are constructed and incorporated into a unified graphical structure. Empirical evaluation on two benchmarking datasets, i.e., CMU-MOSEI and GoEmotions, shows the effectiveness of the proposed model over state-of-the-art baselines. In addition, we also explore the superiority and limitations of the proposed model.

MIP-GAT: A Multi-Task Interactive Graph Attention Network with Position Encodings for Joint Sentiment Classification and Emotion Recognition

Humans can successfully interpret images even when they have been distorted by significant image transformations. Such images aid in differentiating existing computational models for perception because models which predict similar results for typical stimuli that may diverge when confronted with atypical stimuli. In this work, we propose an explanation of people's ability to perceive a specific class of degraded stimuli that requires extreme generalization capabilities: Mooney, or two-tone, faces. We provide a parametric and controllable method to generate Mooney faces and a hypothesis about how the human visual system might be able to perceive such extreme precepts. We show that Mooney faces can be approximated under extreme illumination conditions; a computer graphics perspective on the Mooney image formation process suggests inverse graphics as a model for perceptual generalization and possibly everyday perception. With various visual examples, we argue that Mooney faces are important in the understanding the role of generative models and inverse graphics in human visual processing.

Perception of Mooney Faces: Extreme Generalization through Inverse Rendering?

Cross-lingual adaptation has shown effectiveness in low-resource spoken language understanding (SLU) systems.
However, existing approaches often show unsatisfactory performance on intent detection and slot filling, especially for distant languages,
which are dramatically different from source language in scripts, morphology, or syntax.
To solve the aforementioned challenges, we propose Latent Dialogue Action (LaDA) layer to 
optimize decoding strategy.
The model consists of an extra latent dialogue action layer. It enables our model to enhance a system’s ability to
handle conversations in complex multi-lingual intent and slot value of distant languages.
To our best knowledge, our work is the first
comprehensive study of the use of latent variables for cross-lingual SLU
policy optimization during decode stage. LaDA
achieves state-of-the-art results in zero-shot and few-shot adaptation both on public datasets.

Premium content

Downloads

Next from CogSci 2023

Mapping between the Human Visual System and Two-stream DCNNs in Action Representation

Similar lecture

Reconstruction of visually stable perception from saccadic retinal inputs using corollary discharge signals-driven convLSTM neural networks