Netherlands

Social rewards shape human behavior. During development, a caregiver guides a learner’s behavior towards culturally aligned goals and values. How do these behaviors persist and generalize when the caregiver is no longer present, and the learner must continue autonomously? Here, we propose a model of value internalization where social feedback trains an internal social reward (ISR) model that generates internal rewards when social rewards are unavailable. Through empirical simulations, we show that an ISR model prevents agents from unlearning socialized behaviors and enables generalization in out-of-distribution tasks. Incomplete internalization, akin to &quot;reward hacking&quot; on the ISR, is observed when the model is undertrained.  Finally, we show that our model internalizes prosocial behavior in a multi-agent environment. Our work provides a framework for understanding how humans acquire and generalize values and offers insights for aligning AI with human values.

**Authors:**

Frieda Rong: Stanford University; Max Kleiman-Weiner: University of Washington

CogSci 2024

Value Internalization: Learning and Generalizing from Social Reward

The 45th Annual Meeting of the Cognitive Science Society will take place in Sydney, Australia as a modified hybrid conference. Presentations from the main-session room will be live-streamed every day for all events. This will include all invited talks and award sessions. Recordings of all CogSci 2023 sessions will be made available for on-demand viewing after the conference.<br>
The in-person component will be held at the International Convention Centre Sydney at Darling Harbour. The Conference will take place Wednesday July 26th – Saturday July 29th, 2023 (Wednesday, July 26th is the Workshops Day).

Join us!

<br>[**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2023/07/COgSci-PAAG-V2.pdf)
<br>[**The Detailed Program can be found here**](https://online.fliphtml5.com/ebtyf/mswz/)
<br><br>

#### **CogSci 2023 Program Book**
<iframe style="width:700px;height:400px" src="https://online.fliphtml5.com/ebtyf/tzgk/"  seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe>
<br>

CogSci 2023

The 45th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

Social rewards shape human behavior. During development, a caregiver guides a learner’s behavior towards culturally aligned goals and values. How do these behaviors persist and generalize when the caregiver is no longer present, and the learner must continue autonomously? Here, we propose a model of value internalization where social feedback trains an internal social reward (ISR) model that generates internal rewards when social rewards are unavailable. Through empirical simulations, we show that an ISR model prevents agents from unlearning socialized behaviors and enables generalization in out-of-distribution tasks. Incomplete internalization, akin to "reward hacking" on the ISR, is observed when the model is undertrained.  Finally, we show that our model internalizes prosocial behavior in a multi-agent environment. Our work provides a framework for understanding how humans acquire and generalize values and offers insights for aligning AI with human values.

**Authors:**

Frieda Rong: Stanford University; Max Kleiman-Weiner: University of Washington

technical paper

The 46th Annual Meeting of the Cognitive Science Society was an in-person meeting held in Rotterdam, The Netherlands at the Postillion Hotel & Conference Centre.

**ON-DEMAND PROGRAM ACCESS AFTER THE CONFERENCE**<br>
Recordings of the invited program are now available. You can access them by clicking on the 'Schedule' icon on the left. Select view by week and navigate to the day and time slot of the recording you wish to view. Click on the time slot to access the recording.

Recordings available (click on each recording to view):

**Thursday, July 25**<br>
0900: [Keynote Speaker Morgan Barense on Enhancing real-world event memory](https://underline.io/events/465/sessions/17997/lecture/99084-dynamics-between-minds-and-the-environment)<br>
1000: [Gleitman Award Winner Isabelle Dautriche on Language Foundations: Insights from acquisition, communication, cognition, and more](https://underline.io/events/465/sessions/18000/lecture/99085-gleitman-talk)<br>
1415: [Invited Symposium: Dynamics between minds and the environment](https://underline.io/events/465/sessions?eventSessionId=18016&searchGroup=lecture)<br>
1700: [Rumelhart Prize Presentation Speaker Alison Gopnik on Exploit, explore, empower: Three ages and three intelligences](https://underline.io/events/465/sessions/18028/lecture/99161-rp1-rumelhart-prize-presentation)<br>

**Friday, July 26**<br>
0900: [C.L. de Carvalho-Heineken Prize Keynote Speaker Kia Nobre on Focusing in memory](https://underline.io/events/465/sessions/18035/lecture/99162-hp1-c-l-de-carvalho-heineken-prize-keynote-address)<br>
1030: [Rumelhart Symposium: Childhood as exploration](https://underline.io/events/465/sessions/18038/lecture/100346-childhood-as-exploration)<br>
1415: [Elman Prize Symposium](https://underline.io/events/465/sessions?eventSessionId=18053&searchGroup=lecture)<br>
1600: [Invited Symposium: Dynamics between minds](https://underline.io/events/465/sessions?eventSessionId=18065&searchGroup=lecture)<br>
1745: [Keynote Speaker Andrea E. Martin on Neural dynamics encode the structure and statistics of language](https://underline.io/events/465/sessions/18077/lecture/99271-neural-dynamics-encode-the-structure-and-statistics-of-language)<br>

**Saturday, July 27**<br>
0900: [Keynote Speaker Gregor Schöner on How higher cognition emerges from the dynamics of strongly interacting neural populations](https://underline.io/events/465/sessions/18083/lecture/99273-dynamics-within-the-mind)<br>
1000: [Glushko Talks](https://underline.io/events/465/sessions?eventSessionId=18086&searchGroup=lecture)<br>
1500: [Invited Symposium: Dynamics within minds](https://underline.io/events/465/sessions?eventSessionId=18100&searchGroup=lecture)<br>


#### **CogSci 2024 Program Book**
<div style="position:relative;padding-top:0;width:900px;height:500px;"><iframe style="position:absolute;border:none;width:100%;height:100%;left:0;top:0;" src="https://online.fliphtml5.com/ebtyf/cble/"  seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe></div>


**The Program Book can be downloaded [here](https://drive.google.com/file/d/1yRVp1cBqRnAbdYi4GXWV_pZeyWNsRquv/view?usp=sharing).**

#### **Letter from the President**

Welcome to the 2024 Meeting of the Cognitive Science Society in Rotterdam! CogSci 2024 brings together a large community of cognitive scientists who have traveled here from around the world, as well as a smaller group of remote presenters. I would like to extend an especially warm welcome to our first-time CogSci meeting attendees, and hope that 
their experience inspires them to join our future meetings for many years to come.

I want to thank this year’s conference co-chairs, Larissa K Samuelson, Stefan Frank, Mariya Toneva, Allyson Mackey, and Eliot Hazeltine, for putting together an amazing series of invited talks and symposia around the theme of Dynamics of Cognition. The co-chairs also deserve credit for handling a record-breaking number of submissions and producing a truly exciting conference program 

Beyond the invited talks and symposia dedicated to this year’s conference theme, I would like to highlight the presentations and events honoring the 
Rumelhart, Elman, Gleitman and C .L . de Carvalho Heineken prize winners, including the Rumelhart reception on Thursday. As you may know, we are recording all of the invited talks and symposia, and all prize-winners’ talks, and will be making this content available after the conference. 

The Cognitive Science Society relies on the volunteer efforts of our Governing Board members who work on matters related to our membership; conference policies; diversity and inclusion, international, and outreach initiatives; prizes and much more. We welcome interest from Society members who would like to become more involved in what we do. The 
Society is deeply grateful to Rick Dale and Andrea Bender, who serve as editors of the two Society journals, Cognitive Science and Topics in Cognitive Science respectively. We especially acknowledge our editors’ generosity in donating their stipends each year to D&I and outreach efforts. 

This year’s Annual Meeting depends critically on the support of Marischal De Armond and his team at Podium Conference Specialists: Sharon Zwack, Cendrine De Vis, Sarah-Kate Burke, and Rachel Waller worked tirelessly to secure the venue and handled a multitude of logistical and organizational issues, from arranging coffee breaks and receptions to making sure that a huge number of posters fits comfortably into the available space. Finally, and importantly, I would like to acknowledge the Cognitive Science Society Executive Officer, Erica Wojcik, for managing the complex and ever expanding sphere of our Society’s activities.

I hope you enjoy this year’s meeting and the many different opportunities to engage with the vibrant community of cognitive scientists gathered here. I also hope you get a chance to explore the great city of Rotterdam with its many attractions, museums, restaurants and scenic views. If you’d like to talk more about our Society, or simply want to say hello, please stop by!

![](https://assets.underline.io/markdown_image/1/image/3c66d0e21fff30e204df1138ffd15173.jpeg)

**Anna Papafragou**  
President, Cognitive Science 
Society 2023-2024

**CODE OF CONDUCT**<br>
By attending the CogSci 2024 Conference, you are required to adhere to the society’s [Code of Conduct](https://drive.google.com/file/d/16-6KkptF0Gn3ZYGJDlpqpwTdImw45Ng0/view?usp=drive_link).

**ABOUT THE COGNITIVE SCIENCE SOCIETY**<br>
The Cognitive Science Society brings together researchers from around the world who hold a common goal: understanding the nature of the human mind. The mission of the Society is to promote Cognitive Science as a discipline, and to foster scientific interchange among researchers in various areas of study, including Artificial Intelligence, Linguistics, Anthropology, Psychology, Neuroscience, Philosophy, and Education.

The Society is a non-profit professional organization and its activities include sponsoring an annual conference and publishing the journals Cognitive Science and TopiCS.
<br><br>

You need to log in with the email address you registered with. Access credentials have been sent to your email. 

Please be sure to check your spam and other email folders if you do not see an email confirmation right away.

Please log in to explore this event.

It looks like you are not registered for this event. 

To access the site please register [**here**](https://cognitivesciencesociety.org/registration/). 

Please register!

The 46th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

A key aspect in child language development involves inducing
the rules that determine the relations of the arguments to
their verbal predicate, i.e., semantic roles. Here, we investigate
whether child-directed speech facilitates learning ‘who
does what to whom’ in English and Russian, two languages
that strongly differ in their amount of case-marking and word
order variation. We ask whether a contextual, distributional
learner can more easily learn to assign semantic roles to arguments
based on child-directed speech versus adult-directed
speech. To this end, we represent the arguments of a verb
with contextualised word embeddings extracted from neural
language models. We compare the classification accuracy
of semantic roles based on these representations between utterances
extracted from corpora of child-directed speech and
adult-directed speech. We further study to what extent semantic
roles can be predicted based on arguments represented
by different levels of information, such as non-contextualised
representations, the position in the sentence, and case marking.
We find that child-directed speech facilitates the learning
of semantic roles, an important cornerstone for learning the
morphosyntactic features of a language. However, the effect
of child-directed speech is more pronounced in Russian than
in English, indicating that child-directed speech may be optimised
more strongly in a language where arguments are expressed
in more varied forms and positions, as is the case in
Russian.

**Authors:**

Eva Huber: University of Zurich; Sabine Stoll: University of Zurich; Balthasar Bickel: University of Zurich

Readily grasping ‘who’ and ‘whom’: child-directed speech facilitates semantic role learning

Across three experiments, we show that 15-month-old infants understand that arbitrary objects can be used as symbols. Experiment 1 shows that infants map geometric shapes (e.g., a triangle) onto familiar discourse referents (e.g., a duck) based on labeling (e.g., “Look, a duck!”). Experiment 2 shows that infants do not generalize these mappings to a new speaker. This rules out the alternative hypothesis that infants interpret the labeling events literally. Experiment 3 shows that infants are sensitive to the conceptual identity of the discourse referent. After being told that one shape represents an agent (e.g., a duck) and another shape represents a patient (e.g., a cup), infants attend differentially when the agent symbol moves towards the patient symbol than the opposite. This rules out the alternative hypothesis that infants interpret the labeling events as referential pacts. The findings jointly indicate that symbolic relations are easily activated and available early in human development.

**Authors:**

Barbu Revencu: Central European University; Barbara Pomiechowska: University of Birmingham; Gabor Brody: Brown University; Gergely Csibra: Central European University

Fifteen-month-olds accept arbitrary shapes as symbols of familiar kind tokens

The control-of-variables strategy is often considered to be the superior strategy when children learn from experiments. However, by simulating Bayesian likelihoods of outcomes from a water displacement task, we show that certain confounded comparisons may support belief revision better than controlled comparisons. We tested this assumption by experimentally varying the types of comparisons that participants observed in a learning task involving balls of different sizes and materials (N = 90, age range 6- to 9-yrs). In the Size, Material, and Mixed conditions we presented controlled comparisons. In the Confounded Incongruent Condition, we presented confounded comparisons in which the larger ball was made of the heavier material. In line with our hypotheses, children in the Confounded Incongruent Condition revised their beliefs more than children in the other conditions, as indicated by higher transfer test scores. These findings suggest that confounded comparisons may in fact sometimes provide more optimal information for learning.

**Authors:**

Lucas Lörch: DIPF Leibniz Institute for Research and Information in Education; Elizabeth Bonawitz: Harvard; Garvin Brod: DIPF Leibniz Institute for Research and Information in Education

Challenging the control-of-variables strategy: How confounded comparisons can support children’s science learning

Previous research has shown that our subjective sense of certainty doesn't always accurately reflect the strength of the evidence that has been presented to us. We investigate several key factors that drive children's certainty using a Boolean concept learning task. We created an idealized learning model to predict children's accuracy and certainty during the experiment, given past evidence that they have seen in the task, and we compared its predictions with our behavioral results. Our results suggest that while predictors from the idealized learning model capture children's accuracy, behavioral predictors generated by the behavioral data can better predict children's certainty. We also show that younger children's certainty can be explained by the idealized learning model, while older children's certainty is primarily predicted by how well they observed themselves doing in the experiment.

**Authors:**

Huiwen Alex Yang: University of California, Berkeley; Louis Marti: UC Berkeley; Carolyn Baer: University of British Columbia; Aaraam Granera: University of California, Berkeley; Holly Palmeri: University of California, Berkeley; Celeste Kidd: University of California, Berkeley

Emergence of certainty representations for guiding concept learning

We test whether the support one holds about an event is influenced by other hypotheses. We addressed this by examining context effects in subjective probabilities (SPs) when forecasting NCAA men's basketball team rankings. A challenge in investigating context effects with naturalistic stimuli is the need to model the different representations of the options. To do so, we adapted the Spatial Arrangement method to capture individual representations and developed an algorithm to select stimuli. We asked participants steeped in basketball knowledge to create spatial maps for 50 teams. They were then presented with customized triplets of teams and asked to estimate their SP that one team would outrank the others. The study uncovered context effects in SPs, and moderators of the effects. Our findings suggest that similar cognitive processes may govern the construction of belief and preference and highlight the importance of modeling mental representations to understand forecasting scenarios.

**Authors:**

Jun Fang: Indiana University; Xiaohong Cai: Indiana University; James Adaryukov: Indiana University; Tim Pleskac: Indiana University

Predicting NCAA Men’s Basketball Rankings: How Context Effects Shape Beliefs

Reduced cognitive function in major depression (MDD) is often interpreted as a reduced ability to exert cognitive control. Here we used the Effort Foraging Task to test the hypothesis that reduced cognitive function may be due, in part, to decreased willingness to exert control in MDD because of increased cognitive effort "costs". Contrary to our predictions, neither cognitive nor physical effort costs differed with MDD diagnosis (N MDD=52, N Comparisons=27). However, we found distinct patterns of symptom relationships for cognitive and physical effort costs. In MDD, greater anxiety symptoms were selectively associated with lower cognitive, but not physical effort cost (i.e. greater willingness to exert cognitive effort), whereas greater anhedonia and behavioral apathy symptoms were selectively associated with increased physical (but not cognitive) effort costs. These findings support the measurement of both cognitive and physical effort as decision-making function markers that may inform heterogeneity of MDD.

**Authors:**

Laura A. Bustamante: Washington University in St. Louis; Deanna Barch: Washington University in St. Louis; Johanne Solis: Rutgers University; Temitope Oshinowo: Princeton University; Ivan Grahek: Brown University; Anna B Konova: Rutgers University; Nathaniel Daw: Princeton University; Jonathan Cohen: Princeton University

Anxiety symptoms of major depression associated with increased willingness to exert cognitive, but not physical effort

Typical models of learning assume incremental estimation of continuously-varying decision variables like expected rewards.  However, this class of models fails to capture more idiosyncratic, discrete heuristics and strategies that people and animals appear to exhibit.  Despite recent advances in strategy discovery using tools like recurrent networks that generalize the classic models, the resulting strategies are often onerous to interpret, making connections to cognition difficult to establish.  We use Bayesian program induction to discover strategies implemented by programs, letting the simplicity of strategies trade off against their effectiveness.  Focusing on bandit tasks, we find strategies that are difficult or unexpected with classical incremental learning, like asymmetric learning from rewarded and unrewarded trials, adaptive horizon-dependent random exploration, and discrete state switching.

**Authors:**

Carlos G. Correa: Princeton University; Tom Griffiths: Princeton University; Nathaniel Daw: Princeton University

Program-Based Strategy Induction for Reinforcement Learning

Choice deadlines are commonly imposed in decision-making research to incentivize speedy responses and sustained attention to the task settings. However, computational models of choice and response times routinely overlook this deadline, instead simply omitting trials past the deadline from further analysis. This choice is made under the implicit assumption that parameter estimation is not significantly affected by ignoring these omissions. Using new tools from likelihood-free inference, here we elucidate the degree to which omitting omissions, even in seemingly benign settings, can lead researchers astray. We explore the phenomenon using a Sequential Sampling Model (SSM) with collapsing boundaries as a test-bed.

**Authors:**

Xiamin Leng: Brown University; Alexander Fengler: Brown University; Amitai Shenhav: Brown University; Michael J. Frank: Brown University

The Perils of Omitting Omissions when Modeling Evidence Accumulation

Generalization to new tasks requires learning of task representations that accurately reflect the similarity structure of the task space. Here, we argue that episodic memory (EM) plays an essential role in this process by stabilizing task representations, thereby supporting the accumulation of structured knowledge. We demonstrate this using a neural network model that infers task representations that minimize the current task's objective function; crucially, the model can retrieve previously encoded task representations from EM and use these to initialize the task inference process. With EM, the model succeeds in learning the underlying task structure; without EM, task representations drift and the network fails to learn the structure. We further show that EM errors can support structure learning by promoting the activation of similar task representations in tasks with similar sensory inputs. Overall, this model provides a novel account of how EM supports the acquisition of structured task representations.

**Authors:**

Qihong Lu: Columbia University; Ali Hummos: Massachusetts Institute of Technology; Kenneth Norman: Princeton University

Episodic memory supports the acquisition of structured task representations

Adults are known to have superior working memory to children, but whether this improvement is driven primarily by differences in storage capacity or attentional control is debated. In particular, the understanding of how capacity and control influence the development of working memory is hampered by the fact that most theorizing about the effect of variation in either on behavior has been verbal. To address this, we extended a computational model of working memory to clearly separate the contributions of capacity and control, fitting the model to a recent developmental study. We find that the combined influence of capacity and control on working memory may be more complicated than previously appreciated. In particular, the general pattern of qualitative differences between children and adults could be produced by increasing either capacity or control alone. These results point to a need for additional experimental paradigms to clearly parse the differential impact of working memory components.

**Authors:**

Evan Russek: Princeton University; Cameron Rouse Turner: Princeton University; Emma McEwen: University of St Andrews; Andreea Miruna Miscov: University of St Andrews; Amanda Seed: University of St Andrews; Tom Griffiths: Princeton University

Premium content

Downloads

Next from CogSci 2024

Readily grasping ‘who’ and ‘whom’: child-directed speech facilitates semantic role learning

Similar lecture

Developmental Curiosity and Social Interaction in Virtual Agents