United States

Humans are uniquely impressive cooperators, and yet it remains unclear exactly which cognitive and motivational mechanisms set human cooperation apart. Our closest relatives, bonobos and chimpanzees, have also demonstrated a range of prosocial tendencies across experimental and observational contexts. Critically, however, we do not yet know whether their helping behavior, like that of humans, is motivated by an acute sensitivity to others’ needs. We investigated this question in a novel eye-tracking task, with a large sample of captive apes. While their gaze and pupils were tracked, apes viewed controlled videos of an agent reaching toward objects that ultimately would or would not be attainable without help. If apes are acutely sensitive to others’ needs, we predicted that they would show greater pupil dilation (arousal) when the agent could not complete a goal on his own. Our findings shed light on the mechanistic and evolutionary bases of human prosociality and empathy.

CogSci 2021

Bonobos&#39; (Pan paniscus) and chimpanzees&#39; (Pan troglodytes) understanding of, and pupillary responses to, others&#39; needs

### Looking for Cogsci 2023? Please [click here](https://underline.io/events/405/reception) to switch to 2023 edition.


**Dear Colleagues,**

Welcome to the 43rd Annual Conference of the Cognitive Science Society! 

This year’s conference brings together the latest research from all Cognitive Science and also highlights this year’s theme **Comparative Cognition: Animal Minds.** 

The program features four plenary speakers: Friederike Range (University of Veterinary Medicine, Vienna), Onur Güntürkün (Ruhr University Bochum), Julia Fischer (University of Göttingen), and Erich Jarvis (The Rockefeller University). The keynotes and invited symposia showcase the broad spectrum of ideas that encompass the conference theme of comparative cognition. 

Further, the program includes the Rumelhart Prize keynote presentation by Susan Goldin-Meadow (University of Chicago), and symposia to celebrate the winner of the Elman Prize: Wei Ji Ma (New York University), the Heineken Award winner Robert Zatorre (McGill University), and the Robert J. Glushko Dissertation Prizes session.

The program committee for CogSci 2021 received 1,025 submissions, including 710 full papers, 275 member abstracts, 8 publication-based talks, as well as 15 proposals for symposia, and 17 for workshops and tutorials. After a rigorous review process, the committee selected 152 papers for oral presentation and inclusion in the conference proceedings (14.8%), 332 papers for poster presentation and inclusion in the proceedings (32.4%), and 175 papers for poster presentation with inclusion of abstracts in the proceedings (17.1%) We also selected 275 submitted member abstracts. In addition, we accepted 6 publication-based talks, 12 symposia, and 9 workshops and tutorials to make for an exciting and inclusive program.

We hope that you enjoy the conference this year!<br><br>

**Your Program Chairs,**
![](https://assets.underline.io/uploads/markdown_image/1/image/99984908caba5e6453e5fc5ba34f3507.jpg)

**Learn more about the Vienna Cognitive Science Hub at the University of Vienna, hosts of CogSci 2021**

<iframe width="560" height="315" src="https://www.youtube.com/embed/464h1m3iU68" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

To review the proceedings for the conference or review the searchable program, please visit the [website](https://cognitivesciencesociety.org/program/).


The Cognitive Science Society brings together researchers from around the world who hold a common goal: understanding the nature of the human mind. The mission of the Society is to promote Cognitive Science as a discipline, and to foster scientific interchange among researchers in various areas of study, including Artificial Intelligence, Linguistics, Anthropology, Psychology, Neuroscience, Philosophy, and Education. The Society is a non-profit professional organization and its activities include sponsoring an annual conference and publishing the journals Cognitive Science and TopiCS.

Bonobos' (Pan paniscus) and chimpanzees' (Pan troglodytes) understanding of, and pupillary responses to, others' needs

poster

The study of emergent languages in deep multi-agent simulations
has become an important research field. While targeting
different objectives, most studies focus on analyzing properties
of the emergent language—often in relation to the agents’
inputs—ignoring the influence of the agents’ perceptual processes.
In this work, we use communication games to investigate
how differences in perception affect emergent language.
Using a conventional setup, we train two deep reinforcement
learning agents, a sender and a receiver, on a reference game.
However, we systematically manipulate the agents’ perception
by enforcing similar representations for objects with specific
shared features. We find that perceptual biases of both sender
and receiver influence which object features the agents’ messages
are grounded in. When uniformly enforcing the similarity
of all features that are relevant for the reference game,
agents perform better and the emergent protocol better captures
conceptual input properties.

Why and how to study the impact of perception on language emergence in artificial agents

Domain-general thought requires an ability to combine information from different cognitive domains within a single judgement. We presented kea parrots (Nestor notabilis) with probabilistic choice tasks that required them to make predictions about which of two hidden samples was most likely to contain a rewarding token. Over the course of three experiments, we found that kea used relative rather than absolute quantities to make their sampling predictions and could integrate either knowledge about a physical barrier or demonstrators’ sampling biases to adjust their judgements. This work provides the first evidence for domain-general statistical inference outside of humans and the great apes. This suggests that at least two structurally distinct brain models have independently evolved an ability to integrate information, highlighting how comparative cognition may inspire the development of novel artificial general intelligence systems.

Kea show three signatures of domain-general inference

Understanding a sequence of images as a visual narrative is challenging because it requires not only the understanding of what is shown at a particular moment but also what has changed, been omitted or is out of frame. The human cognitive system makes inferences about the state of the world based on transitions between sequential frames. In this paper, we present a principled analysis of the stylistic differences between two dominant styles of multi-modal narratives, western comics and manga. These two styles differ in terms of screening, ballooning, layout, language, and reading order. We first provide a systematic account of these differences based on an annotated dataset consisting of both comics and manga. We then annotate these datasets with a new feature set and evaluate the contributions of these features through development of a computational model of multi-modal comprehension. The model evaluation is presented through the cloze test that measures the accuracy of the model in predicting unseen next frames given the prior frames in a sequence. Our results provide initial benchmarks and insight into the fundamental challenges that the multi-modal narrative understanding task presents for computational models both for language and vision.

A Computational Model of Comprehension in Manga Style Visual Narratives

Successful teaching requires an assumption of how the learner learns - how the learner uses experiences from the world to update their internal states. We investigate what expectations people have about a learner with a behavioral experiment: Hu- man teachers were asked to teach a sequential decision-making task to an artificial dog in an online manner using rewards and punishments. The artificial dogs were implemented with either an Action Signaling agent or a Q-learner with different dis- count factors. Our findings are threefold: First, we used ma- chine teaching to prove that the optimal teaching complexity across all the learners is the same, and thus the differences in human performance was solely due to the discrepancy between human teacher’s theory of mind and the actual student model. Second, we found that Q-learners with small discount factors were easier to teach than action signaling agents, challenging the established conclusion from prior work. Third, we showed that the efficiency of teaching was monotonically increasing as the discount factors decreased, suggesting that humans’ theory of mind bias towards myopic learners.

Using Machine Teaching to Investigate Human Assumptions when Teaching Reinforcement Learners

Sensory stimuli can mediate cognition and behavior in different ways. In humans, chemosensory threat cues enhance performance and increase vigilance. In non-human primates, visual, olfactory and even tactile cues of biological contaminants elicit avoidance behaviors, i.e. manifestations of the adaptive system of disgust in humans. Nevertheless, how contaminant sensory cues may affect cognitive processes in non-human primates remains largely unexplored. We tested how visual cues suggesting pathogen presence may affect cognitive performance in chimpanzees. We used disgust-related images displayed at regular intervals during a number ordering task on touch screens. Images of carcasses provoked more errors following their display compared to control and other condition images (i.e. invertebrates and food). Our results support the hypothesis that visual disgust elicitors decrease performance by distracting individuals. Future studies should determine whether cognitive responses evolved differently across threat contexts (fear vs. disgust) given their differences in outcomes (death vs. disease).

Exploring the effects of disgust-related images on cognition in chimpanzees

There has been a widely held view that visual representations (e.g., photographs and illustrations) do not depict negation, for example, one that can be expressed by a sentence "the train is not coming". This view is empirically challenged by analyzing the real-world visual representations of comic (manga) illustrations. In the experiment using image captioning tasks, we gave people comic illustrations and asked them to explain what they could read from them. The collected data showed that some comic illustrations could depict negation without any aid of sequences (multiple panels) or conventional devices (special symbols). This type of comic illustrations was subjected to further experiments, classifying images into those containing negation and those not containing negation. While this image classification was easy for humans, it was difficult for data-driven machines, i.e., deep learning models (CNN), to achieve the same high performance. Given the findings, we argue that some comic illustrations evoke background knowledge and thus can depict negation with purely visual elements.

Visual representation of negation: Real world data analysis on comic image design

Humans are highly efficient learners, with the ability to grasp the meaning of a new concept from just a few examples. Unlike popular computer vision systems, humans can flexibly leverage the compositional structure of the visual world, understanding new concepts as combinations of existing concepts. In the current paper, we study how people learn different types of visual compositions, using abstract visual forms with rich relational structure. We find that people can make meaningful compositional generalizations from just a few examples in a variety of scenarios, and we develop a Bayesian program induction model that provides a close fit to the behavioral data. Unlike past work examining special cases of compositionality, our work shows how a single computational approach can account for many distinct types of compositional generalization.

Flexible Compositional Learning of Structured Visual Concepts

Children learn word meanings by making use of commonalities across the usages of a word in different situations. However, early word learning experiences have a high level of uncertainty. For a word in an utterance, there are many possible meanings in the environment (referential uncertainty). Similarly, for a meaning, there are multiple possible words in the utterance (linguistic uncertainty). We propose a general framework to investigate the role of mutual exclusivity bias (asserting one-to-one mappings between words and their meanings) in early word learning. Through a set of computational studies, we show that to successfully learn word meanings under uncertainty, a model needs to implement two types of competition: words competing for the association to a meaning reduces linguistic uncertainty, and meanings competing for a word limits referential uncertainty. Our work highlights the importance of an algorithmic-level analysis to shed light on different mechanisms that implement a computational-level theory.

Mutual Exclusivity as Competition in Cross-situational Word Learning

The ability to learn temporal relationships and use that knowledge to simulate future events is among the most remarkable aspects of cognition. Recently introduced behavioral task called Judgment of Imminence (JOI) combined with a well-known Judgment of Recency (JOR) task pointed to a remarkable symmetry between the temporal organization of memory and prediction. The data were consistent with the hypothesis that both memory and prediction can be organized as a compressed mental timeline. This means that the past and future can be remembered or simulated sequentially relative to the present. The compression implies that events closer to the present, regardless of whether they are in the past or in the future, were represented more accurately than those further from the present. Here we used the existing JOR model based on a compressed memory timeline to build an associative representation that can learn the temporal relationships and create a timeline of the future, which mirrors the timeline of the past. We show that this approach can simultaneously account for response times and accuracy in both JOR and JOI. This work provides a time-local neural-level mechanistic account for how the temporal organization of the memory can be used to learn the temporal structure of the world and simulate the future in an efficient manner as a compressed mental timeline.

A computational model for simulating the future using a memory timeline

It was assumed that the duration of working memory in dogs is around 27 seconds, however, a study on a group of dogs revealed that they were able to maintain spatial memory of an object up to 240 seconds. In our study, we looked at 50 multiple dog breeds. In experiment 1, a small ball was put in one of the 3 wooden boxes in front of the dogs. The dogs had a retention interval for 1,2,3 and 4 minutes consecutively. Then they were asked to search for the ball. In experiment 2, the same ball was put in 3 colourful boxes that were, green, blue, and purple which are distinguishable to dog vision. The retention intervals were kept the same. Our results revealed that the addition of colour has increased the dogs' likelihood of finding the ball which suggests an advancement in the duration of working memory.

Downloads

Next from CogSci 2021

Why and how to study the impact of perception on language emergence in artificial agents

Similar lecture

Great apes’ understanding of others’ beliefs in two manual search tasks