United States

Perceptual training has been shown to be an effective and rapid way of training people to make simple diagnoses using medical images. However, it appears to be less effective at training people to make more complex diagnoses that require non-binary judgements. In the present study, we investigated whether perceptual training could be augmented to make it more effective and what factors limited its effectiveness. In Experiment 1, we created artificial stimuli that were designed to simulate liver ultrasound images to assess perceptual learning for a complex task that involved judgements on a 7-point scale. Whilst performance improved somewhat with training, we found that incorporating annotations into the training provided no benefits. Additionally, contrary to our expectations, training that was structured in a stepped fashion was detrimental to learning. In Experiment 2, we found that perceptual learning in a simple task with shaded disks was most impacted by the extent to which the brightness levels of each disk were discriminable but that attending to multiple locations did not result in a significant cost to performance. Our findings show that augmenting perceptual training does not increase learning and that learning is less when the relevant features are harder to discriminate.

CogSci 2023

Testing the Effectiveness of Augmenting Perceptual Training With Annotations and Steps in a Difficult Visual Discrimination Task

### Looking for Cogsci 2023? Please [click here](https://underline.io/events/405/reception) to switch to 2023 edition.


**Dear Colleagues,**

Welcome to the 43rd Annual Conference of the Cognitive Science Society! 

This year’s conference brings together the latest research from all Cognitive Science and also highlights this year’s theme **Comparative Cognition: Animal Minds.** 

The program features four plenary speakers: Friederike Range (University of Veterinary Medicine, Vienna), Onur Güntürkün (Ruhr University Bochum), Julia Fischer (University of Göttingen), and Erich Jarvis (The Rockefeller University). The keynotes and invited symposia showcase the broad spectrum of ideas that encompass the conference theme of comparative cognition. 

Further, the program includes the Rumelhart Prize keynote presentation by Susan Goldin-Meadow (University of Chicago), and symposia to celebrate the winner of the Elman Prize: Wei Ji Ma (New York University), the Heineken Award winner Robert Zatorre (McGill University), and the Robert J. Glushko Dissertation Prizes session.

The program committee for CogSci 2021 received 1,025 submissions, including 710 full papers, 275 member abstracts, 8 publication-based talks, as well as 15 proposals for symposia, and 17 for workshops and tutorials. After a rigorous review process, the committee selected 152 papers for oral presentation and inclusion in the conference proceedings (14.8%), 332 papers for poster presentation and inclusion in the proceedings (32.4%), and 175 papers for poster presentation with inclusion of abstracts in the proceedings (17.1%) We also selected 275 submitted member abstracts. In addition, we accepted 6 publication-based talks, 12 symposia, and 9 workshops and tutorials to make for an exciting and inclusive program.

We hope that you enjoy the conference this year!<br><br>

**Your Program Chairs,**
![](https://assets.underline.io/uploads/markdown_image/1/image/99984908caba5e6453e5fc5ba34f3507.jpg)

**Learn more about the Vienna Cognitive Science Hub at the University of Vienna, hosts of CogSci 2021**

<iframe width="560" height="315" src="https://www.youtube.com/embed/464h1m3iU68" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

To review the proceedings for the conference or review the searchable program, please visit the [website](https://cognitivesciencesociety.org/program/).


CogSci 2021

The Cognitive Science Society brings together researchers from around the world who hold a common goal: understanding the nature of the human mind. The mission of the Society is to promote Cognitive Science as a discipline, and to foster scientific interchange among researchers in various areas of study, including Artificial Intelligence, Linguistics, Anthropology, Psychology, Neuroscience, Philosophy, and Education. The Society is a non-profit professional organization and its activities include sponsoring an annual conference and publishing the journals Cognitive Science and TopiCS.

poster

The 45th Annual Meeting of the Cognitive Science Society will take place in Sydney, Australia as a modified hybrid conference. Presentations from the main-session room will be live-streamed every day for all events. This will include all invited talks and award sessions. Recordings of all CogSci 2023 sessions will be made available for on-demand viewing after the conference.<br>
The in-person component will be held at the International Convention Centre Sydney at Darling Harbour. The Conference will take place Wednesday July 26th – Saturday July 29th, 2023 (Wednesday, July 26th is the Workshops Day).

Join us!

<br>[**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2023/07/COgSci-PAAG-V2.pdf)
<br>[**The Detailed Program can be found here**](https://online.fliphtml5.com/ebtyf/mswz/)
<br><br>

#### **CogSci 2023 Program Book**
<iframe style="width:700px;height:400px" src="https://online.fliphtml5.com/ebtyf/tzgk/"  seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe>
<br>

The 45th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

Predictive inference and error-driven learning are critical to optimal performance across many different contexts. However, the specific context determines the informativeness of errors in updating predictions. In this study, participants experienced two changing, unsignalled contexts with opposite optimal responses to errors; the change-point context, where errors were informative, and the oddball context, where they were not. The changes to the context occurred under two task structures: 1) a fixed task structure, with consecutive blocks of each context, and 2) a random task structure, with the context randomly selected for each new block. We modelled participants' performance using a Hierarchical Gaussian Filter (HGF) model. We found that performance was greater in the oddball than change-point context, with more accurate and precise estimates. The estimates from the fixed task structure were also more precise than those in the random task structure. We showed that consistency in context can improve precision.

Prediction and learning under unsignalled changing contexts

Intelligent tutoring systems (ITS) afford complex learning environments in which inductive reasoning is engaged, but where sparse log data complicates the classification of cognitive states. Using a simple rule learning task, we explore the feasibility of verbal think aloud protocols to contribute to machine learning algorithms designed to classify states of rule search, rule discovery, and rule following. Domain-general versus domain-specific contributions to classification are considered through the use of isomorphic rule learning tasks with numeric and spatial stimuli. We trained and tested models both within and across task domains. Models including verbal data outperform models based only on log data with particular improvement in classifying rule discovery. These results provide a foundation for real-time classification of cognitive states during ITS use.

Classification of Rule Learning Phases in Inductive Reasoning

Human physical scene understanding requires more than simply localizing and recognizing objects — we can quickly adapt our predictions about how a scene will unfold by incorporating objects' latent physics properties, such as the masses of the objects in the scene. What are the underlying computational mechanisms that allow humans to infer these physical properties and adapt their physical predictions so efficiently from visual inputs? One hypothesis is that general intuitive physics knowledge can be learned from enough raw data, instantiated as computational models that predict future video frames in large datasets of complex scenes. To test this hypothesis, we evaluate existing state-of-the-art video models. We measured both model and human performance on Physion++, a novel dataset and benchmark that rigorously evaluates visual physical prediction in humans and machines, under circumstances where accurate physical prediction relies on accurate estimates of the latent physical properties of objects in the scene. Specifically, we tested scenarios where accurate prediction relied on accurate estimates of objects' mechanical properties, including masses, friction, elasticity and deformability, and the values of these mechanical properties could only be inferred by observing how these objects moved and interacted with other objects and/or fluids. We found that models that encode objectness and physical states tend to perform better, yet there is still a huge gap compared to human performance. We also found most models' predictions correlate poorly with that made by humans. These results show that current deep learning models that succeed in some settings nevertheless fail to achieve human-level physical prediction in other cases, especially those where latent property inference is required.

Physion++: Evaluating Physical Scene Understanding with Objects Consisting of Different Physical Attributes in Humans and Machines

Agents trained using deep reinforcement learning (DRL) are capable of meeting or exceeding human-levels of performance in multi-agent tasks. However, the behaviors exhibited by these agents are not guaranteed to be human-like or human-compatible. This poses a problem if the goal is to design agents capable of collaborating with humans in cooperative or team-based tasks. Previous approaches to encourage the development of human-compatible agents have relied on pre-recorded human data during training. However, such data is not available for the majority of everyday tasks. Importantly, research on human perceptual-motor behavior has found that task-directed behavior is often low-dimensional and can be decomposed into a defined set of dynamical perceptual-motor primitives (DPMPs). Accordingly, we propose a hierarchical approach to simplify DRL training by defining the action dynamics of agents using DPMPs at the lower level, while using DRL to train the decision-making dynamics of agents at the higher level. We evaluate our approach using a multi-agent shepherding task used to study human and multi-agent coordination. Our hierarchical, DRL-DPMP approach resulted in agents which trained faster than vanilla, black-box DRL agents. Further, the hierarchical agents reached higher levels of performance not only when interacting with each other during self-play, but also when completing the task alongside agents embodying models of novice and expert human behavior. Finally, the hierarchical DRL-DPMP agents developed decision-making policies that outperformed heuristic-based agents used in previous research in human-agent coordination.

Scaffolding Deep Reinforcement Learning Agents using Dynamical Perceptual-Motor Primitives

Our memories are stored not in isolation, but in richly structured networks of knowledge. How are individual memories represented within these knowledge structures, and how do new experiences become integrated into existing structures? To address these questions, we exposed participants to novel objects from a hierarchical category structure. After participants learned these objects to criterion, we introduced new objects from the same underlying structure. Participants learned the new objects much more quickly than the old set, suggesting that recently learned knowledge rapidly scaffolded the learning of new, related information. However, fine-grained analyses of participants’ memory errors suggest these newly learned objects may not be fully integrated into prior learned category structure, but rather are held separate. These results suggest that existing knowledge can facilitate the learning of new information in the absence of assimilation of that information. Ongoing work investigates how these dynamics unfold over time and with sleep.


Measuring the rapid acquisition and integration of structured knowledge

One of the most ancient and universal forms of cognitive offloading is the outsourcing of cognitive operations onto other humans. We explored mechanisms underlying this ability by designing a novel computerised memory task where participants memorised target locations and recalled them after a brief delay. Next, they watched two virtual people compete in another memory game, where one demonstrated a reliable memory, and the other demonstrated an unreliable memory. Finally, participants completed the initial memory task again, with either the reliable-memory or unreliable-memory person being available to help with recall on each trial. Through observation and without direct instruction, participants acquired beliefs about the virtual people’s cognitive proficiencies and could readily draw upon these beliefs to inform offloading decisions. Participants were more likely to seek help from the reliable-memory person, and this tendency interacted with factors known to drive cognitive offloading more generally, like task difficulty and unaided cognitive ability.

Can you help me? Using others to offload cognition

How much can we infer about the past and future, given our knowledge of the present? Unlike temporally symmetric inferences about simple sequences, inferences about our own lives are asymmetric: we are better able to infer the past than the future, since we remember our past but not our future (i.e., the psychological arrow of time). What happens when both the past and future are unobserved, as when we make inferences about other people’s lives? We had participants view segments of a character-driven television drama. They wrote out what would happen just before or after each just-watched segment. Participants were better at inferring past (versus future) events. This asymmetry was driven by participants’ reliance on characters’ conversational references in the narrative, which tended to favor the past. Our work reveals a temporal asymmetry in how observations of other people’s behaviors can inform us about the past and future.

Temporal asymmetries in inferring unobserved past and future events

Many empirical domains center around acts of abstract perception. In this work, we are exploring the periphery of perceptual experiences, specifically the ways professional mathematicians develop their internal visualizations within domains of particular expertise. In their core domains, mathematicians report having highly vivid perceptual experiences of impossible objects such as infinite sets or multi-dimensional spaces. We apply an empirical lens which has formerly been used to understand deliberate visualization practices in Shamanic and Christian contexts to understand how mathematicians develop vividness in their visualizations, and how they exert control over them. 
We find that every mathematician in our sample engaged in these multimodal visualizations. We found that shape, movement, and color were much more common qualities than tactile and olfactory qualities. Many mathematicians reported their visualizations to be dynamic and at least partially under their control. Furthermore, visualizations tended to increase in vividness across experience within a domain.

Expert Mathematicians Experience Multi-Modal Visualizations that Develop Across Time

The ‘Self’ has a prioritized cognitive status, attributed to an automatic bottom-up attentional enhancement for self-relevant stimuli. Two predictions follow if self-relevant information is automatically boosted. First, processing should be enhanced for self- comparative to other-relevant targets. Second, interference should be greater for self- compared to other-relevant distractors. To investigate these predictions, we adapted a motion discrimination task. Participants first learnt to associate a colour (pink, blue) with themselves and a stranger (other), then viewed a label (YOU or OTHER) and two different coloured superimposed random dot kinematograms (RDKs; blue, pink). A response dial recorded participants’ reproduced direction of motion for the coloured RDK associated with the presented label. Facilitation / interference for self- and other-labelled stimuli was assessed by the angular difference between the reported and true direction of motion (signed error magnitude). Further regression-based analyses quantified the weight self and other-related stimuli influenced responses (decision weights). Contrary to predictions, the mean signed error magnitude and distractor weights did not significantly differ between self and other-relevant stimuli, suggesting self-relevance did not modulate the degree of interference and self-relevant stimuli did not automatically capture attention. Nevertheless, decision weights for target stimuli showed a significant advantage for self- compared with other-relevant motions. This suggests attention enhances feature-based selective attention for self-relevant motion vectors when task relevant. Hence, the ‘Self’s prioritized status is potentially due to target facilitation.

Self-relevance Facilitates Attention to Self-associated Targets on Feature-based Selective Attention Tasks

A commonly held assumption is that demonstration and pantomime differ from
ordinary action in that the movements are slowed down and exaggerated to be better
understood by intended receivers. This claim has, however, been based on meager
empirical support. This article provides evidence that different
functional demands of demonstration and pantomime result in motion characteristics
that differ from those for praxic action. In the experiment, participants were dressed
in motion capture suits and asked to (1) perform an action, (2) demonstrate this
action so that somebody else could learn how to perform it, (3) pantomime this
action without using the object so that somebody else could learn how to perform it,
and (4) pantomime this action without using the object so that somebody else could
distinguish it from another action. The results confirm that actors exaggerate and
slow down their movements in demonstrations and pantomimes when compared to
ordinary actions.


Premium content

Downloads

Next from CogSci 2023

Prediction and learning under unsignalled changing contexts

Similar lecture

How effective is perceptual training? Evaluating two perceptual training methods on a difficult visual categorisation task