United States

The meanings of iconic signs are usually not easily accessible to sign-naive people. However, most previous studies asked participants to guess the meaning of iconic signs in isolation and without any contextual cues. We ask whether signs whose form is based on more cross-linguistically common underlying motivations are easier to interpret than signs based on less common underlying motivations. Since recent research suggests that iconicity is a relationship of resemblance between the signifier and the signified that is instantiated contextually, we also provide participants with a contextual cue (in the form of a word). We find that interpretability of iconic signs does correlate with cross-linguistic frequency of the underlying motivation of the sign.

CogSci 2023

Transparency in Sign Language Animal Signs

poster

The 45th Annual Meeting of the Cognitive Science Society will take place in Sydney, Australia as a modified hybrid conference. Presentations from the main-session room will be live-streamed every day for all events. This will include all invited talks and award sessions. Recordings of all CogSci 2023 sessions will be made available for on-demand viewing after the conference.<br>
The in-person component will be held at the International Convention Centre Sydney at Darling Harbour. The Conference will take place Wednesday July 26th – Saturday July 29th, 2023 (Wednesday, July 26th is the Workshops Day).

Join us!

<br>[**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2023/07/COgSci-PAAG-V2.pdf)
<br>[**The Detailed Program can be found here**](https://online.fliphtml5.com/ebtyf/mswz/)
<br><br>

#### **CogSci 2023 Program Book**
<iframe style="width:700px;height:400px" src="https://online.fliphtml5.com/ebtyf/tzgk/"  seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe>
<br>

The 45th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

How do people prepare for an upcoming distracting stimulus? It has been recently suggested that not only observers do not inhibit distractors before their appearance, but they are rather more alert at those moments. Interestingly, a similar effect was found when the observers were expecting a task-relevant, informative stimulus, supporting a mandatory "attend-all" mechanism. However, thus far, the preparation effect was only demonstrated in speeded dot-probe tasks and it is yet to be determined whether preparing for distractors merely facilitates motor preparation or whether it has other outcomes, such as modifying early perceptual processes. Replacing the dot-probe task with a four-letter difficult memory task revealed that memory encoding was facilitated when the letters appeared when informative stimuli were expected. In contrast, there was no benefit, nor cost, for memory encoding when distracting stimuli were expected. These results indicate that the preparation effect is more flexible than thought.

The consequences of preparing for informative or distracting stimuli

Perceptual-motor tasks offer redundant solutions to achieve a goal. However, not all solutions are equally robust to error-producing variability and thus, skill learning requires the search for behaviors that are error-tolerant. Throwing a ball to hit a target is a skill that has been studied via the “skittles” task, a simplified 2-dimensional throwing environment. This paper investigated whether participants learning the skittles task benefit from task scaffolding via the placements of targets provided by either a human confederate posing as a teacher, or by the participant. These groups were compared to a third sample who received an unstructured curriculum consisting of randomly placed targets. The results demonstrate that participants in the unstructured training condition were better able to perceive the task’s underlying solution geometry, compared to scaffolding provided by a human. Future work will explore methods to design training curricula that are more efficient in facilitating perceptual-motor skill development.

Influence of Curriculum Structure on Early Skill Learning during a Virtual Throwing Task

Response inhibition—our ability to suppress actions—is achieved through coordinated reactive and proactive processes that may recruit different neurophysiological mechanisms. Here we adapted a two-step continuous performance task in which the decision to respond depends on a combination of an initial context cue and a subsequent target probe. Using transcranial magnetic stimulation (TMS), we mapped changes in corticospinal excitability and inhibition, providing indices of reactive and proactive processes that influence the state of the motor system in the lead-up to initiating or suppressing a response. We found distinct changes in corticospinal excitability at critical timepoints when participants were preparing in advance to inhibit a response (during the cue) and while inhibiting a response (during the probe). Motor system activity during early timepoints correlated with behavioural indices of proactive capacity and predicted whether participants would later successfully inhibit their response. Implications for theories of inhibitory control will be discussed.

Distinct patterns of proactive and reactive inhibition in the human motor system

The ability to discriminate between large and small quantities is a core aspect of basic numerical competence in both humans and animals. In this work, we examine the extent to which the state-of-the-art neural networks designed for vision exhibit this basic ability. Motivated by studies in animal and infant numerical cognition, we use the numerical bisection procedure to test number discrimination in different families of neural architectures. Our results suggest that vision-specific inductive biases are helpful in numerosity discrimination, as models with such biases have lowest test errors on the task, and often have psychometric curves that qualitatively resemble those of humans and animals performing the task. However, even the strongest models, as measured on standard metrics of performance, fail to discriminate quantities in transfer experiments with differing training and testing conditions, indicating that such inductive biases might not be sufficient.

Evaluating Visual Number Discrimination in Deep Neural Networks

Recent work in computer vision and cognitive reasoning has given rise to an increasing adoption of the Violation-of-Expectation (VoE) paradigm in synthetic datasets. Inspired by infant psychology, researchers are now evaluating a model’s ability to label scenes as either expected or surprising with knowledge of only expected scenes. However, existing VoE-based 3D datasets in physical reasoning provide mainly vision data with little to no heuristics or inductive biases. Cognitive models of physical reasoning reveal infants create high-level abstract representations of objects and interactions. Capitalizing on this knowledge, we established a benchmark to study physical reasoning by curating a novel large-scale synthetic 3D VoE dataset armed with ground-truth heuristic labels of causally relevant features and rules. To validate our dataset in five event categories of physical reasoning, we benchmarked and analyzed human performance. We also proposed the Object File Physical Reasoning Network (OFPR-Net) which exploits the dataset's novel heuristics to outperform our baseline and ablation models. The OFPR-Net is also flexible in learning an alternate physical reality, showcasing its ability to learn universal causal relationships in physical reasoning to create systems with better interpretability.

A Benchmark for Modeling Violation-of-Expectation in Physical Reasoning Across Event Categories

In cognitive science, we often assume that human learning is characterized by a limited capacity to represent the information relevant for a given task. We argue that excess capacity --- using more representational resources than needed for a task at hand --- is a plausible alternative paradigm for the study of human learning. Through a review of recent results from machine learning, we show that excess capacity is consistent with high predictive ability. Through review of cognitive science literature, we demonstrate that excess capacity learning can account for a range of empirical phenomena, such as humans' simultaneous yet apparently contradictory tendency to both memorize observations and capture higher-level patterns in them, as well as a tendency to learn complex and redundant solutions to the tasks. We conclude by discussing promising directions for future inquiry under the excess capacity learning paradigm.

Excess Capacity Learning

Efficient representation of our motor memories is essential for developing and deploying the plethora of human motor skills we use every day, yet there is little cohesion in understanding how these representations are organized and develop over time. In this study, we developed a novel behavioral paradigm aimed at probing experience-dependent representational change of a motor skill with training. Across several experiments, participants trained to coordinate novel finger configurations in a speeded reaction time task and performed a similarity judgment task to probe for changes in the psychological representation of the recently acquired skill. We sought to determine if learned representations of action can be found through behavioral methods and if such representations are organized based on similarity and independent reorganization patterns predicted by theories of sensorimotor neuroscience. Together, we propose a novel behavioral measure complementary to neuroimaging capable of observing human representational change of a motor skill over time.

Experience-Dependent Representational Change During Motor Skill Learning

In cognitive science, research about mental imagery is often limited to visual, often overlooking olfactory imagery. In this study, we examined the relationship between beauty and olfactory imagery evoked by haiku. We used an odor priming that is commonly used in cognitive science to measure olfaction so that we could examine the effects of environmental aromas on the aesthetic experience. 44 participants were asked to evaluate 30 haikus. Half of them were exposed to a cypress aroma while the other half had no aroma exposure. The results showed that olfactory imagery during haiku appreciation positively influenced the beauty of haiku, and higher olfactory imagery ability led to a deeper immersion in the haiku. Odor priming did not affect evaluations, but it did affect gaze bias as measured by eye tracking. This is the first time to demonstrate the influence of olfactory imagery on aesthetic evaluation in psychology of aesthetics.

Scent of Poetry: Influence of Olfactory Imagery during Haiku Appreciation on Aesthetic Evaluation

This study (n=64) investigated the influence of manipulating the face contour on the face inversion effect (better recognition performance for upright vs inverted upside-down faces) and on face recognition in general. The study used upright and inverted scrambled faces which suffer from disruption of the configural information (spatial relationships among the facial features) typically found in normal faces. This is because we aimed to isolate the face contour information from the configural information. A delayed- matching task was adopted to ensure a high level of recognition performance, especially for inverted faces. The results revealed no significant difference between the inversion effect for scrambled faces with the normal contour vs that for scrambled faces with the manipulated (blurred) contour. Critically, we found an effect on overall recognition performance whereby scrambled faces with the blurred contour suffered greatly from the manipulation. Our results suggest that the face contour affects overall face recognition performance.

Manipulating the face contour reduces overall recognition performance for scrambled faces

Aesthetic value, beauty, is a complex concept in that it has both subjective and objective aspects. However, in previous eye-tracking studies of artworks, the target associated with the gaze has often been only the latter image feature (e.g., symmetry). By contrast, recent developments in computational aesthetics (especially aesthetic classifiers) offers a path that treats these two aspects comprehensively. Along this line, we further develop eye-tracking research. We conducted computational-model-based data analyses of eye-tracking behavior, with the aim of providing more fine-grained insights into the comprehensive concept of beauty. In contrast to previous studies that focused on Western fine-artworks, our study is distinctive in that it focuses on visual art in Eastern culture, namely Japanese ukiyo-e (the well-known works of Katsushika Hokusai and Utagawa Hiroshige). Our empirical results showed that the gaze trajectory and movement area differed significantly between highly-rated and non-highly-rated paintings. This provides positive evidence for the relationship between aesthetic value and perceptual behavior.

Premium content

Transparency in Sign Language Animal Signs

Next from CogSci 2023

The consequences of preparing for informative or distracting stimuli