United States

Sentiment and emotion embody intrinsic experience of human cognition, both of which have the profoundly influence on the cognitive processes in humans. The commonality between sentiment and emotion leads to the fact that sentiment classification and emotion recognition are two correlated tasks in cognitive science and artifical intellignce (AI). One task improves its performance by leveraging similarities and differences across tasks. However, recent works have often treated them as two separately different tasks, where their commonalities have largely been neglected. To fill this gap, we propose a multi-task interactive graph attention network with position encodings, termed MIP-GAT. The main proposal is a multi-interactive graph interaction layer where a syntactic dependency connection, a cross-task connection and position encodings are constructed and incorporated into a unified graphical structure. Empirical evaluation on two benchmarking datasets, i.e., CMU-MOSEI and GoEmotions, shows the effectiveness of the proposed model over state-of-the-art baselines. In addition, we also explore the superiority and limitations of the proposed model.

CogSci 2023

MIP-GAT: A Multi-Task Interactive Graph Attention Network with Position Encodings for Joint Sentiment Classification and Emotion Recognition

The purpose of the AAAI conference is to promote research in artificial intelligence (AI) and scientific exchange among AI researchers, practitioners, scientists, and engineers in affiliated disciplines. 

AAAI 2021

poster

The 45th Annual Meeting of the Cognitive Science Society will take place in Sydney, Australia as a modified hybrid conference. Presentations from the main-session room will be live-streamed every day for all events. This will include all invited talks and award sessions. Recordings of all CogSci 2023 sessions will be made available for on-demand viewing after the conference.<br>
The in-person component will be held at the International Convention Centre Sydney at Darling Harbour. The Conference will take place Wednesday July 26th – Saturday July 29th, 2023 (Wednesday, July 26th is the Workshops Day).

Join us!

<br>[**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2023/07/COgSci-PAAG-V2.pdf)
<br>[**The Detailed Program can be found here**](https://online.fliphtml5.com/ebtyf/mswz/)
<br><br>

#### **CogSci 2023 Program Book**
<iframe style="width:700px;height:400px" src="https://online.fliphtml5.com/ebtyf/tzgk/"  seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe>
<br>

The 45th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

Humans can successfully interpret images even when they have been distorted by significant image transformations. Such images aid in differentiating existing computational models for perception because models which predict similar results for typical stimuli that may diverge when confronted with atypical stimuli. In this work, we propose an explanation of people's ability to perceive a specific class of degraded stimuli that requires extreme generalization capabilities: Mooney, or two-tone, faces. We provide a parametric and controllable method to generate Mooney faces and a hypothesis about how the human visual system might be able to perceive such extreme precepts. We show that Mooney faces can be approximated under extreme illumination conditions; a computer graphics perspective on the Mooney image formation process suggests inverse graphics as a model for perceptual generalization and possibly everyday perception. With various visual examples, we argue that Mooney faces are important in the understanding the role of generative models and inverse graphics in human visual processing.

Perception of Mooney Faces: Extreme Generalization through Inverse Rendering?

Cross-lingual adaptation has shown effectiveness in low-resource spoken language understanding (SLU) systems.
However, existing approaches often show unsatisfactory performance on intent detection and slot filling, especially for distant languages,
which are dramatically different from source language in scripts, morphology, or syntax.
To solve the aforementioned challenges, we propose Latent Dialogue Action (LaDA) layer to 
optimize decoding strategy.
The model consists of an extra latent dialogue action layer. It enables our model to enhance a system’s ability to
handle conversations in complex multi-lingual intent and slot value of distant languages.
To our best knowledge, our work is the first
comprehensive study of the use of latent variables for cross-lingual SLU
policy optimization during decode stage. LaDA
achieves state-of-the-art results in zero-shot and few-shot adaptation both on public datasets.

LaDA: Latent Dialogue Action For Zero-shot Cross-lingual Neural Network Language Modeling

In this work, we propose an interpretable knowledge tracking model (KVFKT) based on key value and forgetting. This model maintains the students’ knowledge state matrix in each memory unit, and also maintains the corresponding forgetting matrix to track the last review timestamp of students’ knowledge points. In addition, this model introduces the IRT two parameter model from the perspective of educational psychology to further enhance the interpretability of the model. Finally, the model is tested on four real-world datasets, and the experimental results prove the advantages of the method described in this paper.

An Interpretable Model With Forgetting Matrix For Deep Knowledge Tracking

The unprecedented spread of smartphone usage and its various boarding sensors have been garnering increasing interest in automatic mental health detection. However, there are two major barriers to reliable mental health detection applications that can be adopted in real-life: (a)The outputs of the complex machine learning model are not explainable, which reduces the trust of users and thus hinders the application in real-life scenarios. (b)The sensor signal distribution discrepancy across individuals is a major barrier to accurate detection since each individual has their own characteristics. We propose an explainable mental health detection model. Spatial and temporal features of multiple sensory sequences are extracted and fused with different weights generated by the attention mechanism so that the discrepancy of contribution to classifiers across different modalities can be considered in the model. Through a series of experiments on real-life datasets, results show the effectiveness of our model compared to the existing approaches.

Personalized multi-task attention for multimodal mental health detection and explanation

Thousands of learners are taking massive Open Online courses (MOOCs) in search of learning and self-improvement opportunities. However, the learning process often involves a struggle with confusion, which can adversely affect the course participation experience, leading to dropout halfway through. At the same time, it is impossible for the instructors to recognize and respond “confusion” posts from all posts accurately and timely, due to the large volume of registrants. This study identifies "confusion" posts that require instructors' attention through the BERT-CNN model and performs an attribution analysis of confusion based on the visualization results of confusion types and language features. We find that posts identified as "confused" actually represent different information needs of learners, which are mainly related to cognitive and social processes. Furthermore, we evaluated the BERT-CNN model with a 13% improvement in F1 value compared to previous studies and successfully applied it across unseen domains.

Feature Visualization and Attribution Analysis of Confusion for Massive Open Online Course

Behavior Trees (BTs) are widely used in many games, however, they are normally designed in a static way which is hard to deal with dynamic environments. One of the factors that restrict the performance of BTs is the optimization of resources used among sub-tasks, which has not been paid much attention. In this paper, we concentrate on the problem of dynamic allocation of agents for BTs, i.e., an important resource in games. We design a novel hierarchical learning framework, including the allocation learning module and the action learning module, to find strategies for agent allocation and action selection. Each agent is associated with a network for encoding observations, which is then assigned to a sub-task by the allocation learning network. Each sub-task uses a network to compute the action for the corresponding agent. We design how the losses are computed for the two modules respectively and present the whole training procedure. Finally, we examine the performance of the proposed framework on a well-known game, i.e., Google Research Football. The results show that each module works effectively and the whole framework improves the performance of BTs greatly. This work will have an important significance for the community of the usage of BTs.

Dynamic Agent Allocation with Reinforcement Learning for Applying Behavior Trees in Games

Despite increased interest in creating more diverse and inclusive organizational environments, scholars still have relatively little understanding of the cognitive mechanisms underlying leadership formation and how biases against marginalized groups are learned and maintained. Drawing from leadership emergence theory, we investigate potential interventions that support diverse leaders. Using agent-based simulations, we model a collective search process on a fitness landscape. Agents combine individual and social learning, and are represented as a feature vector blending relevant (e.g., individual learning characteristics) and irrelevant (e.g., race or gender) traits. Agents learn how to weigh the traits of others on the basis of reward expectations and dynamically adjust the connections of their social network to grant leadership. By initializing the network to privilege agents with irrelevant traits, we can create biases in how agents weigh certain traits. This framework allows us to test interventions to unlearn bias in favor of performance-relevant traits.

Unlearning the bias: An agent-based simulation for increasing diverse representation through leadership emergence

The ability to detect and analyze a human figure is key to our survival and social interactions. Efficient and robust identification of body parts can help to interpret images when bodies are partially occluded. While previous studies emphasized the configural processing of whole bodies using simplified stimuli, it still remains unclear how local contexts about body parts are integrated to resolve ambiguities (e.g., from occlusion) regarding the identities of or spatial relations among body parts. In a series of online experiments, we asked human observers to identify one ambiguous target body part in the presence of another “context” part. Our results showed that humans can use various amounts of spatial context to discount local ambiguities in natural images of pairs of parts, and are sensitive to low- and mid-level cues such as alignment and connectedness. Further simulations using computational models showed that the models with pairwise relational knowledge based on local part appearances failed to capture human sensitivity to relational properties of spatial context between pairs of body parts. Our results provided behavioral evidence in the human visual representations of various spatial relations between pairs of body parts and revealed different representations of spatial context used in humans and models.

Identifying Body Parts in the Spatial Context of Pairwise Relations: Human Psychophysics and Model Simulations

This study describes the experimentally developed technique of sentiment analysis in an automatic semantic parser that processes daily news input blocks. The 2022 time period was used to analyze news in Telegram channels published by twelve official news agencies and five influential non-official news sources. In the advanced analytical system that we present, automatic learning is combined with a frame-based approach to identify patterns that influence judgments based on a frame representation of the text. The parser analyzes the syntactic structure of each sentence input, constructs its semantic representation, and associates it with one of 3800 semantic frames extracted from a large text corpus. The research revealed that the relative frequency and combination of frames varied between the two groups of news sources. The results prove that news is conceptualized and represented by various media sources in very different ways with the potential to affect the recipient's beliefs and emotions.

Automated Semantic Frame Analysis of Telegram News Channels

We present two models of visual location memory developed within the ACT-R cognitive architecture and compare the model’s performance to that of human participants in a pattern reproduction task. The snapshot model has a fovea-peripheral based activation mechanism, which simulates how more attention and processing resources are given to the centre of the visual field for short stimulus expo-sure trials (50ms and 200ms). For long exposure trials (>=1s), a chunking model was developed based on the snap-shot model by adding chunking processes which can en-code geometric patterns. Both models can match the task response accuracy and pause data of human participants. The results of the modelling reveal that for the short stimulus exposure trials the accuracy of recall is affected by the distance between the object location and the fovea vision location. For trials with long stimulus exposure times, participants were likely to use salient geometric patterns to encode the configuration of discs.


Premium content

Downloads

Next from CogSci 2023

Perception of Mooney Faces: Extreme Generalization through Inverse Rendering?

Similar lecture

Co-GAT: A Co-Interactive Graph Attention Network for Joint Dialog Act Recognition and Sentiment Classification