CogSci 2025

•

August 02, 2025

•

San Francisco, United States

keywords:

computer-based experiment

emotion perception

learning

artificial intelligence

emotion

Multimodal sentiment analysis (MSA) recognizes human sentiments with various data modalities. Existing works primarily focus on efficient feature extractors for each modality or multimodal fusion frameworks. However, they do not exploit the sentiment-related prior knowledge in the human brain, limited in their performance when sentiment cues tend to be more implicit and ambiguous. To address this problem, we propose a rationale-guided prompt learning optimization framework (RaPo) inspired by the sentiment chains of biological brains. Specifically, we adopt a chain-of-thought prompt to analyze images with a large visual-language model, generate the corresponding contextual captions and rationales, which are then combined to derive the sentiment prompt. Finally, the prompt is used to optimize the RaPo framework through the designed rationale-guided prompt tuning. Experiments on several MSA tasks consistently show an outperformance of several state-of-the-art methods, with an average increase in accuracy by 2.8%.

Downloads

PaperTranscript English (automatic)

Next from CogSci 2025

The increase in brain network modularity leads to improved memory performance in the volitional eyes-closed state
poster

The increase in brain network modularity leads to improved memory performance in the volitional eyes-closed state

CogSci 2025

+4
Guiyang Lv and 6 other authors

02 August 2025

Similar lecture

Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors
poster

Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors

ACL 2022

Yang Wu
+4
Yang Wu and 6 other authors

24 May 2022