Singapore

This study investigates the intuitive relationship between manual gestures and vocal syllables, grounded in shared neurobiological and motor systems. Participants were tasked with producing &quot;Synekinian pairs,&quot; consisting of vocal syllables paired with instinctive gestures. Through qualitative and quantitative analyses, the findings reveal consistent patterns in manual-vocal associations, offering insights into gesture-based sound design, vocal synthesis, gesture notation and human-computer interaction. Future work aims to refine the experimental methodology, expand datasets, and validate these observations across diverse cultural and linguistic contexts.

AAAI 2026

Exploring “Synekinian Pairs”: Manual-Vocal Gesture Integration in Experimental Contexts

human–computer interaction.

gesture-based sound design

speech articulation

manual–vocal gesture integration

gesture analysis

multimodal interaction

AAMAS is the largest and most influential conference in the area of agents and multiagent systems, bringing together researchers and practitioners in all areas of agent technology and providing and internationally renowned high-profile forum for publishing and finding out about the latest developments in the field. AAMAS is the flagship conference of the non-profit International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS).  

![](https://assets.underline.io/uploads/markdown_image/1/image/ce4604bd54468a006164d16e080204fb.jpg)

Please click on the button below to register for this event.

If you are registered and see this page please check the account email you are logged in with. It must be the same as for the registration.

If you still have trouble accessing the contact please contact support at aamas2021@underline.io 

AAMAS 2021

This study investigates the intuitive relationship between manual gestures and vocal syllables, grounded in shared neurobiological and motor systems. Participants were tasked with producing "Synekinian pairs," consisting of vocal syllables paired with instinctive gestures. Through qualitative and quantitative analyses, the findings reveal consistent patterns in manual-vocal associations, offering insights into gesture-based sound design, vocal synthesis, gesture notation and human-computer interaction. Future work aims to refine the experimental methodology, expand datasets, and validate these observations across diverse cultural and linguistic contexts.

workshop paper

We are pleased to announce the Fortieth AAAI Conference on Artificial Intelligence (AAAI-26), which will be held in Singapore EXPO from January 20 to January 27, 2026.

The purpose of the AAAI conference series is to promote research in Artificial Intelligence (AI) and foster scientific exchange between researchers, practitioners, scientists, students, and engineers across the entirety of AI and its affiliated disciplines. AAAI-26 will feature technical paper presentations, special tracks, invited speakers, workshops, tutorials, poster sessions, senior member presentations, competitions, and exhibit programs, and a range of other activities to be announced.<br><br>

To access this event page, you need to log in with the **email address you registered with**. <br>Access credentials will be sent to your email from Underline -  subject line "Welcome to AAAI 2026". Please be sure to check your spam email folder if you do not see an email confirmation right away.

Please log in

To access this event page, you are required to register.
Please complete your registration to continue.

We recommend reading [**the registration information**](https://aaai.org/conference/aaai/aaai-26/registration/) first.

**Online Registration Form**: https://aaai.getregistered.net/conference-2026 

Registration Required

We are pleased to announce the Fortieth AAAI Conference on Artificial Intelligence (AAAI-26), which will be held in Singapore EXPO from January 20 to January 27, 2026.

This study investigates how audiences perceive humor in both Human-created and AI-generated Manzai scripts, a traditional Japanese form of scripted stand-up comedy performed by a pair of comedians. We analyze laughter responses using two complementary modalities: explicit laughter, captured through real-time reaction-button inputs, and implicit laughter, measured via mouth-corner motion tracking. Comparative experiments are conducted to evaluate differences between Human-created and AI-generated Manzai scripts. The results reveal that while AI-generated Manzai scripts can elicit explicit laughter to a certain extent, it is less effective in inducing implicit laughter compared to Human-created script. Implicit laughter is observed only when explicit laughter occurred, suggesting that unconscious emotional reactions may precede conscious recognition of humor. Moreover, Human-created Manzai scripts that are contextually relatable and easy to imagine produced larger and more sustained mouth-corner movements, indicating that empathy and contextual understanding play key roles in embodied humor perception. These findings demonstrate that mouth-corner motion is a reliable indicator of subtle amusement and provide new insights into Bodily Expressed Emotion Understanding (BEEU) for AI-generated humor.

Understanding Bodily Expressed Laughter Responses to Human and AI-Generated Japanese Manzai scripts

Predicting Valence-Arousal-Dominance (VAD) dimensions from bodily-expressed emotions in videos remains a fundamentally challenging task in affective computing, requiring models that capture subtle spatiotemporal patterns while balancing computational efficiency and interpretability. We present a comprehensive investigation of VAD prediction approaches on the newly introduced Annotated Bodily Expressed Emotion (ABEE) dataset, which contains approximately 3,200 video clips spanning 8 primary emotion categories and 20 subcategories. We explore two complementary methodologies: a feature-based gradient boosting approach using XGBoost with carefully engineered spatiotemporal features and dimensionality reduction, and deep learning architectures capable of learning hierarchical representations directly from raw video data. Our feature-based approach demonstrates exceptional computational efficiency, with sub-second training times and minimal resource requirements, while our deep models reveal the fundamental difficulty of capturing continuous VAD dimensions from bodily expressions. Through systematic evaluation on the ABEE dataset, we establish baseline performance for the VAD prediction task, achieving $R^2$ scores of -0.090, -0.014, and -0.058 for valence, arousal, and dominance, respectively, with our gradient boosting approach. These results highlight the substantial gap between current methodologies and the inherent complexity of bodily emotion signals, providing benchmarks for future research. We further discuss critical insights regarding feature engineering, temporal dynamics, and the intrinsic challenges of continuous emotion prediction from naturalistic video data, emphasizing the need for dedicated spatiotemporal modeling strategies tailored to bodily expressions.

Spatiotemporal Modeling of Bodily Emotional Expressions for Continuous Valence-Arousal-Dominance Prediction in Video

Sketching is a widely used medium for generating and exploring early-stage design concepts. While generative AI (GenAI) chatbots are increasingly used for idea generation, designers often struggle to craft effective prompts and find it difficult to express evolving visual concepts through text alone. In the formative study (N=6), we examined how designers use GenAI during ideation, revealing that text-based prompting disrupts creative flow. To address these issues, we developed TalkSketch, an embedded multimodal AI sketching system that integrates freehand drawing with real-time speech input. TalkSketch aims to support a more fluid ideation process through capturing verbal descriptions during sketching and generating context-aware AI responses. Our work highlights the potential of GenAI tools to engage the design process itself rather than focusing on output.

TalkSketch: Multimodal Generative AI for Real-time Sketch Ideation with Speech

The capacity for complex, evidence-grounded, and strategically adaptive persuasion remains a formidable grand challenge for artificial intelligence. Prior work, like IBM Project Debater, focused on generating isolated persuasive speeches in highly simplified and shortened debate formats for lay audiences. We introduce a novel autonomous system capable of participating in and winning a full, unmodified two-team competitive policy debate. Our system employs a hierarchi cal architecture of specialized multi-agent workflows, where teams of LLM-powered agents collaborate and critique one an- other to perform discrete argumentative tasks. Each workflow
utilizes iterative retrieval, synthesis, and self-correction using a massive corpus of policy debate evidence (OpenDebateEvidence) [Roush et al. 2024] and produces complete speech transcripts, cross-examinations, and rebuttals. We introduce a live, interactive end-to-end presentation pipeline that renders debates with AI speech and animation: transcripts are surface realized and synthesized to audio with OpenAI text-to-speech (gpt-4.1-tts), and then displayed as talking-head portrait
videos with EchoMimic V1 [Chen et al. 2024, 2025, OpenAI 2025e,c]. Beyond fully autonomous (AI vs. AI) matches, the system supports hybrid human–AI operation: human debaters can intervene at any stage, and humans can optionally serve as opponents against the AI in any speech, enabling AI–human as well as AI–AI rounds. In preliminary evaluations against human-authored cases, our system produces qualitatively superior argumentative components and consistently wins simulated rounds as adjudicated by an independent autonomous judge. Expert human debate coaches also prefer the arguments, evidence, and cases constructed by our system.

A superpersuasive autonomous policy debating system

MOVE-ME is a wearable AI system that functions as a choreographic companion, designed to interrupt and inspire dancers’ improvisational flow in real time. Equipped with an on-body camera and speech synthesis, the system observes the dancer’s environment and responds to visual input and text prompts with spoken suggestions. These responses, ranging from poetic provocations to site-specific directives, create a feedback loop in which human and machine co-compose movement, challenging distinctions between spontaneity and computation, authorship and obedience.
The project explores AI as a relational agent rather than as a tool, an intelligent presence that shapes choreography through co-creation. MOVE-ME was featured in three practice-based research projects between 2024–2025, each testing different choreographic configurations and affective dynamics.

MOVE-ME: Dance Choreography with AI

This study presents a cross-cultural implementation of an artistic Brain–Computer Interface (BCI) and generative artificial intelligence (GenAI) system designed for live performance within the Balinese gamelan tradition. The BCI-GenAI system enables real-time translation of neural synchrony between dyads of performers (musician-musician, dancer-dancer, musician-dancer) into the control of culturally-relevant generative visual projections that interact with performers and audience alike.
Nine Balinese artists (six musicians and three dancers) participated in a two-part performance Janaki Dewi: Sita’s Reverie and Wiwada Manik: Tales of the Brothers. Dyads of artists wore Mobile Brain-Body Imaging (MoBI) technology to capture in real time their brain (electroencephalography, EEG) and ocular (electrooculography, EOG) activities, head motion, and video during rehearsals and a public performance over a period of 3 weeks. All signals were synchronized by hardware. A Brain-Computer Interface (BCI) preprocessed the MoBI Signals and computed the inter-brain synchrony between dyads. Synchrony indices derived from EEG bispectra modulated diffusion parameters in a StreamDiffusion-based GenAI, whereas text prompts consisting of culturally-relevant narrative and emotional descriptors reflected the story’s mythological and affective dimensions. Thus, the BCI-GenAI system linked the real-time inter-brain synchronization to dynamic imagery projected live on stage. The system thus functioned as a creative partner in-the-loop, responsive to both the emotional and rhythmic structure of performance. The multi-institutional, cross-cultural project contributes a methodological framework for BCI-GenAI in artistic settings, emphasizing cross-cultural collaboration, the symbiosis between cultural traditions and emergent technologies, and ethical data governance. It advances a model of responsible human–AI co-creation, where technology supports rather than displaces tradition thereby preserving the continuity of cultural identity through innovation, team science and transdisciplinarity.

An Artistic BCI-GenAI System Enabling Real-Time Co-Creation in Balinese Performance

This work-in-progress introduces SightDog, a hybrid framework that equips a robotic quadruped with multimodal artificial intelligence to support blind and visually impaired users. Designed as a robotic guide dog, SightDog integrates Vision–Language Models (VLMs) with schema-driven function calling to interpret natural language instructions and visual perception for navigation and assistance. A central focus is human–robot interaction: SightDog enables natural language dialog, provides contextual feedback, and adapts its responses to user intent in real time. In doing so, the system demonstrates a form of creative communication, where improvisation and adaptive dialog play a crucial role. In a simulation study, we show that SightDog can deliver environmental information and perform reactive navigation toward user-specified goals while managing obstacles and crosswalks. As part of this creative HRI, the system can also engage in informal dialog (e.g., telling casual jokes, which we illustrate in the experiment provided). While primarily an assistive prototype, the system also raises questions for interactive and creative AI, particularly regarding how AI systems respond to improvised human input. By situating SightDog within both accessibility and interactive AI research, this work contributes to discussions on human–robot collaboration and the future of guidance technologies.

SightDog: Function Calling and Creative Dialogue for AI‑Enhanced Guide Dogs

Recent advances in image generative models have enabled
rich collaborations between humans and AI systems. Among
these, Energy-Based Models (EBMs) learn an energy land-
scape that guides noised samples toward high-probability re-
gions. Unlike diffusion models that use fixed time sched-
ules, EBMs possess equilibrium properties that enable user
feedback during generation without destabilizing the distri-
bution. However, current EBM research primarily optimizes
for high-fidelity images, offering little control over the trade-
off between semantic realism and fine-grained diversity—an
essential feature for interactive creative applications. Artists
and creatives thus lack a modality to balance semantic coher-
ence (e.g., “a red apple”) with creative variation (e.g., apples
of different shapes or colors). To address this, we introduce
a geometry-aware annealing framework for EBMs. We pro-
pose a directionally-aware annealing variable that leverages
local geometric information to directionally adjust the effec-
tive noise level during sampling. Such an annealing feedback
mechanism that allows users to generate semantically real-
istic images before progressively exploring higher-diversity,
more creative variants. Together, these techniques enable a
controllable balance between fidelity and creativity, advanc-
ing the use of EBMs for interactive creative AI.

Geometry-Aware Energy-Based Image Modelling

Algorithmic fairness has grown rapidly, yet key concepts remain unsettled in criminal justice. We review group, individual, and process fairness and map the conditions under which they conflict. We then develop a simple modification to standard group fairness. Rather than exact parity across protected groups, we minimize a weighted error loss while keeping differences in false negative rates within a small tolerance. This improves feasibility, raises accuracy, and highlights the ethical choice of error costs. We situate this proposal within three classes of critique: biased and incomplete data, latent affirmative action, and the explosion of subgroup constraints. Finally, we propose a practical framework for deployment in public systems, built on three pillars: need-based decisions, transparency, and narrowly tailored solutions. Together, these elements link technical design to legitimacy and provide actionable guidance for agencies that use risk assessment and related tools.

Alternative Fairness and Accuracy Optimization in Criminal Justice

Catastrophic forgetting remains a critical challenge in continual learning for large language models (LLMs), where models struggle to retain performance on historical tasks when fine-tuning on new sequential data without access to past datasets. In this paper, we first reveal that the drift of functional directions during the fine-tuning process is a key reason why existing regularization-based methods fail in long-term LLM continual learning. To address this, we propose Dynamic Orthogonal Continual (DOC) fine-tuning, a novel approach that tracks the drift of these functional directions and dynamically updates them during the fine-tuning process. Furthermore, by adjusting the gradients of new task parameters to be orthogonal to the tracked historical function directions, our method mitigates interference between new and old tasks. Extensive experiments on various LLM continual learning benchmarks demonstrate that this approach outperforms prior methods, effectively reducing catastrophic forgetting and providing a robust tool for continuous LLM fine-tuning.

Downloads

Next from AAAI 2026

Understanding Bodily Expressed Laughter Responses to Human and AI-Generated Japanese Manzai scripts

Similar lecture

It's A Match! Gesture Generation Using Expressive Parameter Matching

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from AAAI 2026

Understanding Bodily Expressed Laughter Responses to Human and AI-Generated Japanese Manzai scripts

Similar lecture

It's A Match! Gesture Generation Using Expressive Parameter Matching

Downloads