CogSci 2025

•

August 01, 2025

•

San Francisco, United States

keywords:

computer-based experiment

interactive behavior

language understanding

artificial intelligence

pragmatics

This paper examines how LLMs handle false presuppositions and whether certain linguistic factors influence their responses to falsely presupposed content. Presuppositions subtly introduce information as given, making them highly effective at embedding disputable or false information. This raises concerns about whether LLMs, like humans, may fail to detect and correct misleading assumptions introduced as false presuppositions, even when the stakes of misinformation are high. Using a systematic approach based on linguistic presupposition analysis, we investigate the conditions under which LLMs are more or less sensitive to adopt or reject false presuppositions. Focusing on political contexts, we examine how factors like linguistic construction, political party, and scenario probability impact the recognition of false presuppositions. We conduct experiments with a newly created dataset and examine three LLMs: OpenAI's GPT-4-o, Meta's LLama-3-8B, and MistralAI's Mistral-7B-v03. Our results show that the models struggle to recognize false presuppositions, with performance varying by condition. This study highlights that linguistic presupposition analysis is a valuable tool for uncovering the reinforcement of political misinformation in LLM responses.

Downloads

SlidesPaperTranscript English (automatic)

Next from CogSci 2025

Helping and hindering guide infants' expectations about future behavior
technical paper

Helping and hindering guide infants' expectations about future behavior

CogSci 2025

+1
Bill Pepe and 3 other authors

01 August 2025

Similar lecture

Evaluating Large Language Models for Health-related Queries with Presuppositions
poster

Evaluating Large Language Models for Health-related Queries with Presuppositions

ACL 2024

Monojit Choudhury
Danish Pruthi
Navreet Kaur and 2 other authors

13 August 2024