CogSci 2025

•

August 02, 2025

•

San Francisco, United States

keywords:

quantitative behavior

language comprehension

artificial intelligence

linguistics

syntax

This study investigates whether large language models (LLMs) possess human-like syntactic competence by examining their handling of English center-embedded structures. Two experiments were conducted: one collected acceptability judgments from native speakers, confirming sensitivity to syntactic constraints; the other measured surprisal values from GPT-2 and Gemma 2 on grammatical versus ungrammatical center-embedded sentences. While both models distinguished between the two types probabilistically, they failed to replicate categorical human judgments. The results suggest that LLMs conflate low-frequency constructions with ungrammaticality, reflecting limitations in hierarchical syntactic understanding. It is argued that genuine linguistic competence requires more than statistical pattern recognition and advocate for integrating formal syntactic theory into model development. This work contributes to the ongoing dialogue between generative linguistics and AI, highlighting key distinctions between human cognition and current LLMs.

Downloads

PaperTranscript English (automatic)

Next from CogSci 2025

Schema-Induced Emotional Arousal Enhances Task Performance:  A Pupillometric Investigation of Top-Down Cognitive Influence
poster

Schema-Induced Emotional Arousal Enhances Task Performance: A Pupillometric Investigation of Top-Down Cognitive Influence

CogSci 2025

Emika Watanabe and 2 other authors

02 August 2025

Similar lecture