Canada

The semantic relation between a verb and its argument rapidly impacts language comprehension much like world knowledge and the linguistic context (Altmann &amp; Steedman, 1988; Kutas &amp; Hillyard, 1984; McRae et al., 1998). As part of the socially situated context, register could incrementally modulate comprehension and interact with standard language knowledge processing. Two self-paced reading experiments with an additional picture selection task examined how social-formality contexts and their (mis)matches with register use are comprehended in the presence of verb-argument semantic relation (mis)matches. We assessed whether comprehenders can rapidly adapt to shifting situation formality (Exp 2, N=64), or whether they benefit from habituation enabled by blocked presentation of formality (Exp 1, N=64). We successfully replicated incremental verb-argument (mis)match effects. No significant register effect was found, but the observed picture selection accuracy patterns could be taken to suggest that the processing of social contextual information might impact late sentence processing.

CogSci 2022

The interplay of situation-formality register congruence and verb-argument relations

Join us for CogSci2022! Our 44th Annual Conference will be centered around the theme of diversity, with an accompanying range of keynotes and invited speakers who themselves highlight the diversity of our field. Our three symposia are Cognition across Diverse Populations, Cognition within Diverse Societies, and Global Challenges for Cognitive Science. The conference is being offered in a fully hybrid environment for onsite and online attendees.
 
 [**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2022/07/Cogsci-2022-PAAG-Detailed-July-12final-1.pdf)
 [**The Detailed Program can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2022/08/DeArmond-CogSci2022-program-v113-final.pdf)

This conference requires a registration to attend. Please use the link below to secure your ticket. The website will be available to all registered attendees on July 25th. 

[Register to Attend](https://cognitivesciencesociety.org/registration/)

Registration Is Required

The 44th Annual Meeting of the Cognitive Science Society highlighted research on the theme Cognitive Diversity in addition to the full breadth and diversity of research topics offered by the society’s membership. 





The semantic relation between a verb and its argument rapidly impacts language comprehension much like world knowledge and the linguistic context (Altmann & Steedman, 1988; Kutas & Hillyard, 1984; McRae et al., 1998). As part of the socially situated context, register could incrementally modulate comprehension and interact with standard language knowledge processing. Two self-paced reading experiments with an additional picture selection task examined how social-formality contexts and their (mis)matches with register use are comprehended in the presence of verb-argument semantic relation (mis)matches. We assessed whether comprehenders can rapidly adapt to shifting situation formality (Exp 2, N=64), or whether they benefit from habituation enabled by blocked presentation of formality (Exp 1, N=64). We successfully replicated incremental verb-argument (mis)match effects. No significant register effect was found, but the observed picture selection accuracy patterns could be taken to suggest that the processing of social contextual information might impact late sentence processing.

poster

The subjective value of a choice option is modified by its potential outcomes, when those outcomes will be realized, how likely the outcomes are, and the valence associated with these outcomes (gains, losses). People’s preferences in risky or intertemporal choice are often described by models like hyperbolic discounting, expected utility theory, and prospect theory. This study tested these models by eliciting hypothetical monetary choices along a continuum of tradeoffs between amount versus delay, amount versus risk, and amount to be gained versus amount to be lost. Offering a continuum of options allowed us to test qualitative predictions of the model – for example, a hyperbolic discounting model predicts that participants should never respond in the middle of a continuous scale where payoff is a linear function of delay. The results qualitatively falsify several common models, suggesting that current theories of binary choice are insufficient to account for valuation along a continuum.

Impulsivity, risk-taking, and loss aversion in a continuous response task

One of the key issues in visual word recognition is the role of orthographic overlap in priming. However, most research investigating this topic has focused on priming with orthographic neighbors. In this study, we investigate priming effects of word-final letter overlap and their interaction with word frequency, prime duration, and morphology. In Experiment 1 with briefly presented primes (SOA=34 ms, N = 123), we obtained similar facilitation from non-morphological overlap (compel-TRAVEL) and inflectional suffix overlap (turned-CALLED), regardless of word frequency. In Experiment 2 when primes were fully recognizable (SOA=150 ms, N=123), only non-morphological overlap showed inhibition among lower frequency prime words. These results are inconsistent with predictions of the Interactive Activation model (McCelland and Rumelhart, 1981), and suggest (i) different weights of inhibition and facilitation depending on prime duration and morphological structure of words as well as (ii) the involvement of a reset mechanism in long SOA conditions.

Word-final orthographic priming as a function of word frequency, prime duration, and morphological status

As widely acknowledged in the bilingualism literature, language experience is multifaceted, complex, and dynamic; it cannot be simply reduced to single dimensions or categories. However, cognitive science research outside of bi/multilingualism does not always take into account this fact. Within a population of Hindi-Urdu speakers, we show that proxy categories based on `native speaker' identification or residential history do not neatly map onto patterns of language experience, despite the common assumption that these bring about sufficient homogeneity. Moreover, compared to variables derived from gradient measures of language experience, these proxies do not robustly predict linguistic behavior in the form of acceptability judgments in Hindi-Urdu. In demonstrating alternative approaches to operationalizing language experience, we argue for all language researchers to move past relying on underspecified and ideologically-linked concepts, in favor of more intentional, nuanced, and rigorous testing of experiential factors underlying language processing.

Moving past indirect proxies for language experience: 'Native speaker' and residential history are poor predictors of language behavior

According to the Language Familiarity Effect (LFE), people are better at discriminating between speakers of their native language. Although this cognitive effect was largely studied in the literature, experiments have only been conducted on a limited number of language pairs and their results only show the presence of the effect without yielding a gradual measure that may vary across language pairs. In this work, we show that the computational model of LFE introduced by Thorburn, Feldman, and
Schatz (2019) can address these two limitations. In a first experiment, we attest to this model's capacity to obtain a gradual measure of the LFE by replicating behavioural findings on native and accented speech. In a second experiment, we evaluate LFE on a large number of language pairs, including many which have never been tested on humans. We show that the effect is replicated across a wide array of languages, providing further evidence of its universality. Building on the gradual measure of LFE, we also show that languages belonging to the same family yield smaller scores, supporting the idea of an effect of language distance on LFE.


Is the Language Familiarity Effect gradual ? A computational modelling approach

Why do readers typically fixate near the center of a word, with a bias towards word onset? Alhama, Siegelman, Frost, & Armstrong (2019) proposed an account based on (1) perceptual constraints that reduce the likelihood of perceiving a letter the further it is from the fixated location, and (2) the information available from the perceived letters for identifying the word. We expand this work to predict the fixation location distributions of 7-letter words for 43 languages from 9 language families. We found that in the majority of the languages, words were most likely to be correctly recognized when fixating near the center, slightly toward onset. However, there were deviations from this trend, such as predicting more accurate recognition when fixating slightly towards offset in Slavic languages. Our results provide novel predictions for experimental work that considers a flexible language system that optimizes initial fixations based on information theory constraints.

Predicting Fixation Locations in 43 Languages based on Perceptual Constraints and Information Theory

In two eye-tracking pilots during reading, we investigated real-time processing of formality-register congruence and subject-verb morphosyntactic congruence, and their relation. Participants read, in German, two context sentences conveying a formal or informal situation, followed by a target sentence containing a high- or low-register verb (e.g., Engl. transl. "The policeman detained the activist" vs. "The policeman grabbed the activist") which matched or mismatched context formality. The second pilot additionally manipulated subject-verb morphosyntactic congruence (e.g., Engl. transl. "*The policeman detain the activist"; "*The policeman grabbed the activist"). We observed main effects of formality-register and morphosyntactic congruence on verb reading times, as well as an interaction effect at the post-verbal object noun. Higher degrees of context and target sentence formality resulted in longer reading times. Ongoing investigation will further clarify our pilot findings, which suggest some interference between formality-register and morphosyntactic congruence processing.

(How) Do Register and Morphosyntactic Congruence Effects Interact during Sentence Reading? Two Eye-Tracking Pilot Studies

In an eye-tracking during reading experiment, we examined how rapidly two types of photo-sentence relations impact sentence comprehension. The relation between a photo of a cultural figure and a year in an ensuing sentence (either the cultural figure in the photo was either alive in that year or not) was contrasted with relations between the same photo and achievements or facts about the cultural figure (e.g., a film they had vs. had not starred in). Longer reading times were observed at the regions containing mismatching year or fact, with more robust effects when data were filtered to include only trials in which participants had accurate prior knowledge about the cultural figure, their accomplishments, and their lifetime. These findings indicate that specific long-term knowledge is activated by a picture of a known figure and is rapidly available during language processing.

Activation of biographical information via picture of cultural figures during comprehension: evidence from eye-tracking during reading

We explore contextual adaptation of referring expressions with respect to referential ambiguity and communicative intention. We focus not only on whether people adapt, but also on how by contrasting lexical specification (e.g., "batter") and syntactic modification (e.g., "man in white pants") when discriminating between objects in natural scenes (e.g., a batter wearing white pants and a referee). There are three main results. First, we replicate that speakers adapt their expressions to avoid ambiguity. Second, communicative intention has an effect: participants tended to use more specific names in a discrimination task than in a descriptive task, even without referential ambiguity in the context. Third, when given the choice, participants tended to prefer more specific words over adding modification - that is, using lexical rather than syntactic means to resolve ambiguity. This suggests that it may be less demanding to increase informativity of referring expressions with lexical specification than syntactic modification.

Effects of task and visual context on referring expressions using natural scenes

End-to-end sign language understanding and generation models do not accurately represent the prosody of the languages. This lack of temporal and spatial variation in generated signs leads to poor quality and lower human perception. We seek to improve prosody in automatic models that understand sign language by modeling intensification in a data-driven manner with strategies grounded in the linguistics of sign language by enhancing the representation of intensity modifiers in gloss annotations. In this work, we identify four major categories for sign intensification across two different sign languages. Through an extensive data exploration, we compare annotated datasets for German Sign Language and British Sign Language for intensification. We analyze the effects of the domain of the dataset on the intensifier abundance and the changes of intensifier use across different sign languages.

Learning cognitive and linguistic prosodic categories for automatic cross-lingual sign language understanding

When a language offers multiple options for expressing the same meaning, what principles govern a speaker's choice? Two well-known principles proposed for explaining wide-ranging speaker preference are Uniform Information Density and Availability-Based Production. Here we test the predictions of these theories in a previously uninvestigated case of speaker choice.
Russian has two ways of expressing the comparative: an \textsc{explicit} option (\textit{Ona bystree chem ja}/She fast{\sc-comp} than me{\sc-nom}) and a \textsc{genitive} option (\textit{Ona bystree menya/She fast{\sc-comp} me{\sc-gen}}). We lay out several potential predictions of each theory for speaker choice in the Russian comparative construction, including effects of post-comparative word predictability, phrase length, syntactic complexity, and semantic association between the comparative adjective and subsequent noun. In a corpus study, we find that the explicit construction is used preferentially when the post-comparative noun phrase is longer, has a relative clause, and is less semantically associated with the comparative adjective. A follow-up production experiment using visual scene stimuli to elicit comparative sentences replicates the corpus finding that Russian native speakers prefer the explicit form when post-comparative phrases are longer. These findings offer no clear support for the predictions of Uniform Information Density, but are broadly supportive of Availability-Based Production, with the explicit option serving as an unreduced form that eases speakers' planning of complex or low-availability utterances. Code for this study is available at https://github.mit.edu/thclark/russian_uid


Premium content

Downloads

Next from CogSci 2022

Impulsivity, risk-taking, and loss aversion in a continuous response task

Similar lecture

Investigating the real-time effect of register-situation formality congruence versus verb-argument semantic fit during spoken language comprehension