United States

Experimental research on the processing and acquisition of Scalar Implicatures (SIs) relies on behavioral tasks that purport to measure the rate at which SIs are computed within an experimental paradigm. Two paradigms, the Truth Value Judgment Task (TVJT) (Gordon, 1998; Crain &amp; Thornton, 2000) and the Picture Selection Task (PST) (Gerken &amp; Shady, 1998) have dominated the experimental pragmatics literature; however, there has been little investigation of the way in which the selection of the experimental paradigm may affect the estimates of implicature rate. Here we report the results of two studies testing participants in both TVJT and PST using three different linguistic scales in English: “ad-hoc”, “or-and”, and “some-all”. In the first experiment, the task variation was manipulated within subjects while in the second experiment, it was manipulated between subjects. We found that the estimated rate of SI computation varied noticeably between these tasks for two out of the three linguistic scales. This suggests that the experimental paradigm itself has a significant impact on our estimates of the implicature rate and consequently psycholinguistic theories of implicature computation.

CogSci 2023

Task Variation in Scalar Implicature Computation

### Welcome!
The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) will take place in Bangkok, Thailand from August 11th to 16th, 2024. Our Virtual Poster Sessions will take place online Thursday, August 22, 2024.

You are required to register for this event. **Please register [here](https://2024.aclweb.org/registration). **

If you have already registered, please check your inbox for an email from Underline granting you access to ACL 2024 content.

Please register!

ACL 2024

The 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) will take place in Bangkok, Thailand from August 11th to 16th, 2024. More information will be announced soon.

Experimental research on the processing and acquisition of Scalar Implicatures (SIs) relies on behavioral tasks that purport to measure the rate at which SIs are computed within an experimental paradigm. Two paradigms, the Truth Value Judgment Task (TVJT) (Gordon, 1998; Crain & Thornton, 2000) and the Picture Selection Task (PST) (Gerken & Shady, 1998) have dominated the experimental pragmatics literature; however, there has been little investigation of the way in which the selection of the experimental paradigm may affect the estimates of implicature rate. Here we report the results of two studies testing participants in both TVJT and PST using three different linguistic scales in English: “ad-hoc”, “or-and”, and “some-all”. In the first experiment, the task variation was manipulated within subjects while in the second experiment, it was manipulated between subjects. We found that the estimated rate of SI computation varied noticeably between these tasks for two out of the three linguistic scales. This suggests that the experimental paradigm itself has a significant impact on our estimates of the implicature rate and consequently psycholinguistic theories of implicature computation.

poster

The 45th Annual Meeting of the Cognitive Science Society will take place in Sydney, Australia as a modified hybrid conference. Presentations from the main-session room will be live-streamed every day for all events. This will include all invited talks and award sessions. Recordings of all CogSci 2023 sessions will be made available for on-demand viewing after the conference. 
The in-person component will be held at the International Convention Centre Sydney at Darling Harbour. The Conference will take place Wednesday July 26th – Saturday July 29th, 2023 (Wednesday, July 26th is the Workshops Day).

Join us!

 [**The Program at a Glance can be found here**](https://cognitivesciencesociety.org/wp-content/uploads/2023/07/COgSci-PAAG-V2.pdf)
 [**The Detailed Program can be found here**](https://online.fliphtml5.com/ebtyf/mswz/)
 

#### **CogSci 2023 Program Book**
<iframe style="width:700px;height:400px" src="https://online.fliphtml5.com/ebtyf/tzgk/" seamless="seamless" scrolling="no" frameborder="0" allowtransparency="true" allowfullscreen="true" ></iframe>

The 45th Annual Meeting of the Cognitive Science Society presents the latest research across cognitive science and highlights the theme of Cognition in Context.

Utterances mentioning a highly predictable event are known to elicit atypicality inferences (Kravtchenko and Demberg, 2015; 2022). In those studies, pragmatic inferences are measured based on typicality ratings. It is assumed that comprehenders notice the redundancy and "repair'' the utterance informativity by inferring that the mentioned event is atypical for the referent, resulting in a lower typicality rating. However, the actual inferences that people make have never been elicited. We extend the original experimental design by asking participants to explain their ratings and administering several individual differences tests. This allows us to test (1) whether low ratings indeed correspond to the assumed inferences (they mostly do, but occasionally participants seem to make the inference but then reject it and give high ratings), and (2) whether the tendency to make atypicality inferences is modulated by cognitive factors. We find that people with higher reasoning abilities are more likely to draw inferences.

What inferences do people actually make upon encountering informationally redundant utterances? An individual differences study

When and how do people detect and adjust for sample bias? The present work examines how people use a small, potentially biased sample to reason about the population from which the sample was drawn. We developed a task to explore when and how people generalize from selectively sampled evidence and which cues learners use to infer the presence of selection bias and adjust their responses accordingly. Participants sampled data that followed several different distributions (e.g., bimodal), and constructed their frequency distribution of a larger “population”. Participants “filled in” missing data when sample distribution observations were sparse or were inconsistent with priors about distribution shape. Human responses were compared with several computational model predictions. An averaging model captured response curves better than a normative Bayesian approach (for some distributions). Results suggest that people draw on prior distributional expectations and observed sample distributions when generalizing from potentially biased samples.

Censor Detection: Detecting and adjusting for sample bias

It is generally difficult for people to make rational and accurate judgments under their limited cognitive resources. In this study, we propose an intervention to easily improve people’s judgment accuracy with less workload by waiting for a short time at the beginning of a task. By using a simple binary choice task, we found that when a short (1s) waiting time was inserted, participants showed higher accuracy than when no waiting time was inserted, and they felt less mental workload than when a longer (2.5s) waiting time was inserted. To examine the underlying implicit cognitive processes, we applied mouse tracking approaches during choice behaviors. We found that the inserted time enhanced participants’ change of mind (i.e., they amended their initial wrong judgments). These results suggest that making people wait for only 1s will serve as a simple, effective, and resource-rational intervention to boost people’s accuracy of judgments. Because of its simplicity, we believe that this intervention can be applied in various fields.

A one-second wait improves judgment accuracy: A mouse tracking reveals cognitive processes during choice behaviors

Virtual Reality (VR) presents a novel method to study the mind by generating dynamic, immersive environments for participants to engage with. However, the adoption of VR in cognitive science has been slow---for one, in order to use VR as a methodological tool, we need to verify that studies conducted in VR reflect the same assumptions that are common in existing experimental methods. Here, we investigate this question by drawing on existing empirical work in the domain of intuitive physics. In Experiment 1, we found that participants' judgments on a physical scene prediction task largely correlated with the same judgments collected using conventional methods. In Experiment 2, participants preferentially explored objects that violated core principles of physics, even engaging in distinct hypothesis-testing behaviors in accordance with the violation. In sum, these findings suggest that VR can be an exciting, novel method to study human behavior.

Intuitions about physical scenes and objects are preserved in Virtual Reality (VR)

Words express various sensory information to various degrees. Norming studies have collected native speakers’ subjective perceptual strength ratings for numerous words in several languages. This paper presents perceptual strength norms for 510 Japanese words, including iconic lexemes called ideophones. The newly collected norms replicated some previously reported correlations, such as the one between certain sensory modalities and iconicity. A systematic comparison between the Japanese and English perceptual strength norms further revealed that Japanese onomatopoeic ideophones tend to be more multisensory than their English equivalents and that Japanese words in general tend to encode more interoceptive information than English words. These findings suggest the usefulness of norming data in linguistic typology.

Perceptual Strength Norms for 510 Japanese Words, Including Ideophones: A Comparative Study with English

How similar are people's meanings of common words? Do differences in word meanings lead to miscommunication? We examined divergence between word meanings using similarity ratings such as "Is a penguin more similar to a chicken or a dolphin". We found that given the identical instructions some people prioritized taxonomic relationships more than other people. Moreover, this taxonomic bias generalized from animals to artifacts suggesting a more general difference in semantic organization. When people with different biases are paired in a matcher-director type task, they were less likely to achieve communicative success.

Divergence in Word Meanings and its Consequence for Communication

English and Mandarin Chinese are two distinct languages in many aspects, such as orthography and morphology. Previous network analyses show strong clustering coefficients ($C$) on English semantic networks, revealing the interconnectedness of semantic representations between words. However, it is not clear whether such semantic representation properties are language specific or general, and whether the linguistic-feature difference (e.g., subword components such as orthography and morphology) may affect the lexico-semantic structure. Here, we compared $C$s of words in English and Mandarin semantic networks based on a) feature norms empirically derived from human subjects and b) distributed semantic information of text retrieved by word embedding models. We consistently observed higher $C$s of Mandarin words than English words, especially when the semantic network considers subword features. Linear regressions suggested that the subword components' semantic properties in Mandarin, but not in English, could significantly and positively predict the $C$ of words in semantic networks. The results indicate an important role of language-specific properties in lexico-semantic structures and imply the diversity of human language processing.

Large-scale Network Analyses Reveal Cross-Language Differences in Semantic Structures: A Comparative Study

In two-person asymmetric coordination dilemmas, both people are better off if they coordinate, but one person benefits more than the other. When these interactions repeatedly recur, people can form expectations to avoid failing to coordinate, and to balance who is better off over time. What does it mean when asymmetric social interactions recur, and what can we learn from how people solve these dilemmas? We hypothesize that people expect social interactions to recur when two people are in a social relationship, and that knowing about the symmetry of the social relationship influences the stable solution to asymmetric coordination dilemmas over time. We report two experiments where participants read stories and answered questions about social interactions between two people. In Experiment 1, participants infer that two people are in a social relationship when there is a sequence of altruistic interactions between them, and specifically infer an asymmetric relationship when one person always performs the altruistic action, and a symmetric relationship when the two people alternate performing the altruistic action. In Experiment 2, participants equally expect alternating and repeating altruistic actions when the relationship is symmetric, but expect repeating actions (following a precedent) when the relationship is asymmetric. Our results suggest that people are able to use knowledge of relationships to generate shared expectations for coordinating on recurring altruistic social interactions, and vice versa.

People have systematic expectations linking social relationships to patterns of reciprocal altruism

Collaboration in shared environments requires human agents to coordinate their behaviour according to the machines’ actions. In this study, we compared the performance and behaviour of Human-Machine (HM) and Human-Human (HH) teams. While HH teaming behaviour is sensitive to Collaborative contexts, little is known about HM teaming behaviour. Furthermore, teaming behaviour may impact the team’s Joint Capacity – the team’s ability to handle teamwork processes and task demands. To assess teaming behaviour at every moment of a trial we used three distinct spatiotemporal measures (Momentary Distance, Highly Correlated Segments, and Running Correlation). To assess the team’s joint performance, we adopted the Capacity Coefficient (Townsend & Nozawa, 1995). For both HH and HM teams, behavioural measures predicted Joint Capacity. HH teams demonstrated greater performance and less synchronous behaviour than HM teams. The reduced synchrony of HH teams likely improved their performance as they could complement each other’s behaviour rather than duplicate inefficiencies.

The Relationship Between Teaming Behaviours and Joint Capacity of Hybrid Human-Machine Teams

Intention prediction often plays a crucial role in successful social interaction. Previous studies have attempted to understand this skill by focusing on the role of movement kinematics in isolation. However, this approach is limited as the same kinematics typically map to multiple action possibilities (affordances) and as a result, individual's also employ contextual information to predict others' intentions. In this study we present preliminary findings from a qualitative study aimed at investigating intention prediction in naturalistic contexts. Participants viewed an individual reaching for a cup with one of two object-directed intentions: to drink OR to clear the table. A third non-object-directed intention was also included where the observed individual placed their hand on the table next to the cup. For each intention the contextual information was varied by changing the environmental scene between (1) cups full of juice, (2) almost empty cups, and (3) half-empty cups. The findings reveal that participants perceived the cup's functional (most salient) affordance - drink - for the intention so far as the movement kinematics specified an object-directed intention (drink or clear) with a context that clearly afforded it (full and half-full cups). However, participants were also sensitive to the kinematic differences between the object-directed intentions when the context made the functional affordance seem improbable (almost empty cups). The methodological and theoretical implications of the results with regards to studying intention prediction are discussed.

Premium content

Downloads

Next from CogSci 2023

What inferences do people actually make upon encountering informationally redundant utterances? An individual differences study

Similar lecture

Pragmatic inference of scalar implicature by LLMs