Taiwan

The exponential surge of social media has enabled information propagation at an unprecedented rate. However, it also led to the generation of a vast amount of malign content, such as hateful memes. To eradicate the detrimental impact of this content, over the last few years hateful memes detection problem has grabbed the attention of researchers. However, most past studies were conducted primarily for English memes, while memes on resource-constraint languages (i.e., Bengali)
remain under-studied. Moreover, current research considers memes with a caption written in monolingual (either English or Bengali) form. However, memes might have code-mixed captions (English+Bangla), and the existing models can not provide accurate inference in such cases. Therefore, to facilitate research in this arena, this paper introduces a multimodal hate speech dataset (named MUTE) consisting of 4158 memes having Bengali and code-mixed captions. A detailed annotation guideline is provided to aid the dataset creation in other resource-constraint languages. Additionally, extensive experiments have been carried out on MUTE, considering the only visual, only textual, and both modalities. The result demonstrates that joint evaluation of visual and textual features significantly improves (≈ 3%) the hateful memes classification compared to the unimodal evaluation.

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-srw.5/)


IJCNLP-AACL 2022

MUTE: A Multimodal Dataset for Detecting Hateful Memes

multimodal hate speech

resource

fusion

bengali

The AACL, Asia-Pacific Chapter of the Association for Computational Linguistics, and the AFNLP, Asian Federation of Natural Language Processing, invite you to participate in the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL) and the 10th International Joint Conference on Natural Language Processing (IJCNLP). 
<br>
<br>

A registration is required to access this event. Access to the event site will be granted to all registered attendees on **November 16th**. If you have not already done so, please register using the link below:
<br>
<br>https://conference.iis.sinica.edu.tw/servlet/Register?ConferenceID=411

Registration Is Required

The AACL, Asia-Pacific Chapter of the Association for Computational Linguistics, and the AFNLP, Asian Federation of Natural Language Processing, invite you to participate in the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL) and the 10th International Joint Conference on Natural Language Processing (IJCNLP). 

workshop paper

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-srw.6/)


A Simple and Fast Strategy for Handling Rare Words in Neural Machine Translation

Writing computer programs is a skill that remains inaccessible to most due to the barrier of programming language (PL) syntax. While large language models (LLMs) have been proposed to translate natural language pseudocode to PL code, they are costly in terms of data and compute. We propose a lightweight alternative to LLMs that exploits the property of code wherein most tokens can be simply copied from the pseudocode. We divide the problem into three phases: Copy, Generate, and Combine. In the Copy Phase, a binary classifier is employed to determine and mask the pseudocode tokens that can be directly copied into the code. In the Generate Phase, a Sequence-to-Sequence model is used to generate the masked PL code equivalent. In the Combine Phase, the generated sequence is combined with the tokens that the Copy Phase had masked. We show that our C3PO models achieve similar performance to non-C3PO models while reducing the computational cost of training as well as the vocabulary sizes.

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-srw.7/)

{C3PO}: {A} Lightweight Copying Mechanism for Translating Pseudocode to Code

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-srw.8/)

Outlier-Aware Training for Improving Group Accuracy Disparities

Multi-document summarization (MDS) is a process of generating an informative and con- cise summary from multiple topic-related doc- uments. Many studies have analyzed the qual- ity of MDS dataset or models, however no work has been done from the perspective of topic preservation. In this work, we fill the gap by performing an empirical analysis on two MDS datasets and study topic preservation on generated summaries from 8 MDS mod- els. Our key findings include i) Multi-News dataset has better gold summaries compared to Multi-XScience in terms of its topic distribu- tion consistency and ii) Extractive approaches perform better than abstractive approaches in preserving topic information from source doc- uments. We hope our findings could help de- velop a summarization model that can generate topic-focused summary and also give inspira- tion to researchers in creating dataset for such challenging task.

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-srw.9/)


An Empirical Study on Topic Preservation in Multi-Document Summarization

Access to mobile phones in many low- and middle-income countries has increased exponentially over the last 20 years, providing an opportunity to connect patients with healthcare interventions through mobile phones (known as mobile health). A barrier to large-scale implementation of interactive mobile health interventions is the human effort needed to manage participant messages. In this study, we explore the use of natural language processing to improve healthcare workers’ management of messages from pregnant and postpartum women in Kenya. Using multilingual, low-resource language text messages from the Mobile solutions for Women and Children’s health (Mobile WACh NEO) study, we developed models to assess urgency of incoming messages. We evaluated models using a novel approach that focuses on clinical usefulness in either triaging or prioritizing messages. Our best-performing models did not reach the threshold for clinical usefulness we set, but have the potential to improve nurse workflow and responsiveness to urgent messages.

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-srw.10/)

Detecting Urgency in Multilingual Medical SMS in Kenya

The multi-modal foundation model CLIP computes representations from texts and images that achieved unprecedented performance on tasks such as zero-shot image classification. However, CLIP was pretrained on public internet data. Thus it lacks highly domain-specific knowledge.
We investigate the adaptation of CLIP-based models to the chest radiography domain using the MIMIC-CXR dataset. We show that the features of the pretrained CLIP models do not transfer to this domain. 
We adapt CLIP to the chest radiography domain using contrastive language supervision and show that this approach yields a model that outperforms supervised learning on labels on the MIMIC-CXR dataset while also generalizing to the CheXpert and RSNA Pneumonia datasets. Furthermore, we do a detailed ablation study of the batch and dataset size.
Finally, we show that language supervision allows for better explainability by using the multi-modal model to generate images from texts such that experts can inspect what the model has learned.

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-srw.11/)

Language over Labels: Contrastive Language Supervision Exceeds Purely Label-Supervised Classification Performance on Chest X-Rays

A new trend in topic modeling research is to do Neural Topic Modeling by Clustering document Embeddings (NTM-CE) created with a pretrained language model. Studies have evaluated static NTM-CE models and found them performing comparably to, or even better than other topic models. An important extension of static topic modeling is making the models dynamic, allowing the study of topic evolution over time, as well as detecting emerging and disappearing topics. In this research proposal, we present two research questions to understand dynamic topic modeling with NTM-CE theoretically and practically. To answer these, we propose four phases with the aim of establishing evaluation methods for dynamic topic modeling, finding NTM-CE-specific properties, and creating a framework for dynamic NTM-CE. For evaluation, we propose to use both quantitative measurements of coherence and human evaluation supported by our recently developed tool.

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-srw.12/)

Dynamic Topic Modeling by Clustering Embeddings from Pretrained Language Models: A Research Proposal

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-srw.13/)

Concreteness vs. Abstractness: A Selectional Preference Perspective

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-tutorials.2/)


Recent Advances in Pre-trained Language Models: Why Do They Work and How Do They Work

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-tutorials.6/)


MUTE: A Multimodal Dataset for Detecting Hateful Memes

Downloads

Next from IJCNLP-AACL 2022

A Simple and Fast Strategy for Handling Rare Words in Neural Machine Translation

Similar lecture

Benchmarking the Covariate Shift Robustness of Open-world Intent Classification Approaches

MUTE: A Multimodal Dataset for Detecting Hateful Memes

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from IJCNLP-AACL 2022

A Simple and Fast Strategy for Handling Rare Words in Neural Machine Translation

Similar lecture

Benchmarking the Covariate Shift Robustness of Open-world Intent Classification Approaches

Downloads