Indonesia

While large pre-trained language models (LLMs) have shown their impressive capabilities in various NLP tasks, they are still under-explored in the misinformation domain. In this paper, we examine LLMs with in-context learning (ICL) for news claim verification, and find that only with 4-shot demonstration examples, the performance of several prompting methods can be comparable with previous supervised models. To further boost performance, we introduce a Hierarchical Step-by-Step (HiSS) prompting method which directs LLMs to separate a claim into several subclaims and then verify each of them via multiple questions-answering steps progressively.
Experiment results on two public misinformation datasets show that HiSS prompting outperforms state-of-the-art fully-supervised approach and strong few-shot ICL-enabled baselines.

IJCNLP-AACL 2023

Towards LLM-based Fact Verification on News Claims with a Hierarchical Step-by-Step Prompting Method

### Welcome to ACL 2023, the 61st Annual Meeting of the Association for Computational Linguistics! 
 The conference will be held in Toronto, Canada, July 9-14, 2023. 
Following the succession of the recent conferences in our field, ACL 2023 will adopt a hybrid format.
While the impact of Covid has considerably diminished in terms of traveling, obtaining visas to Canada
entails a very long process. Moreover, the global economic conditions pose challenges for many individuals to travel to conferences. Recognizing these circumstances, we know many participants may not be
able to attend the conference in person. Therefore, we are committed to providing a great virtual platform
so everyone has the opportunity to interact with other participants and enjoy the conference. Based on the
current registered participants, approxiately 30% have chosen to attend the conference virtually. Whether
you join us in person or virtually, we sincerely hope everyone has a remarkable conference experience. 
This General Chair’s message is where I express my gratitude to the many individuals who have made
enormous contributions to the conference over the past year.

Read [**ACL 2023 General Chair's message**](https://docs.google.com/document/d/1WobYM7norbG4dI48s75HfJoD89qgX5a_F-6U8AteLSA/edit?usp=sharing/) in full.

##### **[Conference Handbook](https://2023.aclweb.org/downloads/acl2023-handbook.pdf)**

ACL 2023

The Association for Computational Linguistics (ACL) is the premier international scientific and professional society for people working on computational problems involving human language, a field often referred to as either computational linguistics or natural language processing.

technical paper

### Welcome to IJCNLP-AACL 2023!
I am honored and happy to welcome you to IJCNLP-AACL 2023! The conference hosts both the 13th
International Joint Conference on Natural Language Processing (IJCNLP) and the 3rd Conference of
the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL). 
The joint conferences of IJCNLP and AACL have been organized by alternating leadership in the
Asia-Pacific region, in odd years by Asian Federation of Natural Language Processing (AFNLP) and
in even years by AACL. The conference is organized by AFNLP this year. 

Considering the current situation that we are not yet fully over the coronavirus pandemic, the
conference is offered in a hybrid mode, off-line in Nusa Dua, Bali, Indonesia, and on-line with the help
of Underline, during November 1-4, 2023. For those attending off-line, I hope that you will find time to
explore the exciting local area, which remains quite warm and pleasant at this time of the year. For
those attending on-line, I hope that the attendance is not much hampered, sometimes even enhanced
and comfortable, though the on-line arrangements have been made without ample time. 

Message from Jong C. Park, Korea Advanced Institute of Science and Technology (KAIST) 
IJCNLP-AACL 2023 General Chair 
###### [Conference Handbook](https://drive.google.com/file/d/1S2JSXa105xJxIkNBfhYmGH20Om6wARBx/view?usp=sharing)

In order to acces this event page, you need to register [here](http://www.ijcnlp-aacl2023.org/)

The 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics

Abduction has long been seen as crucial for narrative comprehension and reasoning about everyday situations. The abductive natural language inference (αNLI) task has been proposed, and this narrative text-based task aims to infer the most plausible hypothesis from the candidates given two observations. However, the inter-sentential coherence and the model consistency have not been well exploited in the previous works on this task. In this work, we propose a prompt tuning model α-PACE, which takes self-consistency and inter-sentential coherence into consideration. Besides, we propose a general self-consistent framework that considers various narrative sequences (e.g., linear narrative and reverse chronology) for guiding the pre-trained language model in understanding the narrative context of input. We conduct extensive experiments and thorough ablation studies to illustrate the necessity and effectiveness of α-PACE. The performance of our method shows significant improvement against extensive competitive baselines.

Self-Consistent Narrative Prompts on Abductive Natural Language Inference

Machine translation models are still inappropriate for translating chats, despite the popularity of translation software and plug-in applications. The complexity of dialogues poses significant challenges and can hinder cross-lingual communication. Instead of pursuing a flawless translation system, a more practical approach would be to issue warning messages about potential mistranslations to reduce confusion. However, it is still unclear how individuals perceive these warning messages and whether they benefit the crowd. This paper tackles to investigate this research question and demonstrates the warning messages' contribution to making chat translation systems effective.

An Investigation of Warning Erroneous Chat Translations in Cross-lingual communication

Machine Learning models in the field of Information Extraction for Scientific Publications
require high-quality labeled data. The large
amount of easily accessible LATEX source code
is a treasure trove of high-quality labeled data.
However, existing datasets comprised of document collections and PDF extraction tools have
limitations: (1) The hierarchical structure of
papers is lost because labeling is done in terms
of pages rather than documents; (2) The reading order is not extracted, which potentially
muddles the extracted contextual structure; (3)
Papers included in the datasets are not likely
to be up-to-date.To address these challenges,
we propose LATEX Rainbow, a framework that
bridges LATEX to PDF that can automatically annotate and extract semantic and layout information from LATEX source code. This framework
extends existing annotation methods by taking
into account the properties of different existing
approaches. It can produce token-level semantic structure annotations, preserve the paper’s
reading order, and extract the table of contents,
i.e., the article’s section structure. LATEX Rainbow enables anyone to extend their datasets
with the latest documents. The project is opensourced on GitHub1
for community contributions and use.


LaTeX Rainbow: Universal LaTeX to PDF Document Semantic & Layout Annotation Framework

Text classification is an important technique in
natural language processing for categorizing
text into appropriate domains. With the increasing amount of textual data, robust text classification is in high demand. This paper focuses on
single-label classification of text for scholarly
articles, aiming to analyze a large number of
papers. Inspired by the successful Fusion-inDecoder method used in question-answering
tasks, we propose an accurate method suitable
for long articles. We evaluate the effectiveness of our method through experiments on
single-label classification with scholarly articles, demonstrating its high F1 scores.

Leveraging the Fusion-in-Decoder for Label Classification

This study tackles the challenge of generating
appropriate academic titles based on the paper’s
abstract. We approach this task as a high-level
text summarization problem and introduce an
innovative post-processing method that combines a predictive model with a set of linguistic
rules to enhance the quality of the title generation. We start by evaluating three Natural
Language Generation models (BART, T5, Flan
T5), by identifying the top-performing model
and by configuring it to generate diverse titles.
We then conduct experiments employing various post-processing strategies -using SciBERT
and linguistic rules- to select the best title out
of all machine-generated options. Finally, we
assess our title selection methods in relation to
human evaluations.

Enhancing Academic Title Generation Using SciBERT and Linguistic Rules

Much of the current progress in our field seems to be driven by a small number of industry labs that have access to computing resources, data, and financial backing on a scale that would have seemed unimaginable only a few years ago (and that remain unattainable for the majority of researchers in academia or industry). However, many of the datasets that have defined novel tasks and that have catalyzed research on new problems came out of much more modest efforts by academic researchers. I will focus on the work that my own group has done on image description and on grounded instruction giving/following in Minecraft as examples of how this kind of work has helped drive scientific progress.  

How new tasks and datasets have enabled progress in NLP

Most work on large language models (LLMs) has focused on what we call "vertical" scaling: making LLMs even better for a relatively small number of high-resource languages. We address "horizontal" scaling instead: extending LLMs to a large subset of the world's languages, focusing on low-resource languages. Our Glot500-m model is trained on more than 500 languages, many of which are not covered by any other language model. But how do we know that the model has actually learned these 500 languages? Broad low-resource evaluation turns out to be a difficult problem in itself and we tried to innovate in several ways. One issue we were not able to solve is that parts of our evaluation standard cannot be distributed due to copyright restrictions. We also find that attributing good/bad performance to the so-called curse of multilinguality is naive and there is in fact also a "boon of multilinguality". We have released Glot500-m and are in the process of making our training corpus Glot500-c publicly available. 

Glot500: Creating and Evaluating a Language Model for 500 Languages

In this talk, I will present our journey of large-scale multimodal pretrained (generative) models across various modalities (text, images, videos, audio, layouts, etc.) and enhancing important aspects such as unification, efficiency, interpretability, and evaluation. We will start by discussing early cross-modal vision-and-language pretraining models (LXMERT). We will then look at early unified models (VL-T5) to combine several multimodal tasks (such as visual QA, referring expression comprehension, visual entailment, visual commonsense reasoning, captioning, and multimodal translation) by treating all tasks as text generation. We will also look at recent advanced unified models (with joint objectives and architecture, as well as newer unified modalities during encoding and decoding) such as textless video-audio transformers (TVLT), vision-text-layout transformers for universal document processing (UDOP), and composable any-to-any text-audio-image-video multimodal generation (CoDi). Second, we will discuss interpretable and controllable multimodal generation via LLM-based planning and programming, such as layout-controllable image generation via visual programming (VPGen), consistent multi-scene video generation via LLM-guided planning (VideoDirectorGPT), and open-domain, open-platform diagram generation (DiagrammerGPT). I will conclude with important evaluation aspects of multimodal generation models, based on fine-grained skill and social bias evaluation (DALL-Eval), as well as interpretable and explainable visual programs (VPEval).

Multimodal Generative LLMs: Unification, Interpretability, Evaluation

Katie Zacarian is the CEO and co-founder of Earth Species Project. Earth Species Project is a non-profit organization with the mission of decoding animal communication. To achieve this mission, ESP collaborates broadly across many scientific disciplines, bringing together AI researchers, biological scientists, ethicists, philosophers, conservationists, and more. With so many disciplines of research partnering with the organization, ESP’s listening to animals hinges almost entirely on its ability to listen to all of the various collaborators contributing to the work. In this talk, Zacarian talks about the challenges, and joys of listening
deeply to the science and expertise outside of our own disciplines–and eventually–outside of our species.

Can We Hear You? Models for Listening in the Animal Kingdom and Scientific Communities

In this talk, I will present the efforts of Natural Language Processing (NLP) research and product development in Indonesia. In about two decades ago, the NLP researches in Indonesia was not well developed, whether in method or NLP data sources. The number of NLP researchers itself is quite low, compared to the population number of Indonesian people. There was even no available research publication for any regional language in Indonesia.
Since then, there have been several attempts to push NLP research in Indonesia, including the forming of Indonesian Association for Computational Linguistics, the participation of Indonesia researchers as part of several international conference committees, and NLP courses in universities which motivate students to conduct NLP researches. Some obstacles are still exist until now including the research fund support from the government; but the number of Indonesian NLP researchers are now increasing, and so is the NLP related start ups in Indonesia.

Downloads

Next from IJCNLP-AACL 2023

Self-Consistent Narrative Prompts on Abductive Natural Language Inference

Similar lecture

Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from IJCNLP-AACL 2023

Self-Consistent Narrative Prompts on Abductive Natural Language Inference

Similar lecture

Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models

Downloads