Indonesia

In this talk, I will present the efforts of Natural Language Processing (NLP) research and product development in Indonesia. In about two decades ago, the NLP researches in Indonesia was not well developed, whether in method or NLP data sources. The number of NLP researchers itself is quite low, compared to the population number of Indonesian people. There was even no available research publication for any regional language in Indonesia.
Since then, there have been several attempts to push NLP research in Indonesia, including the forming of Indonesian Association for Computational Linguistics, the participation of Indonesia researchers as part of several international conference committees, and NLP courses in universities which motivate students to conduct NLP researches. Some obstacles are still exist until now including the research fund support from the government; but the number of Indonesian NLP researchers are now increasing, and so is the NLP related start ups in Indonesia.

IJCNLP-AACL 2023

Natural Language Processing Research and Product Development in Indonesia

# Welcome everyone to ACL 2022!

The 60th Annual Meeting of the Association for Computational Linguistics is taking place May 22-27, 2022 as a hybrid event, in Dublin and online. We are happy to welcome all of you to this anniversary edition with an almost 50-50 in-person and virtual participation. 
The main conference program features oral presentations, in-person and virtual posters and demo sessions, a plenary session for our best paper presentations and awards, three amazing keynote events and two new initiatives of invited talks: Spotlight Talks for Young Rising Stars (STIRS) and The Next Big Idea Talks. Posters (including Findings of ACL 2022) and demos are grouped by areas for both the in-person and the virtual sessions. For the virtual component, the talks will be on Zoom and the posters and the demos will be in GatherTown. The Student Research Workshop will have an oral session and a poster session as part of Poster Session 1. The program also features eight Tutorials and 28 Workshops. 

 
We wish you a wonderful conference! 
[**The ACL 2022 Organizing Committee**](https://www.2022.aclweb.org/organisers)
 
[**Conference Handbook**](https://drive.google.com/file/d/1_BUCMfhMVrjG9E2e71aHdHeE28KSje0l/view?usp=sharing) 
[**Mini Handbook**](https://drive.google.com/file/d/1qlBKl0wzmlVF1oCeMQl3BahLd9nLP5Ce/view?usp=sharing) 
[**Posters and Demo guides**](https://drive.google.com/file/d/1UucMAoCNncIOaH1rMMDa0owuG9qgvJTG/view?usp=sharing)

ACL 2022

The Association for Computational Linguistics (ACL) is the premier international scientific and professional society for people working on computational problems involving human language, a field often referred to as either computational linguistics or natural language processing (NLP). 

keynote

### Welcome to IJCNLP-AACL 2023!
I am honored and happy to welcome you to IJCNLP-AACL 2023! The conference hosts both the 13th
International Joint Conference on Natural Language Processing (IJCNLP) and the 3rd Conference of
the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL). 
The joint conferences of IJCNLP and AACL have been organized by alternating leadership in the
Asia-Pacific region, in odd years by Asian Federation of Natural Language Processing (AFNLP) and
in even years by AACL. The conference is organized by AFNLP this year. 

Considering the current situation that we are not yet fully over the coronavirus pandemic, the
conference is offered in a hybrid mode, off-line in Nusa Dua, Bali, Indonesia, and on-line with the help
of Underline, during November 1-4, 2023. For those attending off-line, I hope that you will find time to
explore the exciting local area, which remains quite warm and pleasant at this time of the year. For
those attending on-line, I hope that the attendance is not much hampered, sometimes even enhanced
and comfortable, though the on-line arrangements have been made without ample time. 

Message from Jong C. Park, Korea Advanced Institute of Science and Technology (KAIST) 
IJCNLP-AACL 2023 General Chair 
###### [Conference Handbook](https://drive.google.com/file/d/1S2JSXa105xJxIkNBfhYmGH20Om6wARBx/view?usp=sharing)

In order to acces this event page, you need to register [here](http://www.ijcnlp-aacl2023.org/)

The 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics

Machine translation models are still inappropriate for translating chats, despite the popularity of translation software and plug-in applications. The complexity of dialogues poses significant challenges and can hinder cross-lingual communication. Instead of pursuing a flawless translation system, a more practical approach would be to issue warning messages about potential mistranslations to reduce confusion. However, it is still unclear how individuals perceive these warning messages and whether they benefit the crowd. This paper tackles to investigate this research question and demonstrates the warning messages' contribution to making chat translation systems effective.

An Investigation of Warning Erroneous Chat Translations in Cross-lingual communication

Machine Learning models in the field of Information Extraction for Scientific Publications
require high-quality labeled data. The large
amount of easily accessible LATEX source code
is a treasure trove of high-quality labeled data.
However, existing datasets comprised of document collections and PDF extraction tools have
limitations: (1) The hierarchical structure of
papers is lost because labeling is done in terms
of pages rather than documents; (2) The reading order is not extracted, which potentially
muddles the extracted contextual structure; (3)
Papers included in the datasets are not likely
to be up-to-date.To address these challenges,
we propose LATEX Rainbow, a framework that
bridges LATEX to PDF that can automatically annotate and extract semantic and layout information from LATEX source code. This framework
extends existing annotation methods by taking
into account the properties of different existing
approaches. It can produce token-level semantic structure annotations, preserve the paper’s
reading order, and extract the table of contents,
i.e., the article’s section structure. LATEX Rainbow enables anyone to extend their datasets
with the latest documents. The project is opensourced on GitHub1
for community contributions and use.


LaTeX Rainbow: Universal LaTeX to PDF Document Semantic & Layout Annotation Framework

Text classification is an important technique in
natural language processing for categorizing
text into appropriate domains. With the increasing amount of textual data, robust text classification is in high demand. This paper focuses on
single-label classification of text for scholarly
articles, aiming to analyze a large number of
papers. Inspired by the successful Fusion-inDecoder method used in question-answering
tasks, we propose an accurate method suitable
for long articles. We evaluate the effectiveness of our method through experiments on
single-label classification with scholarly articles, demonstrating its high F1 scores.

Leveraging the Fusion-in-Decoder for Label Classification

This study tackles the challenge of generating
appropriate academic titles based on the paper’s
abstract. We approach this task as a high-level
text summarization problem and introduce an
innovative post-processing method that combines a predictive model with a set of linguistic
rules to enhance the quality of the title generation. We start by evaluating three Natural
Language Generation models (BART, T5, Flan
T5), by identifying the top-performing model
and by configuring it to generate diverse titles.
We then conduct experiments employing various post-processing strategies -using SciBERT
and linguistic rules- to select the best title out
of all machine-generated options. Finally, we
assess our title selection methods in relation to
human evaluations.

Enhancing Academic Title Generation Using SciBERT and Linguistic Rules

Keeping track of all relevant recent publications and experimental results for a research area is a challenging task. Prior work has demonstrated the efficacy of information extraction models in various scientific areas. Recently, several datasets have been released for the yet understudied materials science domain. However, these datasets focus on sub-problems such as parsing synthesis procedures or on subdomains, e.g., solid oxide fuel cells. In this resource paper, we present MuLMS, a new dataset of 50 open-access articles, spanning seven sub-domains of materials science. The corpus has been annotated by domain experts with several layers ranging from named entities over relations to frame structures. We present competitive neural models for all tasks and demonstrate that multi-task training with existing related resources leads to benefits.

MuLMS: A Multi-Layer Annotated Text Corpus for Information Extraction in the Materials Science Domain

We introduce a comprehensive end-to-end pipeline designed to extract complete bibliography section from English scientific articles in digital-born PDF format and further split them into individual citations. At the heart of our pipeline lies the utilization of Languageindependent Layout Transformer (LiLT), a multimodal model that combines text and layout features to enhance the accuracy and robustness of bibliography extraction. By considering both text and visual structure, LiLT significantly improves the identification of bibliographic sections within scientific articles. To split the extracted full bibliography into individual citations, we employ a custom fine-tuned version of SciBERT, a Transformer-based model that excels at handling complex formatting variations common in scholarly bibliography. Having such end-to-end pipeline in-house allows us to bypass reliance on third-party black box tools, such as GROBID, offering greater control and transparency in the bibliography extraction process. Another highlight of our pipeline is its extensibility, as it can be seamlessly adapted to multilingual and image-based PDFs, hence allowing its utility across a wide range of scholarly content. When evaluated on an in-house dataset of digital-born English PDF articles published at Elsevier, we achieved an F1-score of 94.6%, a notable 3.1% improvement over GROBID, which is a well-regarded tool for bibliography parsing in the industry.

An End-to-End Pipeline for Bibliography Extraction from Scientific Articles

Citation graphs represent the citation relations between papers, and they are commonly used by researchers to identify relevant papers. However, citation graphs do not always represent how papers are related to each other. To make more effective use of citation graphs to discover relevant papers, we can consider identifying the functions of citations and label each edge in the citation graphs with its function. This paper proposes a method to identify the functions of citations automatically. The proposed model utilizes language models, e.g., SciBERT, to identify the description of citation functions. However, the language models are limited in terms of the number of input tokens; thus, the entire citing paragraph cannot be processed at once. To overcome this problem, we analyzed the distribution of the descriptions of citation functions in the citing paragraphs and determined the focusing part in identifying the citation functions. Experiments conducted on scientific paper data demonstrated the effectiveness of the proposed method.

On the Use of Language Models for Function Identification of Citations in Scholarly Papers

Scientific research relies heavily on the exchange of knowledge through citations in academic literature. In the domain of astrophysics, the precise classification of citation functions and the extraction of contextual information are critical for understanding the vast universe of research papers. This paper presents the system description for the WIESP 2023 FOCAL shared task. We introduce an automated approach that leverages state-of-the-art language models, including ALBERT, RoBERTa, BERT, and DistillBERT, to classify citation functions and extract context within astrophysical paragraphs. Our system combines paraphrasing and question-answering techniques to achieve accurate results. Through comprehensive experiments, we demonstrate the robustness of our approach, with ALBERT consistently delivering strong performance.

Automated Citation Function Classification and Context Extraction in Astrophysics: Leveraging Paraphrasing and Question Answering

Measurement extraction is an information extraction subtask focused on extracting quantities and their dependent entities within a
given scientific text. Quantity extraction is
the first and most important step in measurement extraction. Most existing approaches
model the problem as a sequence-labeling task
using pre-trained language models (PLMs).
However, none of the existing systems have
utilised explicit syntactic knowledge to extend the PLM-based modeling. We propose a
syntax-enriched extension by integrating dependency tree representations as syntactic knowledge into transformer-based language models
to address the task of quantity extraction. We
apply our approach to a range of established
transformer-based models to evaluate our approach and analyze its impact in experiments
on scientific literature datasets. Our experimental results and in-depth analysis show that our
approach, syntax-enriched RoBERTa, outperforms the other models, even in situations with
scarce training data in the scientific domain.
The results demonstrate the adaptability of the
proposed model to the tasks, especially useful
in low-resource scenarios.

Investigating the Impact of Syntax-Enriched Transformers on Quantity Extraction in Scientific Texts

In this paper, we address the task of extracting semantic relations between entities in scientific articles in Russian, with a focus on scientific terms as entities. We present a dataset that includes annotated abstracts of scientific articles in Russian. This dataset was used to train and test models and develop an algorithm for the automatic extraction of semantic relations. We conducted experiments and compared one zero-shot and one few-shot approach for relation extraction: one based on the perplexity score and the other based on the use of prototype vectors of relations. Our results show that both methods can achieve reasonable performance, demonstrating the potential of zeroshot and few-shot approaches for relation extraction in scientific texts in Russian. The developed tool and annotated dataset are publicly available and could be valuable resources for other researchers.

Downloads

Next from IJCNLP-AACL 2023

An Investigation of Warning Erroneous Chat Translations in Cross-lingual communication

Similar lecture

One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from IJCNLP-AACL 2023

An Investigation of Warning Erroneous Chat Translations in Cross-lingual communication

Similar lecture

One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia

Downloads