Singapore

EMNLP 2023

The first workshop on generalisation (benchmarking) in NLP Panel

**Welcome to ACL-IJCNLP 2021!**

The great event is jointly organized by the Association for Computational Linguistics (ACL) and Asian Federation of Natural Language Processing (AFNLP). 

As in previous years, the program of the conference includes a poster session, tutorials, workshops and demonstrations in addition to the main conference.


We were able to keep the registration fees similar to those charged for the virtual ACL 2020. The one fee allows attendance at the main conference and any/all tutorials and workshops. These fees would be $125 Regular Early and $175 Regular Late; $50 Student Early and $75 Student Late. Early registration closes at midnight July 11, 2021 (Eastern Daylight Time).

**Reminder:** It is ACL’s policy that at least one author of each accepted paper (including ACL Finding papers) must register for the conference.

**Reminder2:** Underline site will open closer to the event. If you already registered you will receive access detail

Registration is now open

ACL-IJCNLP 2021

The great event is jointly organized by the Association for Computational Linguistics (ACL) and Asian Federation of Natural Language Processing (AFNLP).

panel

**Welcome to EMNLP 2023!**

On behalf of the EMNLP 2023 Organizing Committee, I extend a warm and heartfelt welcome to all of you to the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP). It is with immense pleasure and excitement that we gather here in Singapore, a vibrant hub of innovation and technological advancement.

The conference program is packed with insightful presentations, thought-provoking workshops, and engaging networking opportunities. In addition to the technical sessions, we have also planned several social events that will provide you with the opportunity to connect with your colleagues.

The conference is held in person at the Resorts World Convention Centre in Singapore, and available on-line with the help of Underline.

For those in Singapore, I hope that you will find time to explore the exciting Sentosa Island, Gardens by the Bay, Singapore Botanic Gardens and the many other attractions unique to Singapore.

Of course, we are grateful to our sponsors and partners for their generous support of EMNLP 2023, whose contributions make it possible for us to host this world-class event.

Yuji Matsumoto (RIKEN AIP) 
EMNLP 2023 General Chair

To access the **EMNLP 2023** event page on Underline, you need to register for the Conference. 
Please follow **[this link](https://2023.emnlp.org/registration/)** for more details.

EMNLP 2023 took place in Singapore from Dec 6th to Dec 10th, 2023.

Recently, using deep neural networks for machine translation (MT) tasks has received great attention. To learn more abstract representations of the input and store them as continuous vectors, these networks need a large amount of data. However, very few research studies have been conducted, and only a few data points are available for Amharic. The progress of the Amharic to English MT task is affected by a lack of a relatively large and available benchmark dataset. This paper presents the first relatively large-scale Amharic-English parallel corpora (1.1M) for the MT task. We ran experiments using a pre-trained language model (M2M100\_48M) and Transformer from scratch. The pre-trained models outperformed the baseline Transformer model.

AmEn: Amharic-English Large Parallel Corpus for Machine Translation

Question Answering (QA) systems return concise answers or answer lists based on natural language text, which uses a given context document. Large amounts of resources go into curating QA datasets, to push the advancement of robust models. Although there has been a surge in QA datasets for languages such as English this is not the case for Amharic. Indeed, there is no published or publicly available Amharic QA dataset. Hence, to foster further research in Amharic QA, we present the first Amharic QA dataset (Am-QuAD). We developed this dataset by crowdsourcing 2,628 question-answer pairs from over 378 Wikipedia articles written in Amharic. Additionally, we run an XLMR-based baseline model to spark open-domain QA research interest. The best-performing baseline achieves an F-score of 69.58 and 71.74 in reader-retriever QA and reading comprehension settings.

Am-QuAD: Amharic Question Answering Dataset

Adversarial Robustness of Transformer-based Arabic Offensive Language Detectors

This study proposes a data-centric approach
for Neural Machine Translation (NMT) in low
resource languages, focusing on Moroccan di
alect called Darija. Synthetic data genera
tion from a Moroccan Arabic-English dictio
nary is employed, along with DarijaBERT and
ChatGPT for sequence generation and filter
ing. Transfer learning using mT5 models is
utilized, comparing a baseline model with a
synthetic data augmentation model. Results
show a significant improvement in translation
quality, demonstrating the efficacy of synthetic
data augmentation in addressing low-resource
NMT challenges.

Synthetic Data Augmentation for Low-Resource NMT A Case Study on Moroccan dialect

The Fon language, spoken by an average 2 million of people, is a truly low-resourced African language, with a limited online presence, and existing datasets (just to name but a few). Multitask learning is a learning paradigm that aims to improve the generalization capacity of a model by sharing knowledge across different but related tasks: this could be prevalent in very data-scarce scenarios. In this paper, we present the first explorative approach to multitask learning, for model capabilities enhancement in Natural Language Processing for the Fon language. Specifically, we explore the tasks of Named Entity Recognition (NER) and Part of Speech Tagging (POS) for Fon. We leverage two language model heads as encoders to build shared representations for the inputs, and we use linear layer blocks for classification relative to each task. Our results on the NER and POS tasks for Fon, show competitive (or better) performances compared to several multilingual pretrained language models finetuned on single tasks. Additionally, we perform a few ablation studies to leverage the efficiency of two different loss combination strategies and find out that the equal loss weighting approach works best in our case. Our code is open-sourced at https://github.com/bonaventuredossou/multitask_fon.

FonMTL: Towards Multitask Learning for the Fon Language

Currently there are a lot of State of the art (SOTA) models for text generation. These models are capable enough to generate text that looks as if they are written by a human. Despite the assistance it can provide for humans, these models can be leveraged to malicious tasks such as plagiarism. Especially when it comes to academia, there is an ethical concern based on the authenticity of the content in articles. Thus it is vital to distinguish machine generated text from human written content. Several novel detection tools claim higher detectability accuracies of more than 95%. However in our research we show that, when academic content is composed in a manner how a human would utilize generation models for the task, then those generated texts are difficult to be detected. We conduct experiments in detection by leveraging tools such as GPT2 output detector, DetectGPT and ZeroGPT and classification models such as SciBERT, RoBERTa and DeBERTa.

Is it an Easy Task to Accurately Detect Automatically Generated Academic Content?

This paper examines the main challenges in Amharic hate speech classification tasks. The potential sources of errors in Amharic hate speech classification are explored in detail. Out of a total of more than 18 million tweets in our Twitter corpus, we annotate over 15k tweets with two independent Amharic native-speaker annotators. A Cohen's kappa score of 48% for inter-annotator agreement is achieved. An adjudicator is employed to decide on disputed annotations and determine the final gold labels. Logistic regression, Linear SVM, and the two fine-tuned contextual embedding transformer models: AmFLAIR and AmRoBERTa are employed. Among all the models, AmFLAIR achieves the best performance result with an F1-score of 72%.

Error Analysis in Amharic Hate Speech Detection Task

YORC: Yoruba Reading Comprehension dataset

Due to significant increases in internet penetration and the development of smartphone technology during the preceding couple of decades, many people have started using social media as a communication platform. Social media has grown to be one of the most significant components, with several benefits. However, technology also poses a number of threats, challenges, and barriers, such as hate speech, disinformation, and fake news. all most all social media platforms can be accused of not doing enough to thwart hate speech on their platform. Amharic and Afaan Oromo language speakers frequently mix the two languages when conversing and posting on social media. 
In this work, a bilingual hate speech detection for Amharic and Afaan Oromo languages were conducted using four different deep learning classifiers (CNN, BiLSTM, CNN-BiLSTM, and BiGRU) and three feature extraction (Keras word embedding, word2vec, and FastText) techniques. According to the experiment result, BiLSTM with FastText feature extraction is an outperforming the other algorithm by achieving a 78.05 % percent of accuracy for Bilingual Amharic Afaan Oromo hate speech detection. Furthermore, we are working towards multilingual hate speech detection for other under-represented Ethiopian languages.

Bilingual Hate Speech Detection on Social Media Amharic and Afaan Oromo

Large Language Models (LLMs) have taken center stage in recent years in the field of NLP. But while they have shown significant performance gains in many NLP tasks, their performance is concentrated in Anglo-Centric languages. Although previous studies have highlighted shortcomings of LLMs---including perpetuating harms and biases---we know little about their failure cases in low-resourced languages. We investigate how ChatGPT responds in Amharic and Afan Oromo, two low-resourced languages spoken in Ethiopia. We taxonomize the failure cases we observed and provide examples to illustrate the shortcomings. Our results show text generated in these languages has 6 failure modes and additionally exhibits political utterances that are not related to the prompts. We hope our work will contribute to the broader understanding of LLMs for low-resourced languages.

Downloads

Next from EMNLP 2023

AmEn: Amharic-English Large Parallel Corpus for Machine Translation

Similar lecture

Workshop on NLP for Positive Impact

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from EMNLP 2023

AmEn: Amharic-English Large Parallel Corpus for Machine Translation

Similar lecture

Workshop on NLP for Positive Impact

Downloads