Singapore

EMNLP 2023

Harnessing the power of LLMs: Evaluating human-AI text co-creation through the lens of news headline generation

human-centered nlp

human-ai collaboration

large language model

text summarization

workshop paper

**Welcome to EMNLP 2023!**

On behalf of the EMNLP 2023 Organizing Committee, I extend a warm and heartfelt welcome to all of you to the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP). It is with immense pleasure and excitement that we gather here in Singapore, a vibrant hub of innovation and technological advancement.

The conference program is packed with insightful presentations, thought-provoking workshops, and engaging networking opportunities. In addition to the technical sessions, we have also planned several social events that will provide you with the opportunity to connect with your colleagues.

The conference is held in person at the Resorts World Convention Centre in Singapore, and available on-line with the help of Underline.

For those in Singapore, I hope that you will find time to explore the exciting Sentosa Island, Gardens by the Bay, Singapore Botanic Gardens and the many other attractions unique to Singapore.

Of course, we are grateful to our sponsors and partners for their generous support of EMNLP 2023, whose contributions make it possible for us to host this world-class event.

Yuji Matsumoto (RIKEN AIP) 
EMNLP 2023 General Chair

To access the **EMNLP 2023** event page on Underline, you need to register for the Conference. 
Please follow **[this link](https://2023.emnlp.org/registration/)** for more details.

EMNLP 2023 took place in Singapore from Dec 6th to Dec 10th, 2023.

InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text Generation

Ask To The Point: Open-Domain Entity-Centric Question Generation

NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark

Narrative Order Aware Story Generation via Bidirectional Pretraining Model with Optimal Transport Reward

Ensemble-Instruct: Instruction Tuning Data Generation with a Heterogeneous Mixture of LMs

A Closer Look into Using Large Language Models for Automatic Evaluation

Improving Pacing in Long-Form Story Planning

“Kelly is a Warm Person, Joseph is a Role Model”: Gender Biases in LLM-Generated Reference Letters

Bridging Discrete and Continuous Text Spaces for Accelerated Seq2Seq Diffusion Models

Extracting relational triples from text is a crucial task for constructing knowledge bases. Recent advancements in joint entity and relation extraction models have demonstrated remarkable F1 scores ($\ge 90\%$) in accurately extracting relational triples from free text. However, these models have been evaluated under restrictive experimental settings and unrealistic datasets. They overlook sentences with zero triples (zero-cardinality), thereby simplifying the task. In this paper, we present a benchmark study of state-of-the-art joint entity and relation extraction models under a more realistic setting. We include sentences that lack any triples in our experiments, providing a comprehensive evaluation. Our findings reveal a significant decline (approximately 10-15\% in one dataset and 6-14\% in another dataset) in the models' F1 scores within this realistic experimental setup. Furthermore, we propose a two-step modeling approach that utilizes a simple BERT-based classifier. This approach leads to overall performance improvement in these models within the realistic experimental setting.

90% F1 Score in Relation Triple Extraction: Is it Real?

Premium content

Harnessing the power of LLMs: Evaluating human-AI text co-creation through the lens of news headline generation

Downloads

Next from EMNLP 2023

InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text Generation