Canada

During the COVID-19 pandemic, huge amounts of new information from many different sources is made available to us each day. This pandemic has been worsened by this associated &quot;&quot;infodemic&quot;&quot;. As individuals are becoming increasingly reliant on the internet as a source of information. This ultimately leads to misunderstandings of public health orders or even indirectly affects public policies. While it is critical to identify misinformation and unreliable news sources online, this task becomes increasingly challenging with the tremendous amount of information released each day. We propose the usage of natural language processing (NLP) and machine learning (ML) techniques to build a model that can be used to identify unreliable articles online. We first processed the ReCOVery dataset to obtain 2039 English news articles tagged with COVID-19 keywords from January to May 2020 which are labeled as reliable or unreliable. Data exploration was done to determine major differences between reliable and unreliable articles. We found that reliable news articles had a higher proportion of neutral sentiment while unreliable articles had a higher proportion of positive sentiment. Additionally, our analysis demonstrated that reliable articles had more engagement on social media on terms of tweets, retweets and likes. We built a multi-input deep learning model called Deep Reli using sentiment and body text of articles to classify the reliability. DeepReli was evaluated to achieve a 93% accuracy, 94% sensitivity, 92% specificity. This paper identifies novel differences between reliable and unreliable articles as well as builds a model using state-of-the-art deep learning techniques. We aim to be able to use our findings to help researchers and the public audience more easily identify misinformation and unreliable media in their everyday lives. Future work by researchers could include creating a larger multi-input model which includes features such as geographical location as well as me-series data of news articles. Additionally, it would be valuable to compare the efficacy of the model on other media such as social media posts or headline as well as with different news articles such as those discussing major political events.

Infodemiology For The Future Of Digital And Public Health

Data Exploration and Classification of News Article Reliability: A Deep Learning Study

data exploration

news articles

machine learning

covid-19

sentiment

## Welcome to 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics!
This year, the conference is in Mexico City. NAACL was actually already planned for Mexico City in 2021, but due to the pandemic the entire conference was moved online. This year, finally, we get to go! So it is my sincere pleasure to welcome you to Mexico City, whether in person or virtually. Having the conference in Mexico City is a good opportunity to emphasize that NAACL is our flagship conference for ACL members not only in North America but also in Central and South America, even though NAACL has been bearing “North” in its name. At this year’s conference, we have a theme to match, with a theme track on the Languages of Latin America to showcase the linguistic diversity of the region.
 
The opportunity to present at NAACL should not depend on a researcher’s travel budget, or their family status. This is why it is so important to make virtual participation at NAACL as good an experience as possible – but we want to also provide a good experience for in-person participants. As a community, we are still working out the best way to do that. This year at NAACL, we are trying out a big virtual poster session ahead of the conference, with the hope that this will make make for a lively and interactive experience. At the same time, we are reducing virtual oral presentations, which seem to be particularly tricky to make to work well. A big thanks to the NAACL program chairs and to Luciana Benotti for all their ideas and work to improve the virtual experience. And participants, virtual as well as in-person: Please let us know what worked for you and what didn’t, so we can continue to improve hybrid conferences. 
 
I have been lucky to work with many amazing people. Without their insight, dedication and patience, and without the many hours of work they put in, NAACL would not have been possible. A huge thank you to the program chairs Helena Gomez, Kevin Duh, and Steve Bethard – you are the best! 
 
Finally, I would like to thank all authors, invited speakers and panelists, area chairs and reviewers, the volunteers organizing and chairing sessions, and all attendees, in-person and virtual. Thank you for helping us make NAACL 2024 come to life. 
 
Welcome and hope you all enjoy the conference! 
Katrin Erk 
The University of Texas at Austin 
NAACL-2024 General Chair 
*You can read the full Welcome message in the [Conference Handbook (downloadable)](https://drive.google.com/file/d/1H1NvW0VASQjkSCYgw3mr-3l4yYDSxz6B/view?usp=sharing)*

To access the event page you need to register [**here.**](http://acl.swoogo.com/naacl2024) 
Your access to the event page is limited based on your registration type. If you registered for workshops only, you will gain access to full workshops content on the day of the workshops program.

Please register!

NAACL 2024

2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics

During the COVID-19 pandemic, huge amounts of new information from many different sources is made available to us each day. This pandemic has been worsened by this associated ""infodemic"". As individuals are becoming increasingly reliant on the internet as a source of information. This ultimately leads to misunderstandings of public health orders or even indirectly affects public policies. While it is critical to identify misinformation and unreliable news sources online, this task becomes increasingly challenging with the tremendous amount of information released each day. We propose the usage of natural language processing (NLP) and machine learning (ML) techniques to build a model that can be used to identify unreliable articles online. We first processed the ReCOVery dataset to obtain 2039 English news articles tagged with COVID-19 keywords from January to May 2020 which are labeled as reliable or unreliable. Data exploration was done to determine major differences between reliable and unreliable articles. We found that reliable news articles had a higher proportion of neutral sentiment while unreliable articles had a higher proportion of positive sentiment. Additionally, our analysis demonstrated that reliable articles had more engagement on social media on terms of tweets, retweets and likes. We built a multi-input deep learning model called Deep Reli using sentiment and body text of articles to classify the reliability. DeepReli was evaluated to achieve a 93% accuracy, 94% sensitivity, 92% specificity. This paper identifies novel differences between reliable and unreliable articles as well as builds a model using state-of-the-art deep learning techniques. We aim to be able to use our findings to help researchers and the public audience more easily identify misinformation and unreliable media in their everyday lives. Future work by researchers could include creating a larger multi-input model which includes features such as geographical location as well as me-series data of news articles. Additionally, it would be valuable to compare the efficacy of the model on other media such as social media posts or headline as well as with different news articles such as those discussing major political events.

technical paper

STEM Fellowship hosted the world’s first infodemiology themed hackathon through the 2021 Undergraduate Big Data Challenge, culminating in the national finale event of the Big Data Day. The top 13 teams from across Canada defended their work, and were able to showcase their solutions to a national audience. The winning teams won cash prizes, the opportunity to publish their manuscripts in the STEM Fellowship Journal, and internship opportunities with our partners.

National Inter-University Big Data Challenge 2021 -

The COVID-19 pandemic created an unprecedented spread of misinformation and misinterpretation of scientific facts leading to mass acts of panic and dangerous asocial behaviour. The WHO declared this as an Infodemic. We present the leading university students infodemiological research of open Internet-user contributed health-related data, with the ultimate goal of improving public health.

Are You Spreading Misinformation? Analyzing How Influential Twitter Users Contribute to the Spread of COVID-19 Information

The infodemic created by the COVID-19 pandemic has created several societal issues, including a rise in distrust between the public and health experts and even a refusal of some to accept vaccination; some sources suggest that 1 in 4 Americans will refuse the vaccine [1]. This social concern can be traced to the level of digitization today – particularly in the form of social media. As social media was the most significant contributing factor to the spread of misinformation, the team decided to examine infodemiology across various text-based platforms (Twitter, 4chan, Reddit, Parler, Facebook, and YouTube). This was done by utilizing a sentiment analysis to compare general posts with key terms flagged as misinformation (all of which concern COVID-19) to determine their variety. In gathering the datasets, both APIs and also pre-existing data compiled by standard scientific third parties were used. It was found that in some cases, misinforming posts can have up to 92.5% more negative segment skew compared to accurate posts. From this, the novel Plebeian Algorithm is proposed, which utilizes sentiment analysis and post popularity as metrics to flag a post as misinformation. This algorithm diverges from that of the status quo, as the Plebeian Algorithm uses a democracy process to detect and remove misinformation. A method was constructed in which content deemed misinformation to be removed from the platform is determined by a randomly selected jury of anonymous users. This not only prevents these types of infodemics, but also guarantees a more democratic way of using social media that is beneficial for repairing social trust and encouraging the public’s evidence-informed decision making.



The Plebeian Algorithm A Democratic Approach to Censorship and Moderation

Medical implants are now an integral part of public health in the United States. However, the last few years have brought several controversies regarding their regulation, considering the large number of deleterious effects reported by patients. Some authors even denounce the lack of rigour and transparency in the process of marketing medical implants as well as in the reporting of data. This article aims to address these shortcomings by introducing the American Database for Medical Implant Transparency (ADMIT), a database integrating data from multiple governmental  sources to characterize the entire process by which implantable medical implants are approved by the FDA. After exploring the potential of ADMIT through preliminary analyses, it will be published on an open access platform. Ultimately, it is hoped that this initiative will stimulate research into the real negative effects of gaps in medical implant regulation while providing an informative tool for patients seeking information about them.


Introducing ADMIT : A First Step in Uncovering FDA’s Deceit

Vaccination of the general public is a key step towards reducing the spread of COVID-19 and achieving herd immunity [1]. However, vaccine hesitancy is one of the greatest hindrances to mass vaccination campaigns. As such, being able to understand the factors that affect vaccine sentiment amongst the public is crucial to being able to manage the spread of COVID-19. Previous studies have highlighted the relationship between tweet sentiment and public sentiment, and have also found that stock prices are reflective of public opinion towards a particular company. Since Pfizer, Moderna and AstraZeneca are the primary vaccine producers, tweets relating to the vaccines produced by these companies as well as the stock prices of these companies are likely good indicators of public sentiment towards the COVID-19 vaccines. To identify and quantify the influence of pandemic events that have affected people’s sentiments towards the Pfizer, Moderna, and AstraZeneca vaccines the most, Twitter sentiment analysis as well as a stock price analysis for these companies was performed. A data set of 4,093,081 tweets authored by 1,708,892 unique users which contained key phrases or hashtags related to the AstraZeneca, Pfizer and Moderna vaccines was compiled from February 24th, 2020, to May 28th, 2021, using the Twint Python tool. Sentiment analysis was conducted using the Valence Aware Dictionary and Sentiment Reasoner (VADER) tool[2]. The stock price data was extracted from Yahoo Finance over the same period of time. Time lines of influencing events were constructed by identifying days for which a significant change in stock price or tweet sentiments occurred and then matching those days to significant events related to the pandemic. Our results suggest that news relating to vaccine clinical trials, vaccine distribution, the development of COVID-19 therapetiucs, government public health guide lines, government funding of vaccine development and the distribution and eligibility guidelines for the vaccines and PPE distribution are factors that likely influence change in the public’s positive, negative and neutral opinions on the vaccines. 
Furthermore, our analysis indicates that, to combat the spread of misinformation, public health units should devote more resources to ensuring that information about vaccine eligibility and vaccine distribution is accessible to the public.







"

What pandemic events have had the most influence on public sentiment towards the AstraZeneca, Pfizer and Moderna COVID-19 Vaccines?

Fake news is prevalent online due to the numerous social networks available on the internet. The COVID-19 pandemic started a new wave of health-related fake news that has increased the 
spread of misinformation. The tweets obtained from the ""CoAID"": COVID-19 Healthcare Misinformation Dataset contains healthcare information related to COVID-19, their reliable labels, and user engagement features. This paper applied machine learning (ML), deep learning (DL) and transformer based ML models (BERT) on the dataset. The dataset was first extracted using the computer software Hydrator, and included 252471 tweets from December 2019 to September 2020. The data was then preprocessed and vectorized. Exploratory analysis of the raw dataset was first done in Excel to find the correlation between the different tweet features. Classifying the tweets as ""real"" or ""fake"" was done in three ways: via Traditional Supervised Learning models, Traditional Natural Language Processing (NLP) models, and Deep Learning models. An algorithm was developed once the ideal NLP model was selected to further improve classification metrics. Traditional Supervised Learning models involved selecting variables about the tweets such as the number of retweets, and using those features for classification. Traditional NLP methods applied conventional models such as Naive Bayes (NB) and Random Forest (RF) models to the vectorized data. Finally, three deep learning models were created: a Deep Neural Network (DNN) model, a Recurrent Neural Network (RNN), and an RNN model that used a Bidirectional Encoder Representations from Transformers (BERT) model for word embedding. 
Overall, the best model to use was the RNN model since it performed well on the test dataset, and had the best classification metrics when exposed to data it had never seen before. 
An example of the deployed model our team created called ""TweetScan"" can be found here. It ultimately illustrates how the results of this paper can be applied to reduce the spread of 
misinformation, especially concerning recent issues such as vaccination acceptance.




Downloads

Next from Infodemiology For The Future Of Digital And Public Health

Are You Spreading Misinformation? Analyzing How Influential Twitter Users Contribute to the Spread of COVID-19 Information

Similar lecture

Harnessing Personalization Methods to Identify and Predict Unreliable Information Spreader Behavior

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from Infodemiology For The Future Of Digital And Public Health

Are You Spreading Misinformation? Analyzing How Influential Twitter Users Contribute to the Spread of COVID-19 Information

Similar lecture

Harnessing Personalization Methods to Identify and Predict Unreliable Information Spreader Behavior

Downloads