profile picture

Weicheng Ma

Dartmouth College

transformer networks

natural language processing

attention analysis

word embeddings

syntactic probing

natural language inference

metaphor detection

model interpretability

multi-lingual and cross-lingual nlp

dataset re-annotation

textual entailment

mono-lingual cultural background prediction

multi-grained cultural background prediction

dataset construction and benchmarking

control task

8

presentations

33

number of views

SHORT BIO

I am a 5-th year PhD student at Dartmouth College. My advisor is Prof. Soroush Vosoughi. My research interests span over Deep Learning and its applications in Natural Language Processing (NLP) and computational sociology. My recent projects focus on the interpretation of deep Transformer-based models under multi-task or multi-lingual settings and their applications for social good (e.g., reducing stereotypes). I am also interested in the application of NLP techniques to the study of human behavioral patterns or psychographic characteristics.

Presentations

Simulated Misinformation Susceptibility (SMISTS): Enhancing Misinformation Research with Large Language Model Simulations

Weicheng Ma and 5 other authors

Deciphering Stereotypes in Pre-Trained Language Models | VIDEO

Weicheng Ma and 9 other authors

Improving Syntactic Probing Correctness and Robustness with Control Tasks

Weicheng Ma

EnCBP: A New Benchmark Dataset for Finer-Grained Cultural Background Prediction in English

Weicheng Ma and 3 other authors

GradTS: A Gradient-Based Automatic Auxiliary Task Selection Method Based on Transformer Networks

Weicheng Ma and 4 other authors

Contributions of Transformer Attention Heads in Multi- and Cross-lingual Tasks

Weicheng Ma and 4 other authors

Improvements and Extensions on Metaphor Detection

Weicheng Ma and 3 other authors