Subject: Deep Learning, NLP, RNN, LSTM, GRU, Abusive Language Detection, Hate Speech, Cyberbullying
Year: 2020
Type: Proceeding article
Title: Evaluation of Recurrent Neural Network architectures for abusive language detection in cyberbullying contexts
Author: Filip Markoski
Author: Eftim Zdravevski
Author: Nikola Ljubešić
Author: Sonja Gievska
Abstract: Cyberbullying is a form of bullying that takes place over digital devices. Social media is one of the most common environments where it occurs. It can lead to serious long-lasting trauma and can lead to problems with fear, anxiety, sadness, mood, energy level, sleep, and appetite. Therefore, detection and tagging of hateful or abusive comments can help in the mitigation or prevention of the negative consequences of cyberbullying. This paper evaluates seven different architectures relying on Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) gating units for classification of comments. The evaluation is conducted on two abusive language detection tasks, on a Wikipedia data set and a Twitter data set, obtaining ROC-AUC scores of up to 0.98. The architectures incorporate various neural network mechanisms such as bi-directionality, regularization, convolutions, attention etc. The paper presents results in multiple evaluation metrics which may serve as baselines in future scientific endeavours. We conclude that the difference is extremely negligible with the GRU models marginally outperforming their LSTM counterparts whilst taking less training time.
Publisher: Ss. Cyril and Methodius University in Skopje, Faculty of Computer Science and Engineering, Republic of North Macedonia
Relation: CIIT 2020 full papers;21
Identifier: oai:repository.ukim.mk:20.500.12188/8269
Identifier: http://hdl.handle.net/20.500.12188/8269
