Linguistic Analysis of Toxic Language on Social Media

Ine Gevers, Ilia Markov, Walter Daelemans

Research output: Contribution to JournalArticleAcademicpeer-review

617 Downloads (Pure)

Abstract

The increasing popularity of online communication platforms entails a profound interest in the automatic detection of toxic language, since the effects of user anonymity or issues with content moderation can result in hostile environments. Linguistic analysis can be an important tool for discovering language patterns discriminating between toxic and non-Toxic language, leading to the development of more robust detection systems. In this paper, we investigate several linguistic features of online Dutch toxic comments compared to non-Toxic comments. We focus on three main research questions investigating the differences between the two types of comments: Average length, lexical diversity, and linguistic standardness of comments. More specifically, we compared the average number of tokens per comment, the type-Token ratio, (variants of) the content-To-function-word ratio, the propositional idea density, the use of emoji and emoticons, the punctuation to non-punctuation ratio, and measured the level of linguistic standardness combining features such as word choice, character flooding, and unconventional capitalization. The analysis was performed on the LiLaH dataset, which contains over 36,000 Dutch Facebook comments related to the LGBT community and migrants. We conclude that toxic comments are different from their non-Toxic counterpart regarding all the investigated linguistic features. Additionally, we compared our results to Slovene and English. Our analysis suggests that there are commonalities but also remarkable differences in the linguistic landscape of toxic language across the three languages that may lead to further research.

Original languageEnglish
Pages (from-to)33-48
Number of pages16
JournalComputational Linguistics in the Netherlands
Volume12
Early online date22 Dec 2022
Publication statusPublished - Dec 2022
Event32nd Meeting of Computational Linguistics in the Netherlands, CLIN 2022 - Tilburg, Netherlands
Duration: 17 Jun 2022 → …

Bibliographical note

Funding Information:
Acknowledgements This research has been supported by the Flemish Research Foundation through the bilateral research project FWO G070619N “The linguistic landscape of hate speech on social media”. The research also received funding from the Flemish Government (AI Research Program). We would like to thank the reviewers for their valuable contributions.

Publisher Copyright:
© 2022 Computational Linguistics in the Netherlands. All rights reserved.

Funding

Acknowledgements This research has been supported by the Flemish Research Foundation through the bilateral research project FWO G070619N “The linguistic landscape of hate speech on social media”. The research also received funding from the Flemish Government (AI Research Program). We would like to thank the reviewers for their valuable contributions.

FundersFunder number
Fonds Wetenschappelijk Onderzoek
Vlaamse regering

    Fingerprint

    Dive into the research topics of 'Linguistic Analysis of Toxic Language on Social Media'. Together they form a unique fingerprint.

    Cite this