Understanding and identifying the use of emotes in toxic chat on Twitch

Jaeheon Kim, Donghee Yvette Wohn, Meeyoung Cha

Research output: Contribution to journalArticlepeer-review

Abstract

The latest advances in NLP (natural language processing) have led to the launch of the much needed machine-driven toxic chat detection. Nevertheless, people continuously find new forms of hateful expressions that are easily identified by humans, but not by machines. One such common expression is the mix of text and emotes, a type of visual toxic chat that is increasingly used to evade algorithmic moderation and a trend that is an under-studied aspect of the problem of online toxicity. This research analyzes chat conversations from the popular streaming platform Twitch to understand the varied types of visual toxic chat. Emotes were sometimes used to replace a letter, seek attention, or for emotional expression. We created a labeled dataset that contains 29,721 cases of emotes replacing letters. Based on the dataset, we built a neural network classifier and identified visual toxic chat that would otherwise be undetected through traditional methods and caught an additional 1.3% examples of toxic chat out of 15 million chat utterances.

Original languageEnglish (US)
Article number100180
JournalOnline Social Networks and Media
Volume27
DOIs
StatePublished - Jan 2022

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Communication
  • Computer Networks and Communications

Keywords

  • Algorithmic moderation
  • Detection
  • Emotes
  • Live streaming
  • Twitch
  • Usages
  • Visual toxic chat

Fingerprint

Dive into the research topics of 'Understanding and identifying the use of emotes in toxic chat on Twitch'. Together they form a unique fingerprint.

Cite this