Detecting political bias trolls in Twitter data

Soon Ae Chun, Richard Holowczak, Kannan Neten Dharan, Ruoyu Wang, Soumaydeep Basu, James Geller

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Scopus citations

Abstract

Ever since Russian trolls have been brought to light, their interference in the 2016 US Presidential elections has been monitored and studied. These Russian trolls employ fake accounts registered on several major social media sites to influence public opinion in other countries. Our work involves discovering patterns in these tweets and classifying them by training different machine learning models such as Support Vector Machines, Word2vec, Google BERT, and neural network models, and then applying them to several large Twitter datasets to compare the effectiveness of the different models. Two classification tasks are utilized for this purpose. The first one is used to classify any given tweet as either troll or non-troll tweet. The second model classifies specific tweets as coming from left trolls or right trolls, based on apparent extreme political orientations. On the given data sets, Google BERT provides the best results, with an accuracy of 89.4% for the left/right troll detector and 99% for the troll/non-troll detector. Temporal, geographic, and sentiment analyses were also performed and results were visualized.

Original languageEnglish (US)
Title of host publicationWEBIST 2019 - Proceedings of the 15th International Conference on Web Information Systems and Technologies
EditorsAlessandro Bozzon, Francisco Jose Dominguez Mayo, Joaquim Filipe
PublisherSciTePress
Pages334-342
Number of pages9
ISBN (Electronic)9789897583865
StatePublished - Jan 1 2019
Event15th International Conference on Web Information Systems and Technologies, WEBIST 2019 - Vienna, Austria
Duration: Sep 18 2019Sep 20 2019

Publication series

NameWEBIST 2019 - Proceedings of the 15th International Conference on Web Information Systems and Technologies

Conference

Conference15th International Conference on Web Information Systems and Technologies, WEBIST 2019
Country/TerritoryAustria
CityVienna
Period9/18/199/20/19

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Networks and Communications

Keywords

  • Alt-right tweets
  • Election manipulation
  • Political biases
  • Social network mining
  • Troll detection
  • Twitter

Fingerprint

Dive into the research topics of 'Detecting political bias trolls in Twitter data'. Together they form a unique fingerprint.

Cite this