SWS Academic Research eLibrarySocial Sciences & Art

Scholarly record

TOPIC MODELING FOR TWITTER DISCUSSIONS: MODEL SELECTION AND QUALITY ASSESSMENT

S. S. Bodrunova, I. S. Blekanov, M. Kukarkin

First published: 2019https://doi.org/10.5593/SWS.ISCSS.2019.5/S16.026View metrics

Abstract

Topic modeling is a method of automated definition of subtopics in a text corpus. Usage of topic modeling for short texts, e.g. tweets, is highly complicated due to their short length and grammatical restructuring, including broken word order, abbreviations, and contamination of different languages. In this paper, the authors use the BTM topic modelling algorithm (previously found to work best in comparison with two other topic models measured by automated coherence metrics Umass and NPMI) to test three topic quality metrics independent from topic coherence. Topic modelling is applied to three cases of ethnic conflict discussions on Twitter in three different main languages, namely the Charlie Hebdo shooting (France), the Ferguson unrest (the USA), and the anti-immigrant bashings in Biryulevo (Russia), thus combining a large multilingual, a large monolingual, and a mid-range monolingual type of discussion. We measure the quality of modeling by looking at topic interpretability, topic robustness, and topic saliency. The results of the experiment show that the three topic features may be interdependent (but not always are); the multilingual discussion performs better than the monolingual ones in terms of interdependence of the metrics and formation of ideal topics; and interpretability does not depend on multi-/monolingualism and the dataset volume.

Publication Impact Profile

PlumX
No metrics available.
PLUMX see details

Publication details

Title
TOPIC MODELING FOR TWITTER DISCUSSIONS: MODEL SELECTION AND QUALITY ASSESSMENT
Authors
S. S. Bodrunova, I. S. Blekanov, M. Kukarkin
Proceedings
6th SWS International Scientific Conference on Social Sciences ISCSS 2019
Publisher
STEF92 Technology
Year
2019
Pages
207-214
SWS Citekey
Bodrunova201916207214
ISSN
2682-9959
ISBN
978-619-7408-95-9
Language
en
Publication type
Proceedings Paper
Keywords
topic modellingTwitterquality assessmentBTMhuman codingtopic coherenceinterpretabilitytopic saliencytopic robustness
References11

  1. Ramage, D., Dumais, S., & Liebling, D. (2010, May). Characterizing microblogs with topic models. In Proceedings of the Fourth international AAAI conference on weblogs and social media (pp. 130-137). AAAI.

  2. Blekanov, I., Tarasov, N., & Maksimov, A. (2018, November). Topic Modeling of Conflict Ad Hoc Discussions in Social Networks. In Proceedings of the 3rd International Conference on Applications in Information Technology (pp. 122-126). ACM.

  3. Koltsova, O., & Koltcov, S. (2013). Mapping the public agenda with topic modeling: The case of the Russian livejournal. Policy & Internet, 5(2), 207-227.

  4. Jonnagaddala, J. I. T. E. N. D. R. A., Jue, T. R., & Dai, H. J. (2016, January). Binary classification of Twitter posts for adverse drug reactions. In Proceedings of the Social Media Mining Shared Task Workshop at the Pacific Symposium on Biocomputing (pp. 4-8).

  5. Ligutom, C., Orio, J. V., Ramacho, D. A. M., Montenegro, C., Roxas, R. E., & Oco, N. (2016, November). Using Topic Modelling to make sense of typhoonrelated tweets. In 2016 International Conference on Asian Language Processing (IALP) (pp. 362-365). IEEE.

  6. Maceda, L. L., Llovido, J. L., & Palaoag, T. D. (2017). Corpus Analysis of Earthquake Related Tweets through Topic Modelling. International Journal of Machine Learning and Computing, 7(6), 194-197.

  7. Mazarura, J. R., De Waal, A., Kanfer, F., & Millard, S. M. (2015). Topic modelling for short text. Conference paper. URL: researchgate.net/publication/279195527_Topic_Modelling_for_Short_Text.

  8. Lutovinova, O. V. (2008) Internet as a new ‘oral-written’ system of communication. Bulletin of the Russian State Pedagogical University, 78. URL: https://cyberleninka.ru/article/n/internet-kak-novaya-ustno-pismennaya-sistemakommunikatsii.

  9. Blekanov, I., Tarasov, N., & Maksimov, A. (2018). Topic Modeling of Conflict Ad Hoc Discussions in Social Networks. In Proceedings of the 3rd International Conference on Applications in Information Technology (pp. 122-126). ACM.

  10. Smoliarova, A. S., Bodrunova, S. S., Yakunin, A. V., Blekanov, I., & Maksimov, A. (2018, October). Detecting pivotal points in social conflicts via topic modeling of twitter content. In International Conference on Internet Science (pp. 61-71). Springer, Cham.

  11. Sridhar, V. K. R. (2015, June). Unsupervised topic modeling for short texts using distributed representations of words. In Proceedings of the 1st workshop on vector space modeling for natural language processing (pp. 192-200)

View or Download full articleAccess options
Full paper accessChoose SWS login, librarian support, or instant article download.

SWS access login

Login as SWS Scientific Committee

Authors and approved SWS contributors will read and export their own linked papers after identity matching by SWS profile, email and SGEM GlobalID.

For librarian assistance: [email protected]

Purchase Instant Access

48-hour online accessComing soon
Online-only accessComing soon
Download the full article in PDF formatEUR 35
  • Article can be downloaded after successful payment.
  • Article may be used according to SWS library access terms.
  • Article cannot be redistributed.
Get full paper

Back to publication list