Short Text Classification using Contextual Analysis

Sami Hamid Al Sulaimani* (Corresponding Author), Andrew Starkey

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Micro blogging tools provide a real time service for the public to express opinions, to broadcast news and information and offer an opportunity to comment and respond to such output. Word usage in social media is continually evolving. Micro bloggers may use different sets of words to describe a specific event and they may use new words (i.e. neither exist in the training dataset nor in informal or formal dictionaries) or use words in new contexts. Dynamically capturing new words and their potential meaning from their context can help to reflect the words relationship in social media, which then can be useful for solving various problems, like the event classification task. Different approaches have been proposed in this regard, one of them is Contextual Analysis. This paper focuses on examining the potential of this approach for grouping short texts (tweets) talking about the same event into the same category. A new transparent method for text multi-class categorization is presented. It uses the Contextual Analysis approach to capture the most important words in the context of an event and to detect the usage of similar words in different contexts. In order to test the efficacy in these areas, this study evaluates the performance of the proposed method and other well known methods, such as Naïve Bayes, Support Vector Machines, K-Nearest Neighbors and Convolutional Neural Networks. On average, the experiments’ results show that the proposed multi-class classification method can effectively categorize tweets into various event groups, with a high f1-measure score f1>97.09% and f1>95.27%, in the imbalanced classes and high number of classes experiments, respectively. However, similar to the baseline methods, the performance is negatively
influenced by the imbalanced dataset. The Convolutional Neural Networks method produces the best performance among the other algorithms with f1>97.74% in all experiments, which is 1.73% and 2.72% higher than the lowest performance of Naive Bayes and K-Nearest Neighbors, respectively, but does not
meet the requirements of transparency of results.
Original languageEnglish
Pages (from-to)149619 - 149629
Number of pages11
JournalIEEE Access
Volume9
Early online date8 Nov 2021
DOIs
Publication statusPublished - 11 Nov 2021

Keywords

  • Text analysis
  • event classification
  • contextual analysis
  • supervised machine learning

Fingerprint

Dive into the research topics of 'Short Text Classification using Contextual Analysis'. Together they form a unique fingerprint.

Cite this