Algorithms for the classification of text documents, taking into account proximity in the attribute space

2022

Closed access Metadata (CSL-JSON)
DOI 10.12737/2219-0767-2022-15-1-36-43
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Text classification is one of the key issues in text development research, where documents are classified based on information under supervision. Since there is a considerable number of text classification algorithms, it is currently necessary to compile an overview list of them in order to simplify the orientation in the classification tools that are available at the moment. Many text representation schemes and classification/learning algorithms used to classify text documents into predefined categories can be found in the literature, but some of them require detailed analysis and unleashed potential. The purpose of this study is to provide an overview of different text presentation schemes and a comparison of different classifiers that are used to classify text documents into predefined categories. During the study, a comparison method was used as part of the methodology – modern classification approaches based on criteria, algorithms used and time complexity were compared, as well as methods of analysis, modelling and combination. As a result of the study, several algorithms or combinations of algorithms have been proposed for automatic classification of documents as hybrid approaches. The SVM (Support Vector Machine) classifier was recognised as one of the most effective text classification methods when comparing guided machine learning algorithms. It was concluded that SVM captures the inherent characteristics of the data and embeds the structural risk minimisation (SRM) principle, which minimises the upper bound of the generalisation error better than the empirical risk minimisation principle.