Algorithms for the classification of text documents, taking into account proximity in the attribute space

2022

Закрытый доступ Метаданные (CSL-JSON)
DOI 10.12737/2219-0767-2022-15-1-36-43
Достоверность данных 70 средняя
Как считается эта оценка

Складывается из проверяемых признаков самой записи: есть ли у статьи DOI, сколько независимых источников подтвердили её данные, заполнены ли обязательные поля и насколько свежо последнее подтверждение. Снижают оценку расхождения между источниками и отсутствие идентификатора. Значение от 80 означает, что запись опубликована без дополнительной проверки; от 60 до 79 — что она опубликована с пониженной достоверностью и ручная проверка желательна. Запись, выверенную редактором вручную, пересчёт не опускает ниже 90. Это оценка наших данных о статье, а не оценка самой статьи.

Аннотация

Text classification is one of the key issues in text development research, where documents are classified based on information under supervision. Since there is a considerable number of text classification algorithms, it is currently necessary to compile an overview list of them in order to simplify the orientation in the classification tools that are available at the moment. Many text representation schemes and classification/learning algorithms used to classify text documents into predefined categories can be found in the literature, but some of them require detailed analysis and unleashed potential. The purpose of this study is to provide an overview of different text presentation schemes and a comparison of different classifiers that are used to classify text documents into predefined categories. During the study, a comparison method was used as part of the methodology – modern classification approaches based on criteria, algorithms used and time complexity were compared, as well as methods of analysis, modelling and combination. As a result of the study, several algorithms or combinations of algorithms have been proposed for automatic classification of documents as hybrid approaches. The SVM (Support Vector Machine) classifier was recognised as one of the most effective text classification methods when comparing guided machine learning algorithms. It was concluded that SVM captures the inherent characteristics of the data and embeds the structural risk minimisation (SRM) principle, which minimises the upper bound of the generalisation error better than the empirical risk minimisation principle.