Extremist Ideology Classification in Kazakh: A Multi-Class Approach Using Machine Learning and Psycholinguistic Analysis

Shynar Mussiraliyeva, Milana Bolatbek, Kymbat Baisylbayeva

IEEE Access, 2025

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.1109/access.2025.3596601
Data confidence 85 high
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

This paper presents a new approach for analyzing extremist content in the Kazakh language on social media using advanced machine learning and natural language processing techniques. With the rapid growth of online data, especially on social networks, there is an urgent need for tools that can identify and classify extremist ideologies. Our study focuses on four primary categories: propaganda, recruitment, radicalization, and neutral content. We employ a hybrid methodology that combines traditional text vectorization techniques, machine learning algorithms, and a psycholinguistic analysis module (PLAM) specifically adapted for the Kazakh language. To improve the accuracy of classification and capture subtle emotional signals, we integrate psycholinguistic features extracted through PLAM. The experimental results demonstrate the effectiveness of our hybrid approach. The combination of CountVectorizer + Logistic Regression + PLAM achieved the highest performance among traditional models (F1-score: 0.9305, Accuracy: 0.9308, ROC AUC: 0.9892). Among deep learning models, the BERT + LSTM model yielded the best results (F1-score: 0.9481, Accuracy: 0.9485, ROC AUC: 0.9918), followed by the standalone BERT model (F1-score: 0.9412, Accuracy: 0.9414, ROC AUC: 0.9901). These findings confirm that combining contextual embeddings with sequential modeling improves classification performance, particularly for ideologically complex categories. This research provides an effective framework for multilingual text analysis. It also contributes to improved monitoring and prevention of extremist content in underrepresented languages, such as Kazakh. Future work will focus on refining these methods and exploring their application in other domains for robust content moderation and security in the digital space.