DEVELOPMENT OF AN INTELLIGENT INFORMATION SYSTEM FOR DETECTING NEAR-DUPLICATE TEXTS IN KAZAKH LANGUAGE BASED ON A HYBRID NEURAL MODEL

2026

Closed access Metadata (CSL-JSON)
DOI 10.51775/2790-0886_2026_73_2_243
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

This article presents the development of an intelligent information system for detecting near- duplicate texts in the Kazakh language based on a previously developed hybrid neural model combining statistical and semantic methods of text analysis. The relevance of the research is due to the growth of digital scientific and educational materials and the need to ensure academic integrity and automated monitoring of text borrowing in the context of the linguistic structure of the Kazakh language, characterized by high morphological variability. As part of this study, a conceptual model of the information system was developed, and a structural model of the system based on microservice architecture was formed, The database of the system monitoring of academic texts in the Kazakh language has been designed and a mechanism for integrating the hybrid model into the software environment has been implemented. Functional, integration and load testing of developed modules has been carried out. Additionally, an experimental system test was performed on examples of real-world ways to disguise text borrowings, including inserting a text fragment into an image, rephrasing, and changing the document encoding. The developed system provides automated processing of documents, fragmentation of texts, calculation of similarity ratio, detection of near-duplicates, visualization of matching fragments and formation of reports on originality degree. The results of the study confirm the correctness of calculations, system stability, and the practical applicability of the system in educational and scientific organizations.