The construction of the Kazakh language thesauri in automatic word processing system

2020

Closed access Metadata (CSL-JSON)
DOI 10.1145/3410352.3410789
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

In the paper presents an overview of existing electronic Kazakh-language thesauri and their automatic methods of construction and application. The author analyzed the main characteristics of open access thesauri for scientific research, evaluated the dynamics of their development and effectiveness in solving problems of natural language processing. Statistical and linguistic methods of thesaurus construction were studied, which allow to automate the development and reduce the labor costs of expert linguists. It is considered algorithms for selecting key terms from texts and semantic thesaurus links of all types, as well as the quality of application of the resulting thesauri. For illustrate the features of various methods of building thesaurus links, a combined method was developed that generates a specialized thesaurus completely automatically based on the corpus of domain texts and several existing linguistic resources.