Building Large Language Models in Kazakh Language: Kazakhstan’s Experience and Global Trends

2026

Full text Open access: Hybrid Metadata (CSL-JSON)
DOI 10.55491/2411-6076-2026-1-135-149
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

The article analyzes the scientific and practical aspects of developing an artificial intelligence-based Large Language Model (LLM) oriented toward the Kazakh language as a basic platform for 2024-2026. The relevance of the study is determined by the need to create a full-fledged digital representation of Kazakh, preserve national identity, and ensure linguistic sovereignty in the context of digitalization. The aim of the work is to describe the theoretical principles of the LLM, the structure of a transformer-type neural network, and the composition and annotation of the dataset, as well as to demonstrate their compliance with national and international ethical and legal norms. The data corpus covers national mentality, historical and cultural traditions, and current legislation. The materials, grouped in several key categories, include question–answer pairs and expert commentary and are formulated with ethical requirements in mind. The paper discusses modern methods of text processing, approaches to reducing erroneous and fabricated model outputs, and a qualitative assessment of the results obtained. The scientific novelty is reflected in the systematic description of the first comprehensive large language model (LLM) for the Kazakh language; its practical significance is demonstrated by its potential applications in education, scientific analytics, digital services, and the implementation of state language policy.