A Critical Analysis of Regional Program Evaluation Practice in Kazakhstan

2022

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.51176/1997-9967-2022-3-108-123
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

In recent years the development of public program evaluation has received growing attention in Kazakhstan. An institutional and legal base for program evaluation has been established. However, the examination of literature has evidenced that there have been rudimentary attempts to interrogate evaluation practice, particularly at the regional level. It is still not well known how effective or valuable it is. It is imperative to run a diagnostic and assess the evaluation system to answer this question. This article aims to evaluate the quality of regional program evaluation practice in Kazakhstan. It applies a meta-evaluation tool to understand the extent to which such practice complies with three fundamental and recognized evaluation standards: namely, value, validity, and utility. As a sample, the study used evaluation reports conducted by regional Audit commissions. This research is the first attempt to apply established evaluation standards to the Kazakhstani context. Therefore, it was assumed that some discrepancies with the standards may occur. Having confirmed this hypothesis, the findings indicate that regional program evaluation falls far short of these standards. The paper identified many conceptual and methodological problems, which seriously compromise the validity and soundness of evaluation practice. It is expected that it will stimulate discussion in academic and subject matter expert circles. Furthermore, having identified key areas for improvement, the study may help reform the evaluation field and contribute to better policy- and decisionmaking, thus saving taxpayers’ money and improving people’s wellbeing. In the end, the research put forward several recommendations for strengthening evaluation practice.