ETL process for water resources and demographics data: an open source data processing tools and visualizations

2023

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.47533/2023.1606-146x.4
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Open data portals have become increasingly popular in recent years as more and more governments, organizations, and businesses recognize the benefits of making data publicly available for researchers, analysts and decision-making platforms. Many governments have launched their portal at the national, regional, and local levels. In addition to traditional government datasets such as demographics, finance, and transportation, open data portals are increasingly providing access to a broader range of data types, including environmental data, health data, and social media data. Many open data portals are offering improved tools for data analysis and visualization, making it easier for users to extract insights from the data. Increased collaboration and engagement between government, businesses, and the public, with features such as forums and hackathons. The purpose of this research is to find a way to automate data collecting and visualization processes by using different open source technologies and promoting Open Data Portal by using environmental data, especially water resources and pollution data from the Agency for Strategic Planning and Reforms of the Republic of Kazakhstan, Bureau of National Statistics.