An Augmented Reality Mobile App for Recognizing and Visualizing Museum Exhibits

2025

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.3390/computers14110492
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Augmented reality (AR) offers a novel way to enrich museum visits by deepening engagement and enhancing learning. This study presents the development of a mobile application for the Abylkhan Kasteyev State Museum of Arts (Almaty, Kazakhstan), designed to recognize and visualize exhibits through AR. Using computer vision and machine learning, the application identifies artifacts via a smartphone camera and overlays interactive 3D models in an augmented environment. The system architecture integrates Flutter plugins for AR rendering, YOLOv8 for exhibit recognition, and a cloud database for dynamic content updates. This combination enables an immersive educational experience, allowing visitors to interact with digital reconstructions and multimedia resources linked to the exhibits. Pilot testing in the museum demonstrated recognition accuracy above 97% and received positive feedback on usability and engagement. These results highlight the potential of AR-based mobile applications to increase accessibility to cultural heritage and enhance visitor interaction. Future work will focus on enlarging the exhibit database, refining performance, and incorporating additional interactive features such as multi-user collaboration, remote access, and gamified experiences.