Edge-Based Vision-Language Assistive System for the Visually Impaired: A Quantized VLM Approach

Batyr Arystanbekov, Hüseyin Atakan Varol, Adnan Yazıcı

2026

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.1109/tnsre.2026.3696447
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

This paper presents a novel edge-deployable assistive system for visually impaired individuals, powered by vision-language models (VLMs). Existing cloud-based solutions for image captioning suffer from latency, dependency on internet connectivity, and overly simplistic scene descriptions that fail to convey the rich contextual information needed for meaningful real-world navigation. To address these challenges, we propose a self-contained, wearable system that performs real-time scene interpretation on-device without cloud reliance. The system integrates a quantized version of the LLaVA-NeXT-13B VLM with speech recognition (Whisper) and speech synthesis (PIPER), running on an NVIDIA Jetson Orin NX and Raspberry Pi-based input module. Our framework emphasizes intuitive user interaction through a button-based interface and Bluetooth audio output, minimizing cognitive load. We validate the quantization approach through large-scale benchmarks, such as VizWiz-VQA and VQAv2, demonstrating minimal accuracy degradation (2.6% and 0.9%, respectively) compared to the original model. User evaluations involving 28 participants compared the system to a baseline image captioning model. Objective results demonstrated a 25% increase in image identification accuracy. The system achieved high usability scores and maintained practical latency (4-5 seconds per query), supporting real-world feasibility. This work advances the development of scalable, interpretable, and accessible AI-driven assistive technologies, enabling greater independence and interaction for the visually impaired.