An explainable multi-backbone deep feature fusion framework for intelligent surveillance and citizen safety in smart city ecosystems

Frontiers in Artificial Intelligence, 2026

Full text Open access: Gold Metadata (CSL-JSON)
DOI 10.3389/frai.2026.1836157
Data confidence 70 medium
How this score is calculated

It is built from checkable properties of the record itself: whether the article has a DOI, how many independent sources confirmed its data, whether the required fields are filled in, and how recent the latest confirmation is. Disagreement between sources and a missing identifier lower it. A value of 80 or above means the record was published without further checking; 60 to 79 means it is published at reduced confidence, with a manual check advisable. A record verified by an editor by hand is never pushed below 90 by a recalculation. This scores our data about the article, not the article itself.

Abstract

Introduction: Safety in the city has become a pressing issue in modern smart cities because of the rising rate of violence, attacks, and incidences involving weapons recorded by extensive CCTV networks. Conventional surveillance systems also have difficulties in real-time recognition, scaling, and transparency, as they are not always able to identify cases of violence on time. Methods: This paper proposes DeReV, a novel explainable deep feature-level ensemble framework that integrates two variants from each of the DenseNet, ResNet, and VGG families within a multi-backbone feature fusion architecture for multi-class violence detection in videos. The model is based on the Smart-City CCTV Violence Detection (SCVD) dataset to classify CCTV video as either normal, violent, or weaponized. Results and discussion: DeReV resulted in better performance with an accuracy of 96.15 and a macro F1-score of 0.9617, which is better than the individual baseline networks such as ResNet101 (91.67%), DenseNet169 (92.30%), and VGG16 (92.94%). The ROC analysis has shown that the AUC scores are 0.99 (normal), 0.98 (violence), and 0.98 (weaponized), whereas the Precision-Recall curves are 0.99, 0.97, and 0.95, respectively, which prove the high capability of discrimination and stability under different conditions. The interpretability and transparency of the results were achieved by using Explainable AI (XAI) methods like Grad-CAM, LIME, and Counterfactual Temporal Importance to identify salient spatial and temporal features in the predictive behaviors of the decision outcomes. The suggested DeReV framework not only offers more accurate predictions and model explainability but also supports trustworthy near real-time and citizen-centered AI surveillance, building safer and more resilient smart city ecosystems.