Beyond Feature Similarity: A Local and Global Redundancy Analysis
Computers · 07.11.2026 · 15 (11) · 812
DOI: 10.3390/computers15110812 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computers, online erschienen am 07.11.2026. Verfasst von Anouar Chahbouni und 6 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Deep neural networks achieve remarkable performance in visual recognition tasks, but this accuracy often comes at the cost of high computational complexity and over-parameterized representations. Structured pruning has emerged as an effective solution for reducing this complexity by eliminating unnecessary representations. Nevertheless, its success implicitly relies on the existence of exploitable redundancy within learned feature spaces, whereas the nature, structure, and evolution of such redundancy remain largely underexplored. To address this gap, this paper presents a comprehensive redundancy analysis framework that investigates deep representations from complementary visual, geometric, and intrinsic dimensionality perspectives. The framework is evaluated using VGG16 and Swin-Tiny on the CIFAR-10 and PlantVillage datasets, enabling the analysis of redundancy across convolutional and transformer-based architectures, multiple representation levels, and distinct image classification domains. The proposed framework combines feature-map visualization, cosine similarity analysis, singular value decomposition (SVD), and effective rank (ER) to jointly characterize feature redundancy, representational dependencies, and intrinsic dimensionality from complementary local and global perspectives. The results reveal that redundancy is a pervasive yet dynamic property of deep neural networks, evolving according to architecture, dataset characteristics, representation depth, and input distributions. Pairwise redundancy ratios reach up to 18.61% in deep representations, whereas normalized effective rank values decrease to as low as 0.01, indicating strong spectral concentration in some representations. More importantly, the study demonstrates that redundancy extends beyond directly similar features and also encompasses global dependencies and representations occupying reduced effective subspaces. Structured pruning validation further demonstrates substantial compression with preserved predictive performance under the evaluated experimental settings. These findings provide a deeper understanding of learned representations, establish a principled perspective for interpreting pruning effectiveness, and offer practical guidelines for developing future redundancy-aware compression methods for efficient and deployable deep learning systems.
Zitieren
APA
Chahbouni, A., Manaa, K. E., Manaa, I. E., Abouch, Y., Bossoufi, B., Ghzaoui, M. E., & Alami, R. E. (2026). Beyond Feature Similarity: A Local and Global Redundancy Analysis. Computers, 15(11), 812. https://doi.org/10.3390/computers15110812
Vancouver
Chahbouni A, Manaa KE, Manaa IE, Abouch Y, Bossoufi B, Ghzaoui ME, et al. Beyond Feature Similarity: A Local and Global Redundancy Analysis. Computers. 2026;15(11):812. doi:10.3390/computers15110812
BibTeX
@article{Chahbouni2026,
author = {Chahbouni, Anouar and Manaa, Khaoula El and Manaa, Imane El and Abouch, Yassine and Bossoufi, Badre and Ghzaoui, Mohammed El and Alami, Rachid El},
title = {Beyond Feature Similarity: A Local and Global Redundancy Analysis},
journal = {Computers},
year = {2026},
volume = {15},
number = {11},
pages = {812},
doi = {10.3390/computers15110812}
}
EUVIMED