Vertical Deformation Mapping: Steering Optimiser Toward Flat Minima
CAAI Transactions on Intelligence Technology · 2026-06 · 11 (3) · 835-846
DOI: 10.1049/cit2.70137 ↗Kurz gefasst
Fachartikel in der Zeitschrift CAAI Transactions on Intelligence Technology, online erschienen am 29.04.2026. Verfasst von Liangming Chen und 4 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Standard deep learning optimisation is typically conducted on shape‐fixed loss surfaces. However, shape‐fixed loss surfaces may impede optimisers from reaching flat regions closely associated with strong generalisation. In this work, we propose a new paradigm named deformation mapping to deform the loss surface during optimisation. Moreover, we design various vertical deformation mappings (VDMs) and further analyse their contributions to the training process. Theoretically, we prove that deforming the loss surface enhances the optimiser's ability to filter out sharp minima in deterministic settings. Furthermore, by incorporating diffusion theory, we demonstrate that VDM exponentially reduces the escape time from sharp minima under stochastic noise and momentum. Empirically, visualisations of loss landscapes demonstrate that VDMs locate significantly flatter minima compared to standard optimisation. Furthermore, integrating VDMs into the training of various deep neural networks produces consistent accuracy gains on ImageNet, CIFAR‐10, and CIFAR‐100, with negligible additional computation. Notably, PreResNet‐20 on CIFAR‐100 achieves a 1.46% increase in top‐1 accuracy. These results indicate that the deformation mapping is a promising paradigm for improving optimisation and generalisation in deep learning. The code is available at https://anonymous.4open.science/r/Vertical‐Deformation‐Mapping‐2324 .
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Chen, L., Wang, L., Leung, M., Li, J., & Jin, L. (2026). Vertical Deformation Mapping: Steering Optimiser Toward Flat Minima. CAAI Transactions on Intelligence Technology, 11(3), 835-846. https://doi.org/10.1049/cit2.70137
Vancouver
Chen L, Wang L, Leung M, Li J, Jin L. Vertical Deformation Mapping: Steering Optimiser Toward Flat Minima. CAAI Transactions on Intelligence Technology. 2026;11(3):835-846. doi:10.1049/cit2.70137
BibTeX
@article{Chen2026,
author = {Chen, Liangming and Wang, Longbang and Leung, Man‐Fai and Li, Jianfeng and Jin, Long},
title = {Vertical Deformation Mapping: Steering Optimiser Toward Flat Minima},
journal = {CAAI Transactions on Intelligence Technology},
year = {2026},
volume = {11},
number = {3},
pages = {835--846},
doi = {10.1049/cit2.70137}
}
EUVIMED