Adaptive region aggregation for multi‐view stereo matching using deformable convolutional networks
The Photogrammetric Record · 2023-09 · 38 (183) · 430-449
DOI: 10.1111/phor.12459 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Photogrammetric Record, online erschienen am 21.08.2023. Verfasst von Han Hu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 71 Literaturangaben. Gefördert von: National Basic Research Program of China, National Natural Science Foundation of China.
Abstract (Originalsprache)
Deep‐learning methods have demonstrated promising performance in multi‐view stereo (MVS) applications. However, it remains challenging to apply a geometrical prior on the adaptive matching windows to achieve efficient three‐dimensional reconstruction. To address this problem, this paper proposes a learnable adaptive region aggregation method based on deformable convolutional networks (DCNs), which is integrated into the feature extraction workflow for MVSNet method that uses coarse‐to‐fine structure. Following the conventional pipeline of MVSNet, a DCN is used to densely estimate and apply transformations in our feature extractor, which is composed of a deformable feature pyramid network (DFPN). Furthermore, we introduce a dedicated offset regulariser to promote the convergence of the learnable offsets of the DCN. The effectiveness of the proposed DFPN is validated through quantitative and qualitative evaluations on the BlendedMVS and Tanks and Temples benchmark datasets within a cross‐dataset evaluation setting.
Förderung
- National Basic Research Program of China
- National Natural Science Foundation of China
Zitieren
APA
Hu, H., Su, L., Mao, S., Chen, M., Pan, G., Xu, B., & Zhu, Q. (2023). Adaptive region aggregation for multi‐view stereo matching using deformable convolutional networks. The Photogrammetric Record, 38(183), 430-449. https://doi.org/10.1111/phor.12459
Vancouver
Hu H, Su L, Mao S, Chen M, Pan G, Xu B, et al. Adaptive region aggregation for multi‐view stereo matching using deformable convolutional networks. The Photogrammetric Record. 2023;38(183):430-449. doi:10.1111/phor.12459
BibTeX
@article{Hu2023,
author = {Hu, Han and Su, Liupeng and Mao, Shunfu and Chen, Min and Pan, Guoqiang and Xu, Bo and Zhu, Qing},
title = {Adaptive region aggregation for multi‐view stereo matching using deformable convolutional networks},
journal = {The Photogrammetric Record},
year = {2023},
volume = {38},
number = {183},
pages = {430--449},
doi = {10.1111/phor.12459}
}
EUVIMED