EUVIMEDEUVIMED entdecken
Crossref

Learning frequency‐aware convolutional neural network for spatio‐temporal super‐resolution water surface waves

Chen Peng, Zaili Tu, Sheng Qiu, Chen Li, Changbo Wang, Hong Qin

Computer Animation and Virtual Worlds · 2022-11 · 33 (6)

DOI: 10.1002/cav.2116 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Animation and Virtual Worlds, online erschienen am 18.08.2022. Verfasst von Chen Peng und 5 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: National Science Foundation, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As a usual component in virtual scenes, water surface plays an important role in various graphical applications, including special effects, video games, and virtual reality. Although recent years have witnessed significant progress based on Navier–Stokes equations and simplified water models, large‐scale water surface waves with high‐frequency visual details remain computationally expensive for interactive applications. This article proposes a novel frequency‐aware neural network to synthesize consistent and detailed water surface waves from low‐resolution input. At its core, our approach leverage the wavelet transformation theory over space, frequency and direction, and incremental supervision to decompose the 4D amplitude function into multiple smaller subproblems. Specifically, we first customize four subnetworks and corresponding loss functions for super‐resolution of spatial resolution, temporal evolution, wave direction subdivision, and wave number, respectively. Then, to enforce the upsampling along each dimension orthogonal to each other, we introduce a cooperative training scheme to fine‐tune and integrate the proposed subnetworks with carefully designed training dataset. Our method can visually enhance high‐resolution spatial details, temporal coherence, interactions with complex boundaries, and various wave patterns with flexible control along multiple dimensions. Through extensive experiments, our method arrives at 13 speedup for 32 upsampling of various simulation scenarios. We also validate the effectiveness and robustness of our method to produce realistic water surface waves toward artistic innovation.

Förderung

  • National Science Foundation
  • National Natural Science Foundation of China

Zitieren

APA

Peng, C., Tu, Z., Qiu, S., Li, C., Wang, C., & Qin, H. (2022). Learning frequency‐aware convolutional neural network for spatio‐temporal super‐resolution water surface waves. Computer Animation and Virtual Worlds, 33(6). https://doi.org/10.1002/cav.2116

Vancouver

Peng C, Tu Z, Qiu S, Li C, Wang C, Qin H. Learning frequency‐aware convolutional neural network for spatio‐temporal super‐resolution water surface waves. Computer Animation and Virtual Worlds. 2022;33(6). doi:10.1002/cav.2116

BibTeX
@article{Peng2022,
  author = {Peng, Chen and Tu, Zaili and Qiu, Sheng and Li, Chen and Wang, Changbo and Qin, Hong},
  title = {Learning frequency‐aware convolutional neural network for spatio‐temporal super‐resolution water surface waves},
  journal = {Computer Animation and Virtual Worlds},
  year = {2022},
  volume = {33},
  number = {6},
  doi = {10.1002/cav.2116}
}
Kostenlos starten →