EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

PIPformers : Patch based inpainting with vision transformers for generalize paintings

Jeyoung Lee, Hochul Kang

Computer Animation and Virtual Worlds · 2024-05 · 35 (3)

DOI: 10.1002/cav.2270 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Animation and Virtual Worlds, online erschienen am 17.05.2024. Verfasst von Jeyoung Lee und 1 weiteren Autor:innen. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Catholic University of Korea.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Image inpainting is a field that has been traditionally attempted in the field of computer vision. After the development of deep learning, image inpainting has been advancing endlessly together with convolutional neural networks and generative adversarial networks. Thereafter, it has been expanded to various fields such as image filing through guiding and image inpainting using various masking. Furthermore, the field termed image out‐painting has also been pioneered. Meanwhile, after the recent announcement of the vision transformer, various computer vision problems have been attempted using the vision transformer. In this paper, we are trying to solve the problem of image generalization painting using the vision transformer. This is an attempt to fill images with painting no matter whether the areas where painting is missing are in or out of the images, and without guiding. To that end, the painting problem was defined as a problem to drop images in patch units for easy use in the vision transformer. And we solved the problem with a simple network structure created by slightly modifying the vision transformer to fit the problem. We named this network PIPformers. PIPformers achieved better values than other papers compared to PSNR, RMSE and SSIM.

Förderung

  • Catholic University of Korea

Zitieren

APA

Lee, J., & Kang, H. (2024). PIPformers : Patch based inpainting with vision transformers for generalize paintings. Computer Animation and Virtual Worlds, 35(3). https://doi.org/10.1002/cav.2270

Vancouver

Lee J, Kang H. PIPformers : Patch based inpainting with vision transformers for generalize paintings. Computer Animation and Virtual Worlds. 2024;35(3). doi:10.1002/cav.2270

BibTeX
@article{Lee2024,
  author = {Lee, Jeyoung and Kang, Hochul},
  title = {PIPformers : Patch based inpainting with vision transformers for generalize paintings},
  journal = {Computer Animation and Virtual Worlds},
  year = {2024},
  volume = {35},
  number = {3},
  doi = {10.1002/cav.2270}
}
Kostenlos starten →