ZEBRA‐Prop: A Zero‐Shot Embedding‐Based Rapid and Accessible Regression Model for Materials Properties
Advanced Intelligent Systems · 10.11.2026
DOI: 10.1002/aisy.70592 ↗Kurz gefasst
Fachartikel in der Zeitschrift Advanced Intelligent Systems, online erschienen am 10.11.2026. Verfasst von Ryoma Yamamoto und 4 weiteren Autor:innen. Die Arbeit nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science, Ministry of Education, Culture, Sports, Science and Technology, Kanagawa Institute of Industrial Science and Technology.
Abstract (Originalsprache)
Large language models (LLMs) exhibit substantial potential across diverse scientific disciplines, including materials science. A property prediction framework, ZEBRA‐Prop (Zero‐Shot Embedding‐Based Rapid and Accessible Regression Model for Materials Properties), is presented here as an extension of LLM‐Prop. In contrast to LLM‐Prop, which requires task‐specific fine‐tuning of the LLM, ZEBRA‐Prop keeps the text encoder frozen and eliminates task‐specific fine‐tuning of the LLM, thereby reducing computational cost and enabling rapid model training. The framework employs MatBERT, a language model pretrained on materials science literature, to enhance predictive capability. Multiple textual embeddings are incorporated through a learnable weighting mechanism, which alleviates the context‐length constraints inherent in LLM‐Prop and facilitates effective integration of diverse textual representations. Evaluation is conducted using two datasets: the TextEdge dataset (~140,000 entries) and an in‐house dataset (~2000 entries) derived from the Materials Project database, with physical properties obtained from first‐principles calculations. The predictive performance of ZEBRA‐Prop is close to that of LLM‐Prop, while the training time is reduced by approximately 95%. The performance improvements are attributable to three principal factors: domain‐specific LLM utilization, diversified textual descriptions, and systematic text preprocessing. ZEBRA‐Prop is a scalable, computationally efficient framework that supports accelerated materials discovery, particularly under limited computational resources.
Förderung
- Japan Society for the Promotion of Science
- Ministry of Education, Culture, Sports, Science and Technology
- Kanagawa Institute of Industrial Science and Technology
Zitieren
APA
Yamamoto, R., Takahashi, A., Terayama, K., Kumagai, Y., & Oba, F. (2026). ZEBRA‐Prop: A Zero‐Shot Embedding‐Based Rapid and Accessible Regression Model for Materials Properties. Advanced Intelligent Systems. https://doi.org/10.1002/aisy.70592
Vancouver
Yamamoto R, Takahashi A, Terayama K, Kumagai Y, Oba F. ZEBRA‐Prop: A Zero‐Shot Embedding‐Based Rapid and Accessible Regression Model for Materials Properties. Advanced Intelligent Systems. 2026. doi:10.1002/aisy.70592
BibTeX
@article{Yamamoto2026,
author = {Yamamoto, Ryoma and Takahashi, Akira and Terayama, Kei and Kumagai, Yu and Oba, Fumiyasu},
title = {ZEBRA‐Prop: A Zero‐Shot Embedding‐Based Rapid and Accessible Regression Model for Materials Properties},
journal = {Advanced Intelligent Systems},
year = {2026},
doi = {10.1002/aisy.70592}
}
EUVIMED