EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Budget-Aware Adaptive Test-Time Compute with Hierarchical Self-Verification for Semantic ID Generative Recommendation

Aowei Shen, Wenhe Liu

Computers · 05.11.2026 · 15 (11) · 807

DOI: 10.3390/computers15110807 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers, online erschienen am 05.11.2026. Verfasst von Aowei Shen und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Semantic identifier (SID) generative recommenders cast retrieval as autoregressive decoding over short sequences of residual-quantized codewords. Most published SID recommenders decode all requests with one fixed beam width, which is optimal only if the marginal utility of compute is constant across requests. We find that it is not; additional search changes little for users with consistent histories, but improves accuracy substantially for cold start, interest-drifting, and long-tail users. The main methodological contribution of this paper is request-level allocation of decoding compute, in which a router predicts the accuracy gain of each configuration in a finite decoding menu over the cheapest configuration and selects the configuration with the largest gain net of a priced cost. The selection rule follows from standard Lagrangian arguments, which we use as tools; what is specific to this work is the use of this per-configuration gain as the routing target for SID decoding instead of a difficulty or uncertainty score. The resulting framework, called Bastion, combines the router with a hierarchical process verifier over the quantization levels, a listwise terminal verifier, codeword consistency voting, and budget-constrained group relative policy optimization. On five benchmarks built from Amazon Reviews 2023, MovieLens, and MicroLens, Bastion improves NDCG@10 by 5.7% to 8.7% over the strongest baseline. Its mean latency on Amazon-Beauty is 14.5 ms, against 14.6 ms for a beam-20 TIGER decoder, while its median and 99th-percentile latencies are higher by 0.9 ms and 7.0 ms. At every evaluated budget, its accuracy exceeds that of all baselines on the three datasets for which accuracy versus latency frontiers was measured.

Zitieren

APA

Shen, A., & Liu, W. (2026). Budget-Aware Adaptive Test-Time Compute with Hierarchical Self-Verification for Semantic ID Generative Recommendation. Computers, 15(11), 807. https://doi.org/10.3390/computers15110807

Vancouver

Shen A, Liu W. Budget-Aware Adaptive Test-Time Compute with Hierarchical Self-Verification for Semantic ID Generative Recommendation. Computers. 2026;15(11):807. doi:10.3390/computers15110807

BibTeX
@article{Shen2026,
  author = {Shen, Aowei and Liu, Wenhe},
  title = {Budget-Aware Adaptive Test-Time Compute with Hierarchical Self-Verification for Semantic ID Generative Recommendation},
  journal = {Computers},
  year = {2026},
  volume = {15},
  number = {11},
  pages = {807},
  doi = {10.3390/computers15110807}
}
Kostenlos starten →