EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

SFK: Shape‐ and Function‐Grounded Keypoint Representation for Sequential Manipulation

Yaxin Liu, Yan Liu, Xinyu Song, Ruiqing Han, Haiyong Liu, Bo Huang, Yufeng Yao, Ming Zhong

CAAI Transactions on Intelligence Technology · 2026-10 · 11 (5) · 1396-1412

DOI: 10.1049/cit2.70136 ↗

Kurz gefasst

Fachartikel in der Zeitschrift CAAI Transactions on Intelligence Technology, online erschienen am 22.04.2026. Verfasst von Yaxin Liu und 7 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Key Research and Development Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sequential manipulation is the process by which robots perform multiple interdependent steps to accomplish composite tasks, demanding tight integration of perception, planning and execution. Existing methods incorporate explicit features such as category, semantics, 6D pose or affordance to enhance consistency, yet single‐feature representations limit generalisation and adaptability across diverse task stages. To overcome these limitations, we propose a shape‐ and function‐grounded keypoint (SFK) representation that provides interpretable, task‐relevant object abstractions. The SFK representation preserves topological consistency, enabling the inference of functional semantics, 6D pose, spatial constraints and task‐oriented grasp configurations. Building upon this, a keypoint‐driven hierarchical framework is developed to unify perception, planning and execution, thereby enabling task‐level action reasoning conditioned on keypoint representations and coherent multistep action execution. For evaluation, a keypoint dataset containing over 1600 RGB images of 29 household objects is constructed, and extensive experiments demonstrate task‐relevant keypoint generation with reduced computational time, as well as higher task execution success rates and broader task coverage.

Förderung

  • National Key Research and Development Program of China

Zitieren

APA

Liu, Y., Liu, Y., Song, X., Han, R., Liu, H., Huang, B., Yao, Y., & Zhong, M. (2026). SFK: Shape‐ and Function‐Grounded Keypoint Representation for Sequential Manipulation. CAAI Transactions on Intelligence Technology, 11(5), 1396-1412. https://doi.org/10.1049/cit2.70136

Vancouver

Liu Y, Liu Y, Song X, Han R, Liu H, Huang B, et al. SFK: Shape‐ and Function‐Grounded Keypoint Representation for Sequential Manipulation. CAAI Transactions on Intelligence Technology. 2026;11(5):1396-1412. doi:10.1049/cit2.70136

BibTeX
@article{Liu2026,
  author = {Liu, Yaxin and Liu, Yan and Song, Xinyu and Han, Ruiqing and Liu, Haiyong and Huang, Bo and Yao, Yufeng and Zhong, Ming},
  title = {SFK: Shape‐ and Function‐Grounded Keypoint Representation for Sequential Manipulation},
  journal = {CAAI Transactions on Intelligence Technology},
  year = {2026},
  volume = {11},
  number = {5},
  pages = {1396--1412},
  doi = {10.1049/cit2.70136}
}
Kostenlos starten →