A Benchmarking Framework for Real-Time 3D Pose Estimation in Motor Rehabilitation: Development and Proof-of-Concept Study
JMIR Rehabilitation and Assistive Technologies · 2026-11-09 · 13 · e91360-e91360
DOI: 10.2196/91360 ↗Abstract
Abstract Background Accurate motor assessment is crucial for diagnosing and monitoring neurological and musculoskeletal disorders. However, traditional manual and semiautomated methods can be subjective, time-consuming, or expensive. Real-time 3D human pose estimation (HPE) is emerging as a low-cost, noninvasive alternative. However, its clinical adoption is limited due to a lack of thorough, standardized evaluation of its accuracy and robustness in real-world clinical settings. Objective This study aims to introduce a technical pipeline for evaluating the applicability of real-time 3D HPE in simulated clinical rehabilitation settings. Methods The framework facilitates the evaluation of an HPE model’s spatial and spatiotemporal accuracy, real-time capability, and robustness against simulated common setup errors and camera position variations, using a marker-based motion capture system as a gold-standard baseline. To address the technical challenge of interdataset comparison, the framework includes a morphing model that harmonizes differing joint definitions. Results Applying the framework to a popular, accessible real-time algorithm (MediaPipe) on 4 healthy participants (N=127,828 frames) showed that simulated underexposure and defocus blur had negligible effects (rank-biserial correlation [RBC] ≤0.02), whereas body segment occlusion (mean-per-joint angular error [MPJAE] increase of 1.5, SD 10 degrees; +24.3%) and insufficient multiocular calibration (MPJAE increase of 7.8, SD 14 degrees; +123.4%, RBC=0.95) significantly degraded tracking accuracy. The framework also showed significant sensitivity to nonfrontal camera placements, both side- and back-facing views (RBC 0.41‐0.49 and bias up to 2.2 degrees/37.1%), relative to stable frontal placements (RBC ≤0.03). The skeleton morphing module reduced Procrustes-aligned mean per joint position error (PA-MPJPE) by 55.29 mm (N=79,423 frames, 57.2% reduction) and its SD by 24.69 mm (N=79,423 frames, 50.7%). Conclusions This study establishes a technical foundation for the standardized evaluation of markerless tracking for clinical applications, like motor rehabilitation. The morphing model enables interdataset comparison, and the proposed framework facilitates domain-specific interpretation of HPE performance. While further validation on pathological populations is required, this work provides the necessary engineering foundation for future validation studies.
EUVIMED