EUVIMEDOpdag EUVIMED
CrossrefInfokort

Emotion- and Performance-in-the-Loop: Multimodal Difficulty-Adaptive Exergame System—Controlled Between-Participants Study

Liang Zhao, Dan Liu, Hanli Zhang, Guanci Yang, Donghua Zheng, Ling He

JMIR Serious Games · 2026-11-05 · 14 · e101438

DOI: 10.2196/101438 ↗
AbstractBibliografiske oplysninger

Abstract

Background Existing exergames predominantly adjust difficulty based on explicit performance metrics, neglecting the player’s implicit affective state, which often leads to early disengagement due to boredom or frustration. Objective To address this gap, we present a novel exergame system that implements joint emotion- and performance-driven dynamic difficulty adjustment (DDA), using a closed-loop controller that reasons over both motor performance and affective state. Methods The system integrates a computer-vision-based motion evaluation pipeline, a multimodal emotion recognition module that fuses facial action units (AUs), deep facial features, and motion-compensated heart rate variability (HRV) via an adaptive entropy-weighted decision-level fusion strategy, and a closed-loop difficulty controller. A controlled between-participants experiment (N=20) compared the adaptive system against a fixed-difficulty baseline during a 15-minute dance-exergame session. Results Emotion recognition accuracy reached 81.07% (macro-F1: 81.02%) for 7 emotional states. The adaptive group demonstrated significantly lower cognitive load (NASA-TLX [National Aeronautics and Space Administration Task Load Index], P

Viden, der passer til dit arbejde.

Fra en gratis start over personlig litteratursøgning til den komplette Research Suite.

Se priser →

Er alle forlagsfuldtekster inkluderet?

Nej. Bibliografiske referencer, abstracts og fuldtekster er forskellige typer indhold. Om en fuldtekst er tilgængelig, afhænger af kilden, Open Access og dine eksisterende licenser. Et EUVIMED-abonnement erstatter ikke yderligere forlagsrettigheder.

Se priser →