EUVIMEDEUVIMED entdecken
CrossrefInfokarte

FedHST: Federated Hybrid Spatial–Temporal Optimization for robust non-IID learning

Duy-Dong Le, Thai-Thinh Dang

PLOS One · 2026-11-12 · 21 (11) · e0360546

DOI: 10.1371/journal.pone.0360546 ↗
AbstractBibliografische Angaben

Abstract

Server-side adaptive optimizers in Federated Learning (FL), such as FedAdam and FedAvgM, scale global updates using historical temporal statistics but do not explicitly model instantaneous cross-client variance within a single communication round. Under severe statistical heterogeneity (non-IID data), this can leave the adaptive step size insufficiently damped precisely when local client updates conflict most. We propose FedHST (Federated Hybrid Spatial–Temporal Optimization), a server-side aggregation framework that augments the temporal second-moment estimate with an instantaneous, coordinate-wise cross-client spatial variance term. This term acts as an additional damper under high client disagreement and vanishes under consensus, at which point FedHST reduces to standard temporal-only adaptation. We establish a non-convex convergence rate of 𝒪 ( 1 / T ) , with the residual term showing explicitly how the spatial damping coefficient γ moderates the effect of statistical heterogeneity on convergence. We evaluate FedHST on FashionMNIST, CIFAR-10, and CIFAR-100 under Dirichlet-partitioned non-IID splits ( α ∈ { 0.1 , 0.3 } ), comparing against FedAdam and FedDyn — the strongest representatives of the adaptive server-optimization and dynamic client-regularization paradigms, respectively — over three independent random seeds with paired significance testing; FedAvgM, FedYogi, FedAdagrad, FedProx, and SCAFFOLD are reviewed in Related Work. FedHST attains accuracy statistically indistinguishable from, or modestly and significantly exceeding (up to + 0.5 percentage points, p < 0.05 on FashionMNIST), FedAdam, while substantially and significantly outperforming FedDyn (+ 5 to + 28 percentage points across datasets, p < 0.01), at a computational overhead within 1–4% of FedAdam. Ablation studies further show that FedHST’s advantage over FedAdam grows systematically with the number of local training epochs and with non-IID severity, consistent with the mechanism by which spatial damping is designed to activate under cross-client conflict.

Wissen, das zu Ihrer Arbeit passt.

Vom kostenlosen Einstieg über die persönliche Recherche bis zur vollständigen Research Suite.

Tarife ansehen →

Sind alle Verlagsvolltexte enthalten?

Nein. Bibliografische Nachweise, Abstracts und Volltexte sind unterschiedliche Inhalte. Ob ein Volltext verfügbar ist, hängt von der Quelle, Open Access und Ihren vorhandenen Lizenzen ab. Ein EUVIMED-Tarif ersetzt keine zusätzlichen Verlagsrechte.

Tarife ansehen →