EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Optimization-Driven Cluster-Weighted Clusterwise Linear Regression

Sona Taheri, Adil M. Bagirov, Nelusha Anne Perera, Nargiz Sultanova, Mali Abdollahian

ACM Transactions on Knowledge Discovery from Data · 30.11.2026 · 20 (9) · 1-25

DOI: 10.1145/3850158 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Knowledge Discovery from Data, online erschienen am 05.11.2026. Verfasst von Sona Taheri und 4 weiteren Autor:innen. Die Arbeit nennt 87 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Clusterwise Linear Regression (CLR) integrates clustering and regression to uncover complex relationships within heterogeneous datasets by simultaneously partitioning data and fitting cluster-specific models. This dual capability offers a significant advantage over traditional regression methods, which assume homogeneity across the dataset. However, accurate data approximation often requires many linear functions, which can lead to overfitting. Existing CLR methods are not always efficient for prediction and may fail to partition the explanatory variable space distinctly. To address these limitations, we introduce a novel Cluster-Weighted CLR (CW-CLR) framework based on a nonsmooth, nonconvex optimization formulation that simultaneously solves the clustering and regression tasks. The framework assigns weights to explanatory variables under a sum-to-one constraint and incorporates a scaling parameter to balance clustering and regression errors, yielding a weighted prediction rule that improves robustness, mitigates overfitting, and better exploits cluster structure. To alleviate the challenges posed by nonconvexity, we propose an efficient incremental approach that begins with a single linear model and progressively constructs clusters, aided by a specialized initialization scheme designed to enhance optimization performance. We also propose an improved prediction rule for Optimization-Driven CW-CLR. Numerical experiments on 12 real-world datasets with varying sizes and structures show that CW-CLR achieves competitive or superior predictive performance compared with a broad range of state-of-the-art methods. In particular, CW-CLR attains the best RMSE and MAE on several benchmark datasets and delivers strong goodness-of-fit, with leading \(R^{2}\) and correlation values on multiple datasets. A non-parametric statistical analysis based on the Friedman test and post-hoc analysis confirms that CW-CLR significantly outperforms several competitors and is statistically comparable to the alternatives. Overall, the results demonstrate that CW-CLR provides a robust, accurate, and practically efficient alternative for regression on heterogeneous data.

Zitieren

APA

Taheri, S., Bagirov, A. M., Perera, N. A., Sultanova, N., & Abdollahian, M. (2026). Optimization-Driven Cluster-Weighted Clusterwise Linear Regression. ACM Transactions on Knowledge Discovery from Data, 20(9), 1-25. https://doi.org/10.1145/3850158

Vancouver

Taheri S, Bagirov AM, Perera NA, Sultanova N, Abdollahian M. Optimization-Driven Cluster-Weighted Clusterwise Linear Regression. ACM Transactions on Knowledge Discovery from Data. 2026;20(9):1-25. doi:10.1145/3850158

BibTeX
@article{Taheri2026,
  author = {Taheri, Sona and Bagirov, Adil M. and Perera, Nelusha Anne and Sultanova, Nargiz and Abdollahian, Mali},
  title = {Optimization-Driven Cluster-Weighted Clusterwise Linear Regression},
  journal = {ACM Transactions on Knowledge Discovery from Data},
  year = {2026},
  volume = {20},
  number = {9},
  pages = {1--25},
  doi = {10.1145/3850158}
}
Kostenlos starten →