Browsing by Author "Sen, Baha"

Now showing 1 - 1 of 1

Unified Lf-Norm Robust Fitting for Linear Models
(Institute of Electrical and Electronics Engineers Inc., 2025) Nar, Fatih; Saran, Murat; Saran, Ayse Nurdan; Sen, Baha
In statistical learning, accurately estimating model parameters is crucial for reliable predictions. Managing residuals, the differences between observed and predicted values, is a key challenge. In regression, the residual penalty choice strongly affects model performance. The L2-norm penalty aligns with the least-squares approach, while the L1-norm provides robust fitting by minimizing the influence of outliers. To generalize models, the weights can be regularized using either the L2-norm or L1-norm, corresponding to Ridge and LASSO regularization, respectively. Many methods have been developed to penalize residuals and model weights, resulting in diverse cost functions optimized by specific numerical solvers. In this study, we propose the smooth Lf-norm, a quasi-norm, as a unified framework for penalizing both residuals and model weights in linear models. Our efficient and robust numerical minimization scheme ensures fast and accurate fitting by minimizing our novel cost function. © 2025 Elsevier B.V., All rights reserved.