L 1-Regularization Path Algorithm for Generalized Linear Models

• Published in: Journal of the Royal Statistical Society. Series B, Statistical methodology Vol. 69; no. 4; pp. 659 - 677
• Main Authors: Park, Mee Young, Hastie, Trevor
• Format: Journal Article
• Language: English
• Published: 01.09.2007
• ISSN: 1369-7412; 1467-9868
• DOI: 10.1111/j.1467-9868.2007.00607.x

We introduce a path following algorithm for L1-regularized generalized linear models. The L1-regularization procedure is useful especially because it, in effect, selects variables according to the amount of penalization on the L1-norm of the coefficients, in a manner that is less greedy than forward selection–backward deletion. The generalized linear model path algorithm efficiently computes solutions along the entire regularization path by using the predictor–corrector method of convex optimization. Selecting the step length of the regularization parameter is critical in controlling the overall accuracy of the paths; we suggest intuitive and flexible strategies for choosing appropriate values. We demonstrate the implementation with several simulated and real data sets.