Feature Selection for High-Dimensional Varying Coefficient Models via Ordinary Least Squares Projection

Wang, Haofeng1,2; Jin, Hongxia2; Jiang, Xuejun2

2023-03-01

10.1007/s40304-022-00326-2

COMMUNICATIONS IN MATHEMATICS AND STATISTICS   Impact Factor & Quartile

2194-6701

2194-671X

Feature selection is a changing issue for varying coefficient models when the dimensionality of covariates is ultrahigh. The traditional technology of significantly reducing dimensionality is the marginal correlation screening method based on nonparametric smoothing. However, marginal correlation screening methods may be screen out variables that are jointly correlated to the response. To address this, we propose a novel screener with the name of group screening via nonparametric smoothing high-dimensional ordinary least squares projection, referred to as "Group HOLP" and study its sure screening property. Based on this nice property, we introduce a refined feature selection procedure via employing the extended Bayesian information criteria (EBIC) to select the suitable submodels in varying coefficient models, which is coined as Group HOLP-EBIC method. Under some regularity conditions, we establish the strong consistency of feature selection for the proposed method. The performance of our method is evaluated by simulations and further illustrated by two real examples.

Varying coefficient models Feature screening Nonparametric smoothing Extended Bayesian information criteria High-dimensional ordinary least squares projection

SCI

English

Corresponding

National Natural Science Foundation of China[11871263] ; Shenzhen Sci-Tech Fund[JCYJ20210324104803010]

Mathematics

Mathematics

WOS:000960771600001

SPRINGER HEIDELBERG

Web of Science

1.Harbin Inst Technol, Dept Math, Harbin, Peoples R China
2.Southern Univ Sci & Technol, Dept Stat & Data Sci, Shenzhen, Peoples R China

Wang, Haofeng,Jin, Hongxia,Jiang, Xuejun. Feature Selection for High-Dimensional Varying Coefficient Models via Ordinary Least Squares Projection[J]. COMMUNICATIONS IN MATHEMATICS AND STATISTICS,2023.

Wang, Haofeng,Jin, Hongxia,&Jiang, Xuejun.(2023).Feature Selection for High-Dimensional Varying Coefficient Models via Ordinary Least Squares Projection.COMMUNICATIONS IN MATHEMATICS AND STATISTICS.

Wang, Haofeng,et al."Feature Selection for High-Dimensional Varying Coefficient Models via Ordinary Least Squares Projection".COMMUNICATIONS IN MATHEMATICS AND STATISTICS (2023).