Nonparametric variable selection and its application to additive models

Zhenghui Feng, Lu Lin, Ruoqing Zhu, Lixing ZHU*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Variable selection for multivariate nonparametric regression models usually involves parameterized approximation for nonparametric functions in the objective function. However, this parameterized approximation often increases the number of parameters significantly, leading to the “curse of dimensionality” and inaccurate estimation. In this paper, we propose a novel and easily implemented approach to do variable selection in nonparametric models without parameterized approximation, enabling selection consistency to be achieved. The proposed method is applied to do variable selection for additive models. A two-stage procedure with selection and adaptive estimation is proposed, and the properties of this method are investigated. This two-stage algorithm is adaptive to the smoothness of the underlying components, and the estimation consistency can reach a parametric rate if the underlying model is really parametric. Simulation studies are conducted to examine the performance of the proposed method. Furthermore, a real data example is analyzed for illustration.

Original languageEnglish
Pages (from-to)827-854
Number of pages28
JournalAnnals of the Institute of Statistical Mathematics
Volume72
Issue number3
DOIs
Publication statusPublished - 1 Jun 2020

Scopus Subject Areas

  • Statistics and Probability

User-Defined Keywords

  • Adaptive estimation
  • Nonparametric additive model
  • Nonparametric regression
  • Variable selection

Fingerprint

Dive into the research topics of 'Nonparametric variable selection and its application to additive models'. Together they form a unique fingerprint.

Cite this