Interaction screening by partial correlation

Research output: Contribution to journalArticle

2 Scopus citations

Abstract

Interaction effects between predictors can play an important role in improving prediction and model interpretation for regression models. However, it is both statistically and computationally challenging to discover informative interactions for high dimensional data. Variable screening based on marginal information is popular for identifying important predictors, but it is mainly used for main-effect-only models. In this paper, we study interaction screening for high dimensional quadratic regression models. First, we show that the direct generalization of main-effect screening to interaction screening can be incorrect or inefficient, as it overlooks the intrinsic relationship between main effects and interactions. Next, we propose a main-effect-adjusted interaction screening procedure to select interactions while taking into account main effects. This new unified framework can be employed with multiple types of correlation measures, such as Pearson correlation coefficients, nonparametric rank-based measures including Spearman's and Kendall's correlation coefficients. Efficient algorithms are developed for each correlation measure to make the screening procedure scalable to high dimensional data. Finally, we illustrate performance of the new screening procedure by simulation studies and an application to a retinopathy study.

Original languageEnglish (US)
Pages (from-to)317-325
Number of pages9
JournalStatistics and its Interface
Volume11
Issue number2
DOIs
StatePublished - Jan 1 2018

Keywords

  • High dimensional data
  • Interaction effects
  • Marginal statistic
  • Quadratic regression
  • Rank correlation
  • Variable screening

ASJC Scopus subject areas

  • Statistics and Probability
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Interaction screening by partial correlation'. Together they form a unique fingerprint.

  • Cite this