Additive partially linear models for massive heterogeneous data

Binhuan Wang, Yixin Fang, Heng Lian, Hua Liang

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

We consider an additive partially linear framework for modelling massive heterogeneous data. The major goal is to extract multiple common features simultaneously across all sub-populations while exploring heterogeneity of each sub-population. We propose an aggregation type of estimators for the commonality parameters that possess the asymptotic optimal bounds and the asymptotic distributions as if there were no heterogeneity. This oracle result holds when the number of sub-populations does not grow too fast and the tuning parameters are selected carefully. A plug-in estimator for the heterogeneity parameter is further constructed, and shown to possess the asymptotic distribution as if the commonality information were available. Furthermore, we develop a heterogeneity test for the linear components and a homogeneity test for the non-linear components accordingly. The performance of the proposed methods is evaluated via simulation studies and an application to the Medicare Provider Utilization and Payment data.

Original languageEnglish (US)
Pages (from-to)391-431
Number of pages41
JournalElectronic Journal of Statistics
Volume13
Issue number1
DOIs
StatePublished - 2019

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Keywords

  • Divide-and-conquer
  • Heterogeneity
  • Homogeneity
  • Oracle property
  • Regression splines

Fingerprint Dive into the research topics of 'Additive partially linear models for massive heterogeneous data'. Together they form a unique fingerprint.

Cite this