Abstract
A common challenge in nonparametric inference is its high computational complexity when data volume is large. In this paper, we develop computationally efficient nonparametric testing by employing a random projection strategy. In the specific kernel ridge regression setup, a simple distance-based test statistic is proposed. Notably, we derive the minimum number of random projections that is sufficient for achieving testing optimality in terms of the minimax rate. As a byproduct, the lower bound of projection dimension for minimax optimal estimation derived in [40] is proven to be sharp. One technical contribution is to establish upper bounds for a range of tail sums of empirical kernel eigenvalues.
| Original language | English (US) |
|---|---|
| Pages (from-to) | 2175-2209 |
| Number of pages | 35 |
| Journal | Proceedings of Machine Learning Research |
| Volume | 99 |
| State | Published - 2019 |
| Externally published | Yes |
| Event | 32nd Conference on Learning Theory, COLT 2019 - Phoenix, United States Duration: Jun 25 2019 → Jun 28 2019 |
All Science Journal Classification (ASJC) codes
- Artificial Intelligence
- Software
- Control and Systems Engineering
- Statistics and Probability
Keywords
- Computational limit
- kernel ridge regression
- minimax optimality
- nonparametric testing
- random projection