Loading...
Please wait, while we are loading the content...
Variance estimation using refitted cross-validation in ultrahigh dimensional regression.
| Content Provider | Semantic Scholar |
|---|---|
| Author | Fan, Jianqing Guo, Shaojun Hao, Ning |
| Copyright Year | 2012 |
| Abstract | Variance estimation is a fundamental problem in statistical modelling. In ultrahigh dimensional linear regression where the dimensionality is much larger than the sample size, traditional variance estimation techniques are not applicable. Recent advances in variable selection in ultrahigh dimensional linear regression make this problem accessible. One of the major problems in ultrahigh dimensional regression is the high spurious correlation between the unobserved realized noise and some of the predictors. As a result, the realized noises are actually predicted when extra irrelevant variables are selected, leading to serious underestimate of the level of noise. We propose a two-stage refitted procedure via a data splitting technique, called refitted cross-validation, to attenuate the influence of irrelevant variables with high spurious correlations. Our asymptotic results show that the resulting procedure performs as well as the oracle estimator, which knows in advance the mean regression function. The simulation studies lend further support to our theoretical claims. The naive two-stage estimator and the plug-in one-stage estimators using the lasso and smoothly clipped absolute deviation are also studied and compared. Their performances can be improved by the reffitted cross-validation method proposed. |
| Starting Page | 37 |
| Ending Page | 65 |
| Page Count | 29 |
| File Format | PDF HTM / HTML |
| DOI | 10.1111/j.1467-9868.2011.01005.x |
| PubMed reference number | 22312234 |
| Journal | Medline |
| Volume Number | 74 |
| Issue Number | 1 |
| Alternate Webpage(s) | http://orfe.princeton.edu/~jqfan/papers/12/RCV-JRSSB.pdf |
| Alternate Webpage(s) | https://arxiv.org/pdf/1004.5178v2.pdf |
| Alternate Webpage(s) | http://math.arizona.edu/~nhao/publication/FGH2012JRSSB.pdf |
| Journal | Journal of the Royal Statistical Society. Series B, Statistical methodology |
| Language | English |
| Access Restriction | Open |
| Content Type | Text |
| Resource Type | Article |
