Performance of Empirical Risk Minimization for Linear Regression with Dependent Data
38 Pages Posted: 21 Apr 2021 Last revised: 30 May 2023
Date Written: April 20, 2021
Abstract
This paper establishes bounds on the performance of empirical risk minimization for large-dimensional linear regression. We generalize existing results by allowing the data to be dependent and heavy-tailed. The analysis covers both the cases of identically and heterogeneously distributed observations. Our analysis is nonparametric in the sense that the relationship between the regressand and the regressors is not specified. The main results of this paper show that the empirical risk minimizer achieves the optimal performance (up to a logarithmic factor) in a dependent data setting.
Keywords: empirical risk minimization, linear regression, time series, oracle inequality
JEL Classification: C13, C14, C22, C55
Suggested Citation: Suggested Citation