PAC-Bayesian bounds for sparse regression estimation with exponential weights

We consider the sparse regression model where the number of parameters p is larger than the sample size n. The difficulty when considering high-dimensional problems is to propose estimators achieving a good compromise between statistical and computational performances. The Lasso is solution of a convex minimization problem, hence computable for large value of p. However stringent conditions on the design are required to establish fast rates of convergence for this estimator. Dalalyan and Tsybakov proposed an exponential weights procedure achieving a good compromise between the statistical and computational aspects. This estimator can be computed for reasonably large p and satisfies a sparsity oracle inequality in expectation for the empirical excess risk only under mild assumptions on the design. Lien vers l'article

ALQUIER, P. and LOUNICI, K. (2011). PAC-Bayesian bounds for sparse regression estimation with exponential weights. The Electronic Journal of Statistics, 5, pp. 127-145.

Mots clés : #Exponential-weights, #high, #dimensional-regression, #PAC, #Bayesian-inequalities, #Sparsity-oracle-inequality