A course designed for those who deal with large, complex data sets.
High-dimensional data set are abundant nowadays and this course covers estimation of models with many explanatory variables (potentially more than the sample size). The focus is mainly on the linear model to keep the exposition simple. Here, OLS is problematic in the presence of many explanatory variables. We shall see that if one is willing to impose that the model is sparse (that is only a small subset of the large set of potential explanatory variables is actually relevant) then it is possible to estimate the parameters almost as precisely as if one had implemented OLS only including the relevant variables. Such upper bounds on the estimation error are called oracle inequalities as an estimator possessing it is almost as precise as if an oracle had revealed the true model prior to estimation.
We shall prove that one popular estimator possessing the oracle property is the Lasso (Least Absolute Shrinkage and Selection Operator). We also discuss variable selection and screening via the Lasso. As the Lasso shrinks parameters towards zero, it introduces a shrinkage bias. Thus, one may contemplate running OLS after model selection by the Lasso. We will discuss the properties of such a post-Lasso procedure.
The performance of shrinkage estimators depends crucially on the right choice of a penalty parameter. Thus, it is crucial to have a disciplined way of choosing the penalty parameter with ensuing performance guarantees. We will discuss one such procedure and the ensuing oracle inequalities.
We aim to provide detailed proofs of (most of) the results presented.
The practical sessions will focus on illustrating the theoretical results in R.
Both theory and practical sessions are expected to be interactive.
At the end of the course, you will:
The course will explore the following topics:
*If time allows
All BSE Summer courses are taught to the same high standard as our Master’s programs. Join us to:
Network with like-minded peers
Study in vibrant Barcelona
Learn from world-renowned faculty
All BSE Summer School applicants must ensure that they meet the basic entry requirements.
Summer School applicants normally demonstrate one or more of the following:
Requirements for Estimation in High-Dimensional Linear Models
Here is your schedule for this edition of BSE Microeconometrics Summer School, Estimation in High-Dimensional Models course.
To be eligible for credit transfer, students must complete a final project. Students will deliver a short final project one week after the summer school finishes.
It will consist of completing an assignment that will include the practical and empirical issues worked on in class.
Consult the Summer School Admissions page for more information about this option.
Participants who attend more than 80% of the course will receive a Certificate of Attendance, free of charge.
Multiple course discounts are available, see more information about available discounts. Fees for courses in other Summer School programs may vary.
* Reduced Fee applies for PhD or Master’s students, Alumni of BSE Master’s programs, and participants who are unemployed.
Here are some commonly asked questions by participants. Any further queries, please contact our Admissions Team.
Unfortunately, accommodation is not included in the course fee. Participants are responsible for finding accommodation.
Sessions will NOT be recorded; however, the materials provided by the professor will be available for a month after the course has finished.
Fees for each course may vary. Please consult each course page for accurate information.
Yes, BSE offers a variety of discounts on its Summer School courses. See more information about available discounts or request a personalized discount quote by email.
Yes! you can combine any of the Summer School courses (schedule permitting). See the full course calendar.
Yes, a social dinner is held once a week for all participants, it is free to attend.