Forecast Evaluation of Small Nested Model Sets / Kirstin Hubrich, Kenneth D. West.

By:

Hubrich, Kirstin

Contributor(s):

Material type: Text

TextSeries: Working Paper Series (National Bureau of Economic Research) ; no. w14601.Publication details: Cambridge, Mass. National Bureau of Economic Research 2008.Description: 1 online resource: illustrations (black and white)Subject(s):

C32 - Time-Series Models • Dynamic Quantile Regressions • Dynamic Treatment Effect Models • Diffusion Processes • State Space Models
C53 - Forecasting and Prediction Methods • Simulation Methods
E37 - Forecasting and Simulation: Models and Applications

Online resources:

Available additional physical forms:

Hardcopy version available to institutional subscribers

Abstract: We propose two new procedures for comparing the mean squared prediction error (MSPE) of a benchmark model to the MSPEs of a small set of alternative models that nest the benchmark. Our procedures compare the benchmark to all the alternative models simultaneously rather than sequentially, and do not require reestimation of models as part of a bootstrap procedure. Both procedures adjust MSPE differences in accordance with Clark and West (2007); one procedure then examines the maximum t-statistic, the other computes a chi-squared statistic. Our simulations examine the proposed procedures and two existing procedures that do not adjust the MSPE differences: a chi-squared statistic, and White's (2000) reality check. In these simulations, the two statistics that adjust MSPE differences have most accurate size, and the procedure that looks at the maximum t-statistic has best power. We illustrate our procedures by comparing forecasts of different models for U.S. inflation.

Tags from this library: No tags from this library for this title. Log in to add tags.

Average rating: 0.0 (0 votes)

Holdings
Item type	Home library	Collection	Call number	Status	Date due	Barcode	Item holds
Working Paper	Biblioteca Digital	Colección NBER	nber w14601 (Browse shelf(Opens below))	Not For Loan

Total holds: 0

Collection: Colección NBER Close shelf browser (Hides shelf browser)

Previous	No cover image available	No cover image available	No cover image available	No cover image available	No cover image available	No cover image available	No cover image available	Next
Previous	nber w14599 The Impact of Family Income on Child Achievement: Evidence from the Earned Income Tax Credit /	nber w1460 An Examination of Aggregate Price Uncertainty in Four Countries and SomeImplications for Real Output /	nber w14600 "Currency Manipulation" and World Trade /	nber w14601 Forecast Evaluation of Small Nested Model Sets /	nber w14602 Conveying Quality and Value in Emerging Industries: Star Scientists and the Role of Learning in Biotechnology /	nber w14603 Endogenous Presidentialism /	nber w14604 Institutions vs. Policies: A Tale of Two Islands /	Next

December 2008.

We propose two new procedures for comparing the mean squared prediction error (MSPE) of a benchmark model to the MSPEs of a small set of alternative models that nest the benchmark. Our procedures compare the benchmark to all the alternative models simultaneously rather than sequentially, and do not require reestimation of models as part of a bootstrap procedure. Both procedures adjust MSPE differences in accordance with Clark and West (2007); one procedure then examines the maximum t-statistic, the other computes a chi-squared statistic. Our simulations examine the proposed procedures and two existing procedures that do not adjust the MSPE differences: a chi-squared statistic, and White's (2000) reality check. In these simulations, the two statistics that adjust MSPE differences have most accurate size, and the procedure that looks at the maximum t-statistic has best power. We illustrate our procedures by comparing forecasts of different models for U.S. inflation.