Academic article

A comparison of methods for testing differences in predictive ability

Cederkvist, Henrik René; Aastveit, Are Halvor; Næs, Tormod

Publication details

Journal: Journal of Chemometrics, 2006

International Standard Numbers:
Printed: 0886-9383
Electronic: 1099-128X

Open Access: none


This paper is devoted to the comparison of methods for testing difference in prediction ability of regression-based predictors. Focus is on both parametric and non-parametric methods. Comparisons are done using the bootstrap based on residuals from real data sets. The power of the methods for different alternatives is the main tool for evaluating the properties of the methods. The main conclusion from the bootstrap simulations is that the most suitable method seems to be two-way analysis of variance of the absolute values of the prediction errors. Copyright (c) 2006 John Wiley & Sons, Ltd.