Cookies on this website
We use cookies to ensure that we give you the best experience on our website. If you click 'Continue' we'll assume that you are happy to receive all cookies and you won't see this message again. Click 'Find out more' for information on how to change your cookie settings.

After developing a prognostic model, it is essential to evaluate the performance of the model in samples independent from those used to develop the model, which is often referred to as external validation. However, despite its importance, very little is known about the sample size requirements for conducting an external validation. Using a large real data set and resampling methods, we investigate the impact of sample size on the performance of six published prognostic models. Focussing on unbiased and precise estimation of performance measures (e.g. the c-index, D statistic and calibration), we provide guidance on sample size for investigators designing an external validation study. Our study suggests that externally validating a prognostic model requires a minimum of 100 events and ideally 200 (or more) events.

Original publication

DOI

10.1002/sim.6787

Type

Journal article

Journal

Stat Med

Publication Date

30/01/2016

Volume

35

Pages

214 - 226

Keywords

external validation, prognostic model, sample size, Biostatistics, Cardiovascular Diseases, Databases, Factual, Diabetes Mellitus, Type 2, Humans, Models, Statistical, Multivariate Analysis, Prognosis, Risk Factors, Sample Size, Validation Studies as Topic