BMJ, pages m441
Calculating the sample size required for developing a clinical prediction model
Richard D. Riley
1
,
Joie Ensor
1
,
Kym I. E. Snell
1
,
Frank E. Harrell
2
,
Glen E. Martin
3
,
Johannes B. Reitsma
4
,
Karel G. M. Moons
4
,
Gary S. Collins
5
,
Maarten van Smeden
4, 5, 6
Publication type: Journal Article
Publication date: 2020-03-18
DOI:
10.1136/bmj.m441
General Engineering
Abstract
Clinical prediction models aim to predict outcomes in individuals, to inform diagnosis or prognosis in healthcare. Hundreds of prediction models are published in the medical literature each year, yet many are developed using a dataset that is too small for the total number of participants or outcome events. This leads to inaccurate predictions and consequently incorrect healthcare decisions for some individuals. In this article, the authors provide guidance on how to calculate the sample size required to develop a clinical prediction model.
Top-30
Citations by journals
10
20
30
40
50
60
|
|
BMJ Open
51 publications, 5.17%
|
|
Scientific Reports
24 publications, 2.43%
|
|
PLoS ONE
15 publications, 1.52%
|
|
BMJ
15 publications, 1.52%
|
|
Frontiers in Medicine
15 publications, 1.52%
|
|
Journal of Clinical Medicine
13 publications, 1.32%
|
|
Journal of Clinical Epidemiology
12 publications, 1.22%
|
|
Cancers
11 publications, 1.12%
|
|
BMC Medical Research Methodology
10 publications, 1.01%
|
|
British Journal of Anaesthesia
10 publications, 1.01%
|
|
Statistics in Medicine
10 publications, 1.01%
|
|
Frontiers in Endocrinology
8 publications, 0.81%
|
|
Hepatology
8 publications, 0.81%
|
|
Heliyon
8 publications, 0.81%
|
|
Diagnostic and Prognostic Research
7 publications, 0.71%
|
|
Frontiers in Neurology
7 publications, 0.71%
|
|
Journal of the American Heart Association
7 publications, 0.71%
|
|
Frontiers in Oncology
6 publications, 0.61%
|
|
Frontiers in Cardiovascular Medicine
6 publications, 0.61%
|
|
BMC Medical Informatics and Decision Making
6 publications, 0.61%
|
|
European Respiratory Journal
5 publications, 0.51%
|
|
JAMA network open
5 publications, 0.51%
|
|
Frontiers in Immunology
5 publications, 0.51%
|
|
Canadian Journal of Anaesthesia
5 publications, 0.51%
|
|
BMC Medicine
5 publications, 0.51%
|
|
Frontiers in Public Health
5 publications, 0.51%
|
|
Journal of Hepatology
5 publications, 0.51%
|
|
Journal of Vascular Surgery
5 publications, 0.51%
|
|
European Heart Journal
5 publications, 0.51%
|
|
10
20
30
40
50
60
|
Citations by publishers
20
40
60
80
100
120
140
160
180
200
|
|
Springer Nature
194 publications, 19.68%
|
|
Elsevier
175 publications, 17.75%
|
|
Wiley
102 publications, 10.34%
|
|
BMJ
82 publications, 8.32%
|
|
Frontiers Media S.A.
80 publications, 8.11%
|
|
Multidisciplinary Digital Publishing Institute (MDPI)
46 publications, 4.67%
|
|
Wolters Kluwer Health
43 publications, 4.36%
|
|
Cold Spring Harbor Laboratory
42 publications, 4.26%
|
|
Oxford University Press
28 publications, 2.84%
|
|
Public Library of Science (PLoS)
20 publications, 2.03%
|
|
SAGE
17 publications, 1.72%
|
|
Taylor & Francis
13 publications, 1.32%
|
|
Research Square Platform LLC
12 publications, 1.22%
|
|
Dove Medical Press
10 publications, 1.01%
|
|
JMIR Publications
9 publications, 0.91%
|
|
American Medical Association (AMA)
8 publications, 0.81%
|
|
AME Publishing Company
8 publications, 0.81%
|
|
European Respiratory Society (ERS)
6 publications, 0.61%
|
|
IEEE
4 publications, 0.41%
|
|
Cambridge University Press
4 publications, 0.41%
|
|
American Thoracic Society
3 publications, 0.3%
|
|
The Endocrine Society
3 publications, 0.3%
|
|
American Society of Clinical Oncology (ASCO)
3 publications, 0.3%
|
|
Medknow Publications
3 publications, 0.3%
|
|
American Society of Nephrology
2 publications, 0.2%
|
|
Sports Physical Therapy Section
2 publications, 0.2%
|
|
Hindawi Limited
2 publications, 0.2%
|
|
S. Karger AG
2 publications, 0.2%
|
|
British Editorial Society of Bone and Joint Surgery
2 publications, 0.2%
|
|
20
40
60
80
100
120
140
160
180
200
|
- We do not take into account publications without a DOI.
- Statistics recalculated only for publications connected to researchers, organizations and labs registered on the platform.
- Statistics recalculated weekly.
{"yearsCitations":{"type":"bar","data":{"show":true,"labels":[2020,2021,2022,2023,2024],"ids":[0,0,0,0,0],"codes":[0,0,0,0,0],"imageUrls":["","","","",""],"datasets":[{"label":"Citations number","data":[40,133,200,326,287],"backgroundColor":["#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6"],"percentage":["4.06","13.49","20.28","33.06","29.11"],"barThickness":null}]},"options":{"indexAxis":"x","maintainAspectRatio":true,"scales":{"y":{"ticks":{"precision":0,"autoSkip":false,"font":{"family":"Montserrat"},"color":"#000000"},"stacked":false},"x":{"ticks":{"stepSize":1,"precision":0,"font":{"family":"Montserrat"},"color":"#000000"},"stacked":false}},"plugins":{"legend":{"position":"top","labels":{"font":{"family":"Montserrat"},"color":"#000000"}},"title":{"display":true,"text":"Citations per year","font":{"size":24,"family":"Montserrat","weight":600},"color":"#000000"}}}},"journals":{"type":"bar","data":{"show":true,"labels":["BMJ Open","Scientific Reports","PLoS ONE","BMJ","Frontiers in Medicine","Journal of Clinical Medicine","Journal of Clinical Epidemiology","Cancers","BMC Medical Research Methodology","British Journal of Anaesthesia","Statistics in Medicine","Frontiers in Endocrinology","Hepatology","Heliyon","Diagnostic and Prognostic Research","Frontiers in Neurology","Journal of the American Heart Association","Frontiers in Oncology","Frontiers in Cardiovascular Medicine","BMC Medical Informatics and Decision Making","European Respiratory Journal","JAMA network open","Frontiers in Immunology","Canadian Journal of Anaesthesia","BMC Medicine","Frontiers in Public Health","Journal of Hepatology","Journal of Vascular Surgery","European Heart Journal"],"ids":[5113,13767,24963,25648,17043,26234,14960,22471,24347,12055,16286,19896,6346,21848,28968,1698,4124,10990,11659,533,24322,14458,1699,18538,20111,12126,1532,19956,7338],"codes":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"imageUrls":["\/storage\/images\/resized\/hysFKdIDQMKHPbF1uLxJ3M6dQA4gPVuC6ZeA7m5a_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/PRGhlgB4OKRltSNtT39eA6wlnOTGRap1QQ6FQHih_medium.webp","\/storage\/images\/resized\/hysFKdIDQMKHPbF1uLxJ3M6dQA4gPVuC6ZeA7m5a_medium.webp","\/storage\/images\/resized\/4QWA67eqfcfyOiA8Wk7YnqroHFqQbTsmDJUYTCTg_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/bRyGpdm98BkAUYiK1YFNpl5Z7hPu6Gd87gbIeuG3_medium.webp","\/storage\/images\/resized\/4QWA67eqfcfyOiA8Wk7YnqroHFqQbTsmDJUYTCTg_medium.webp","\/storage\/images\/resized\/bRyGpdm98BkAUYiK1YFNpl5Z7hPu6Gd87gbIeuG3_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/4QWA67eqfcfyOiA8Wk7YnqroHFqQbTsmDJUYTCTg_medium.webp","\/storage\/images\/resized\/bRyGpdm98BkAUYiK1YFNpl5Z7hPu6Gd87gbIeuG3_medium.webp","\/storage\/images\/resized\/4QWA67eqfcfyOiA8Wk7YnqroHFqQbTsmDJUYTCTg_medium.webp","\/storage\/images\/resized\/4QWA67eqfcfyOiA8Wk7YnqroHFqQbTsmDJUYTCTg_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/hMjtEcPnOlZu0Qdup5ZFVJML9APp6JeBF0xfZC5e_medium.webp","\/storage\/images\/resized\/brnEFyEeTGw9nlsHnEHbyCV6AqrisRCX7QF1dLtY_medium.webp","\/storage\/images\/resized\/4QWA67eqfcfyOiA8Wk7YnqroHFqQbTsmDJUYTCTg_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/4QWA67eqfcfyOiA8Wk7YnqroHFqQbTsmDJUYTCTg_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/yNSijlgQghQF53VZuyFLA30CKDe4j3HK74Vtpnxa_medium.webp"],"datasets":[{"label":"","data":[51,24,15,15,15,13,12,11,10,10,10,8,8,8,7,7,7,6,6,6,5,5,5,5,5,5,5,5,5],"backgroundColor":["#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6"],"percentage":[5.17,2.43,1.52,1.52,1.52,1.32,1.22,1.12,1.01,1.01,1.01,0.81,0.81,0.81,0.71,0.71,0.71,0.61,0.61,0.61,0.51,0.51,0.51,0.51,0.51,0.51,0.51,0.51,0.51],"barThickness":13}]},"options":{"indexAxis":"y","maintainAspectRatio":false,"scales":{"y":{"ticks":{"precision":0,"autoSkip":false,"font":{"family":"Montserrat"},"color":"#000000"},"stacked":false},"x":{"ticks":{"stepSize":null,"precision":0,"font":{"family":"Montserrat"},"color":"#000000"},"stacked":false}},"plugins":{"legend":{"position":"top","labels":{"font":{"family":"Montserrat"},"color":"#000000"}},"title":{"display":true,"text":"Journals","font":{"size":24,"family":"Montserrat","weight":600},"color":"#000000"}}}},"publishers":{"type":"bar","data":{"show":true,"labels":["Springer Nature","Elsevier","Wiley","BMJ","Frontiers Media S.A.","Multidisciplinary Digital Publishing Institute (MDPI)","Wolters Kluwer Health","Cold Spring Harbor Laboratory","Oxford University Press","Public Library of Science (PLoS)","SAGE","Taylor & Francis","Research Square Platform LLC","Dove Medical Press","JMIR Publications","American Medical Association (AMA)","AME Publishing Company","European Respiratory Society (ERS)","IEEE","Cambridge University Press","American Thoracic Society","The Endocrine Society","American Society of Clinical Oncology (ASCO)","Medknow Publications","American Society of Nephrology","Sports Physical Therapy Section","Hindawi Limited","S. Karger AG","British Editorial Society of Bone and Joint Surgery"],"ids":[8,17,11,6954,208,202,32,6909,19,344,31,18,9418,417,7126,2676,1566,3289,6953,1,3246,2489,73,6894,974,5493,6921,6998,1169],"codes":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"imageUrls":["\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/bRyGpdm98BkAUYiK1YFNpl5Z7hPu6Gd87gbIeuG3_medium.webp","\/storage\/images\/resized\/hysFKdIDQMKHPbF1uLxJ3M6dQA4gPVuC6ZeA7m5a_medium.webp","\/storage\/images\/resized\/4QWA67eqfcfyOiA8Wk7YnqroHFqQbTsmDJUYTCTg_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/6QE8LXWrLpkoy5A2te6hw7who46GeCoTYIstuoAz_medium.webp","\/storage\/images\/resized\/hg4jJjT8wVGtHstBCc0zk465Mg9pLx3G4odCDOqE_medium.webp","\/storage\/images\/resized\/yNSijlgQghQF53VZuyFLA30CKDe4j3HK74Vtpnxa_medium.webp","\/storage\/images\/resized\/PRGhlgB4OKRltSNtT39eA6wlnOTGRap1QQ6FQHih_medium.webp","\/storage\/images\/resized\/ruydfaB80LDjlkYqsfOeUAZohOIODyq7bQzis5O7_medium.webp","\/storage\/images\/resized\/5YZtvLvkPZuc2JHOaZsjCvGSHFCuC3drUwN3YAc5_medium.webp","","\/storage\/images\/resized\/wVWp6zaxUsMdR03dYMdOZoesUrVGtNMWkHKByIvT_medium.webp","\/storage\/images\/resized\/cRMehae9HOl9IXrL0Y5aSxEgqjYPaMefZzmyZtW8_medium.webp","\/storage\/images\/resized\/brnEFyEeTGw9nlsHnEHbyCV6AqrisRCX7QF1dLtY_medium.webp","\/storage\/images\/resized\/PYBAYQjpFdxPQPRGY3kU5Xzbu0W7K7umVNk0TY9i_medium.webp","\/storage\/images\/resized\/hMjtEcPnOlZu0Qdup5ZFVJML9APp6JeBF0xfZC5e_medium.webp","\/storage\/images\/resized\/6scCJegesojp2jubwY3uKCzTAmgsaH2GIFlg6Hfk_medium.webp","\/storage\/images\/resized\/cF81zWlLdkmYekymGuDcSdvgBGNKaIDoMoeJtHS1_medium.webp","\/storage\/images\/resized\/y6coX2RdMAMXy0PTXCMVDlJvumyjAcjbT7WXoxjx_medium.webp","\/storage\/images\/resized\/ykVNlEVbd1r3y7sMfZorOnDlpU1cRYn1ESbDmhRe_medium.webp","\/storage\/images\/resized\/0WrbuCPHoMon4eqSaqLoeO1owjv6jeDiHASSYzbS_medium.webp","","\/storage\/images\/resized\/orS0jeKEmNluvTOmiw9eau2cDuw0NkXVV399uzuY_medium.webp","","\/storage\/images\/resized\/hqfzhQAjTGlNSRs6yzFNITgjSMm9Jr2QuotJHIvE_medium.webp","\/storage\/images\/resized\/dzjTgJDYMoGfxybjlxLdd3z4gHYG42WZR0UxSYzy_medium.webp",""],"datasets":[{"label":"","data":[194,175,102,82,80,46,43,42,28,20,17,13,12,10,9,8,8,6,4,4,3,3,3,3,2,2,2,2,2],"backgroundColor":["#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6"],"percentage":[19.68,17.75,10.34,8.32,8.11,4.67,4.36,4.26,2.84,2.03,1.72,1.32,1.22,1.01,0.91,0.81,0.81,0.61,0.41,0.41,0.3,0.3,0.3,0.3,0.2,0.2,0.2,0.2,0.2],"barThickness":13}]},"options":{"indexAxis":"y","maintainAspectRatio":false,"scales":{"y":{"ticks":{"precision":0,"autoSkip":false,"font":{"family":"Montserrat"},"color":"#000000"},"stacked":false},"x":{"ticks":{"stepSize":null,"precision":0,"font":{"family":"Montserrat"},"color":"#000000"},"stacked":false}},"plugins":{"legend":{"position":"top","labels":{"font":{"family":"Montserrat"},"color":"#000000"}},"title":{"display":true,"text":"Publishers","font":{"size":24,"family":"Montserrat","weight":600},"color":"#000000"}}}},"yearsCitationsQuartiles":{"type":"bar","data":{"show":true,"labels":[2020,2021,2022,2023,2024],"ids":[],"codes":[],"imageUrls":[],"datasets":[{"label":"Q4","backgroundColor":"rgb(221,90,78)","data":[1,0,1,1,1],"percentage":["0.1","0","0.1","0.1","0.1"]},{"label":"Q3","backgroundColor":"rgb(251, 163,83)","data":[0,0,1,9,8],"percentage":["0","0","0.1","0.91","0.81"]},{"label":"Q2","backgroundColor":"rgb(232, 213, 89)","data":[3,17,35,35,41],"percentage":["0.3","1.72","3.55","3.55","4.16"]},{"label":"Q1","backgroundColor":"rgb(164, 207, 99)","data":[30,94,134,235,206],"percentage":["3.04","9.53","13.59","23.83","20.89"]},{"label":"Quartile not defined","backgroundColor":"#E5E7EB","data":[6,22,29,46,31],"percentage":["0.61","2.23","2.94","4.67","3.14"]}]},"options":{"indexAxis":"x","maintainAspectRatio":true,"scales":{"y":{"ticks":{"precision":0,"autoSkip":false,"font":{"family":"Montserrat"},"color":"#000000"},"stacked":true},"x":{"ticks":{"stepSize":1,"precision":0,"font":{"family":"Montserrat"},"color":"#000000"},"stacked":true}},"plugins":{"legend":{"position":"top","labels":{"font":{"family":"Montserrat"},"color":"#000000"}},"title":{"display":true,"text":"Citations quartiles by SCImago per year","font":{"size":24,"family":"Montserrat","weight":600},"color":"#000000"}}}},"yearsCitationsQuartilesWs":{"type":"bar","data":{"show":true,"labels":[2020,2021,2022,2023,2024],"ids":[],"codes":[],"imageUrls":[],"datasets":[{"label":"Q4","backgroundColor":"rgb(221,90,78)","data":[0,1,6,4,9],"percentage":["0","0.1","0.61","0.41","0.91"]},{"label":"Q3","backgroundColor":"rgb(251, 163,83)","data":[3,11,19,28,19],"percentage":["0.3","1.12","1.93","2.84","1.93"]},{"label":"Q2","backgroundColor":"rgb(232, 213, 89)","data":[8,36,66,106,101],"percentage":["0.81","3.65","6.69","10.75","10.24"]},{"label":"Q1","backgroundColor":"rgb(164, 207, 99)","data":[20,57,66,132,117],"percentage":["2.03","5.78","6.69","13.39","11.87"]},{"label":"Quartile not defined","backgroundColor":"#E5E7EB","data":[9,28,43,56,41],"percentage":["0.91","2.84","4.36","5.68","4.16"]}]},"options":{"indexAxis":"x","maintainAspectRatio":true,"scales":{"y":{"ticks":{"precision":0,"autoSkip":false,"font":{"family":"Montserrat"},"color":"#000000"},"stacked":true},"x":{"ticks":{"stepSize":1,"precision":0,"font":{"family":"Montserrat"},"color":"#000000"},"stacked":true}},"plugins":{"legend":{"position":"top","labels":{"font":{"family":"Montserrat"},"color":"#000000"}},"title":{"display":true,"text":"Citations quartiles by WoS per year","font":{"size":24,"family":"Montserrat","weight":600},"color":"#000000"}}}}}
Are you a researcher?
Create a profile to get free access to personal recommendations for colleagues and new articles.
Metrics
Cite this
GOST |
RIS |
BibTex
Cite this
GOST
Copy
Riley R. D. et al. Calculating the sample size required for developing a clinical prediction model // BMJ. 2020. p. m441.
GOST all authors (up to 50)
Copy
Riley R. D., Ensor J., Snell K. I. E., Harrell F. E., Martin G. E., Reitsma J. B., Moons K. G., Collins G. S., van Smeden M. Calculating the sample size required for developing a clinical prediction model // BMJ. 2020. p. m441.
Cite this
RIS
Copy
TY - JOUR
DO - 10.1136/bmj.m441
UR - https://doi.org/10.1136/bmj.m441
TI - Calculating the sample size required for developing a clinical prediction model
T2 - BMJ
AU - Riley, Richard D.
AU - Ensor, Joie
AU - Snell, Kym I. E.
AU - Harrell, Frank E.
AU - Martin, Glen E.
AU - Reitsma, Johannes B.
AU - Moons, Karel G. M.
AU - Collins, Gary S.
AU - van Smeden, Maarten
PY - 2020
DA - 2020/03/18 00:00:00
PB - BMJ
SP - m441
SN - 0959-8146
SN - 1756-1833
SN - 0959-8138
SN - 1468-5833
SN - 0007-1447
ER -
Cite this
BibTex
Copy
@article{2020_Riley,
author = {Richard D. Riley and Joie Ensor and Kym I. E. Snell and Frank E. Harrell and Glen E. Martin and Johannes B. Reitsma and Karel G. M. Moons and Gary S. Collins and Maarten van Smeden},
title = {Calculating the sample size required for developing a clinical prediction model},
journal = {BMJ},
year = {2020},
publisher = {BMJ},
month = {mar},
url = {https://doi.org/10.1136/bmj.m441},
pages = {m441},
doi = {10.1136/bmj.m441}
}