Artificial Intelligence in Medicine

, volume 138 , pages 102506

Rams, hounds and white boxes: Investigating human–AI collaboration protocols in medical diagnosis

Federico Cabitza ^{1, 2}

Andrea Campagner ²

Luca Ronzio ³

Matteo Cameli ⁴

Giulia E. Mandoli ⁴

Maria Pastore ⁵

Luca Maria Sconfienza ^{2, 6}

Duarte Folgado ⁷

Marília Barandas ⁷

Hugo Gamboa ^{7, 8}

Hide authors affiliations Show authors affiliations: 8 affiliations

Department of Computer Science, Systems and Communication, University of Milano-Bicocca, Milan, Italy |

IRCCS Istituto Ortopedico Galeazzi, MILAN, Italy

Istituti di Ricovero e Cura a Carattere Scientifico

Galeazzi Orthopaedic Institute

IRCCS Istituto San Raffaele, Milan, Italy |

⁴

Department of Medical Biotechnologies, Division of Cardiology, University of Siena, Siena, Italy |

⁵

Azienda Ospedaliera Maggiore Della Carita’ Di Novara, Novara, Italy |

⁶

Department of Biomedical Sciences for Health, Università Degli Studi di Milano, Milan, Italy |

⁷

Associação Fraunhofer Portugal Research, Lisbon, Portugal |

⁸

Laboratório de Instrumentação, Engenharia Biomédica e Física da Radiação (LIBPhys-UNL), Departamento de Física, Faculdade de Ciências e Tecnologia, FCT, Universidade Nova de Lisboa, Lisbon, Portugal |

Publication type: Journal Article

Publication date: 2023-04-01

Elsevier

Artificial Intelligence in Medicine

scimago Q1

wos Q1

SJR: 1.396

CiteScore: 12.2

Impact factor: 6.2

ISSN: 09333657, 18732860

DOI: 10.1016/j.artmed.2023.102506

Copy DOI

PubMed ID: 36990586

Medicine (miscellaneous)

Artificial Intelligence

Abstract

In this paper, we study human-AI collaboration protocols, a design-oriented construct aimed at establishing and evaluating how humans and AI can collaborate in cognitive tasks. We applied this construct in two user studies involving 12 specialist radiologists (the knee MRI study) and 44 ECG readers of varying expertise (the ECG study), who evaluated 240 and 20 cases, respectively, in different collaboration configurations. We confirm the utility of AI support but find that XAI can be associated with a “white-box paradox”, producing a null or detrimental effect. We also find that the order of presentation matters: AI-first protocols are associated with higher diagnostic accuracy than human-first protocols, and with higher accuracy than both humans and AI alone. Our findings identify the best conditions for AI to augment human diagnostic skills, rather than trigger dysfunctional responses and cognitive biases that can undermine decision effectiveness.

Found

1 citation

Chakradeo Kaustubh

4 publications, 103 citations

h-index: 2

University of Copenhagen

1 citation

MATERA MARISTELLA

48 publications, 578 citations, 5 reviews

h-index: 13

Polytechnic University of Milan

Top-30

Journals

Publishers

	5 10 15 20 25 30
Springer Nature	Springer Nature, 30, 41.1% Springer Nature 30 publications, 41.1%
Elsevier	Elsevier, 18, 24.66% Elsevier 18 publications, 24.66%
Association for Computing Machinery (ACM)	Association for Computing Machinery (ACM), 6, 8.22% Association for Computing Machinery (ACM) 6 publications, 8.22%
Taylor & Francis	Taylor & Francis, 5, 6.85% Taylor & Francis 5 publications, 6.85%
Institute of Electrical and Electronics Engineers (IEEE)	Institute of Electrical and Electronics Engineers (IEEE), 3, 4.11% Institute of Electrical and Electronics Engineers (IEEE) 3 publications, 4.11%
MDPI	MDPI, 2, 2.74% MDPI 2 publications, 2.74%
Walter de Gruyter	Walter de Gruyter, 1, 1.37% Walter de Gruyter 1 publication, 1.37%
JMIR Publications	JMIR Publications, 1, 1.37% JMIR Publications 1 publication, 1.37%
Baishideng Publishing Group	Baishideng Publishing Group, 1, 1.37% Baishideng Publishing Group 1 publication, 1.37%
IGI Global	IGI Global, 1, 1.37% IGI Global 1 publication, 1.37%
Association for Research in Vision and Ophthalmology (ARVO)	Association for Research in Vision and Ophthalmology (ARVO), 1, 1.37% Association for Research in Vision and Ophthalmology (ARVO) 1 publication, 1.37%
SAGE	SAGE, 1, 1.37% SAGE 1 publication, 1.37%
Proceedings of the National Academy of Sciences (PNAS)	Proceedings of the National Academy of Sciences (PNAS), 1, 1.37% Proceedings of the National Academy of Sciences (PNAS) 1 publication, 1.37%
Cold Spring Harbor Laboratory	Cold Spring Harbor Laboratory, 1, 1.37% Cold Spring Harbor Laboratory 1 publication, 1.37%
Mark Allen Group	Mark Allen Group, 1, 1.37% Mark Allen Group 1 publication, 1.37%
	5 10 15 20 25 30

We do not take into account publications without a DOI.
Statistics recalculated weekly.

Are you a researcher?

Create a profile to get free access to personal recommendations for colleagues and new articles.

Metrics

Cite this

GOST |

Cite this

GOST Copy

Cabitza F. et al. Rams, hounds and white boxes: Investigating human–AI collaboration protocols in medical diagnosis // Artificial Intelligence in Medicine. 2023. Vol. 138. p. 102506.

GOST all authors (up to 50) Copy

Cabitza F., Campagner A., Ronzio L., Cameli M., Mandoli G. E., Pastore M., Sconfienza L. M., Folgado D., Barandas M., Gamboa H. Rams, hounds and white boxes: Investigating human–AI collaboration protocols in medical diagnosis // Artificial Intelligence in Medicine. 2023. Vol. 138. p. 102506.

RIS |

Cite this

RIS Copy

TY - JOUR

DO - 10.1016/j.artmed.2023.102506

UR - https://doi.org/10.1016/j.artmed.2023.102506

TI - Rams, hounds and white boxes: Investigating human–AI collaboration protocols in medical diagnosis

T2 - Artificial Intelligence in Medicine

AU - Cabitza, Federico

AU - Campagner, Andrea

AU - Ronzio, Luca

AU - Cameli, Matteo

AU - Mandoli, Giulia E.

AU - Pastore, Maria

AU - Sconfienza, Luca Maria

AU - Folgado, Duarte

AU - Barandas, Marília

AU - Gamboa, Hugo

PY - 2023

DA - 2023/04/01

PB - Elsevier

SP - 102506

VL - 138

PMID - 36990586

SN - 0933-3657

SN - 1873-2860

ER -

BibTex

Cite this

BibTex (up to 50 authors) Copy

@article{2023_Cabitza,

author = {Federico Cabitza and Andrea Campagner and Luca Ronzio and Matteo Cameli and Giulia E. Mandoli and Maria Pastore and Luca Maria Sconfienza and Duarte Folgado and Marília Barandas and Hugo Gamboa},

title = {Rams, hounds and white boxes: Investigating human–AI collaboration protocols in medical diagnosis},

journal = {Artificial Intelligence in Medicine},

year = {2023},

volume = {138},

publisher = {Elsevier},

month = {apr},

url = {https://doi.org/10.1016/j.artmed.2023.102506},

pages = {102506},

doi = {10.1016/j.artmed.2023.102506}

}

Publisher

Elsevier

Journal

Artificial Intelligence in Medicine

scimago Q1

wos Q1

SJR

1.396

CiteScore

12.2

Impact factor

6.2

ISSN

09333657 (Print)

18732860 (Electronic)

Profiles

	1 2 3 4 5 6 7
Communications in Computer and Information Science	Communications in Computer and Information Science, 7, 9.59% Communications in Computer and Information Science 7 publications, 9.59%
Lecture Notes in Computer Science	Lecture Notes in Computer Science, 5, 6.85% Lecture Notes in Computer Science 5 publications, 6.85%
npj Digital Medicine	npj Digital Medicine, 5, 6.85% npj Digital Medicine 5 publications, 6.85%
International Journal of Human-Computer Interaction	International Journal of Human-Computer Interaction, 4, 5.48% International Journal of Human-Computer Interaction 4 publications, 5.48%
Artificial Intelligence in Medicine	Artificial Intelligence in Medicine, 3, 4.11% Artificial Intelligence in Medicine 3 publications, 4.11%
International Journal of Human Computer Studies	International Journal of Human Computer Studies, 3, 4.11% International Journal of Human Computer Studies 3 publications, 4.11%
Computer Supported Cooperative Work	Computer Supported Cooperative Work, 2, 2.74% Computer Supported Cooperative Work 2 publications, 2.74%
IEEE Access	IEEE Access, 2, 2.74% IEEE Access 2 publications, 2.74%
International Journal of Medical Informatics	International Journal of Medical Informatics, 2, 2.74% International Journal of Medical Informatics 2 publications, 2.74%
Machine Learning and Knowledge Extraction	Machine Learning and Knowledge Extraction, 1, 1.37% Machine Learning and Knowledge Extraction 1 publication, 1.37%
Clinical Chemistry and Laboratory Medicine	Clinical Chemistry and Laboratory Medicine, 1, 1.37% Clinical Chemistry and Laboratory Medicine 1 publication, 1.37%
Digestive and Liver Disease	Digestive and Liver Disease, 1, 1.37% Digestive and Liver Disease 1 publication, 1.37%
Mayo Clinic Proceedings Digital Health	Mayo Clinic Proceedings Digital Health, 1, 1.37% Mayo Clinic Proceedings Digital Health 1 publication, 1.37%
Journal of Medical Internet Research	Journal of Medical Internet Research, 1, 1.37% Journal of Medical Internet Research 1 publication, 1.37%
Computers in Biology and Medicine	Computers in Biology and Medicine, 1, 1.37% Computers in Biology and Medicine 1 publication, 1.37%
Information Fusion	Information Fusion, 1, 1.37% Information Fusion 1 publication, 1.37%
World Journal of Gastrointestinal Endoscopy	World Journal of Gastrointestinal Endoscopy, 1, 1.37% World Journal of Gastrointestinal Endoscopy 1 publication, 1.37%
Behaviour and Information Technology	Behaviour and Information Technology, 1, 1.37% Behaviour and Information Technology 1 publication, 1.37%
Computer Law and Security Review	Computer Law and Security Review, 1, 1.37% Computer Law and Security Review 1 publication, 1.37%
Handbook of Research on Teaching Methods in Language Translation and Interpretation	Handbook of Research on Teaching Methods in Language Translation and Interpretation, 1, 1.37% Handbook of Research on Teaching Methods in Language Translation and Interpretation 1 publication, 1.37%
Investigative Ophthalmology and Visual Science	Investigative Ophthalmology and Visual Science, 1, 1.37% Investigative Ophthalmology and Visual Science 1 publication, 1.37%
BMC Musculoskeletal Disorders	BMC Musculoskeletal Disorders, 1, 1.37% BMC Musculoskeletal Disorders 1 publication, 1.37%
Patterns	Patterns, 1, 1.37% Patterns 1 publication, 1.37%
BioMedInformatics	BioMedInformatics, 1, 1.37% BioMedInformatics 1 publication, 1.37%
Health Informatics Journal	Health Informatics Journal, 1, 1.37% Health Informatics Journal 1 publication, 1.37%
European Journal of Nuclear Medicine and Molecular Imaging	European Journal of Nuclear Medicine and Molecular Imaging, 1, 1.37% European Journal of Nuclear Medicine and Molecular Imaging 1 publication, 1.37%
Insights into Imaging	Insights into Imaging, 1, 1.37% Insights into Imaging 1 publication, 1.37%
The Future of Responsible Management Education	The Future of Responsible Management Education, 1, 1.37% The Future of Responsible Management Education 1 publication, 1.37%
Gastroenterology	Gastroenterology, 1, 1.37% Gastroenterology 1 publication, 1.37%
	1 2 3 4 5 6 7