Confounding factors need to be accounted for in assessing bias by machine learning algorithms

Saved in:
Bibliographic Details
Published inNature medicine Vol. 28; no. 6; pp. 1159 - 1160
Main Authors Mukherjee, Pritam, Shen, Thomas C., Liu, Jianfei, Mathai, Tejas, Shafaat, Omid, Summers, Ronald M.
Format Journal Article
LanguageEnglish
Published New York Nature Publishing Group US 01.06.2022
Nature Publishing Group
Subjects
Online AccessGet full text
ISSN1078-8956
1546-170X
1546-170X
DOI10.1038/s41591-022-01847-7

Cover

Author Mathai, Tejas
Shen, Thomas C.
Liu, Jianfei
Summers, Ronald M.
Mukherjee, Pritam
Shafaat, Omid
Author_xml – sequence: 1
  givenname: Pritam
  orcidid: 0000-0002-9975-9994
  surname: Mukherjee
  fullname: Mukherjee, Pritam
  email: pritam.mukherjee@nih.gov
  organization: Imaging Biomarkers and Computer-Aided Diagnosis Laboratory, Department of Radiology and Imaging Sciences, National Institutes of Health Clinical Center
– sequence: 2
  givenname: Thomas C.
  surname: Shen
  fullname: Shen, Thomas C.
  organization: Imaging Biomarkers and Computer-Aided Diagnosis Laboratory, Department of Radiology and Imaging Sciences, National Institutes of Health Clinical Center
– sequence: 3
  givenname: Jianfei
  surname: Liu
  fullname: Liu, Jianfei
  organization: Imaging Biomarkers and Computer-Aided Diagnosis Laboratory, Department of Radiology and Imaging Sciences, National Institutes of Health Clinical Center
– sequence: 4
  givenname: Tejas
  surname: Mathai
  fullname: Mathai, Tejas
  organization: Imaging Biomarkers and Computer-Aided Diagnosis Laboratory, Department of Radiology and Imaging Sciences, National Institutes of Health Clinical Center
– sequence: 5
  givenname: Omid
  surname: Shafaat
  fullname: Shafaat, Omid
  organization: Imaging Biomarkers and Computer-Aided Diagnosis Laboratory, Department of Radiology and Imaging Sciences, National Institutes of Health Clinical Center
– sequence: 6
  givenname: Ronald M.
  surname: Summers
  fullname: Summers, Ronald M.
  organization: Imaging Biomarkers and Computer-Aided Diagnosis Laboratory, Department of Radiology and Imaging Sciences, National Institutes of Health Clinical Center
BookMark eNp9kD1rHDEQhkWwIf76A64EadJsPNqVVtoyHHFiMLhxII0RWt3oLLMnORpd4X9vnS8QcOFqNJrnGYb3lB2lnJCxSwHfBAzmiqRQk-ig7zsQRupOf2InQsmxExr-HLU3aNOZSY2f2SnREwAMoKYT9rDKKeRdWse04cH5mgvxhLjmNfMZufO-TWvrQy48Ju6IkGhPz9ERn1_41vnHmJAv6EraD9yyySXWxy2ds-PgFsKLf_WM_b7-cb_61d3e_bxZfb_t_KD62hk1QEBjjAIxzkLOUgc_eI8SxazXEGT7RAjjNHqlDCD4eY3O4CwGlMoNZ-zrYe9zyX93SNVuI3lcFpcw78j2ozayb6Zp6Jd36FPeldSu21N6UlL0olHmQPmSiQoG62N1NeZUi4uLFWD3udtD7rblbt9yt7qp_Tv1ucStKy8fS8NBoganDZb_V31gvQLXx5gU
CitedBy_id crossref_primary_10_1038_s41467_024_52003_3
crossref_primary_10_1098_rsos_230400
crossref_primary_10_1001_jamanetworkopen_2023_24176
crossref_primary_10_1016_j_xcrm_2024_101713
crossref_primary_10_1038_s41551_023_01056_8
crossref_primary_10_1016_j_patter_2023_100790
crossref_primary_10_1038_s41746_023_00766_2
crossref_primary_10_1055_s_0043_1775597
crossref_primary_10_1093_humrep_dead223
crossref_primary_10_1016_j_clp_2024_02_003
crossref_primary_10_1038_s41591_022_01854_8
crossref_primary_10_1038_s41591_024_02885_z
Cites_doi 10.1038/s41591-021-01595-0
10.1142/9789811232701_0022
ContentType Journal Article
Copyright This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply 2022
This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply 2022.
Copyright_xml – notice: This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply 2022
– notice: This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply 2022.
DBID AAYXX
CITATION
3V.
7QG
7QL
7QP
7QR
7T5
7TK
7TM
7TO
7U7
7U9
7X7
7XB
88A
88E
88I
8AO
8FD
8FE
8FH
8FI
8FJ
8FK
8G5
ABUWG
AEUYN
AFKRA
AZQEC
BBNVY
BENPR
BHPHI
C1K
CCPQU
DWQXO
FR3
FYUFA
GHDGH
GNUQQ
GUQSH
H94
HCIFZ
K9.
LK8
M0S
M1P
M2O
M2P
M7N
M7P
MBDVC
P64
PHGZM
PHGZT
PJZUB
PKEHL
PPXIY
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
Q9U
RC3
7X8
DOI 10.1038/s41591-022-01847-7
DatabaseName CrossRef
ProQuest Central (Corporate)
Animal Behavior Abstracts
Bacteriology Abstracts (Microbiology B)
Calcium & Calcified Tissue Abstracts
Chemoreception Abstracts
Immunology Abstracts
Neurosciences Abstracts
Nucleic Acids Abstracts
Oncogenes and Growth Factors Abstracts
Toxicology Abstracts
Virology and AIDS Abstracts
ProQuest Health & Medical Collection
ProQuest Central (purchase pre-March 2016)
Biology Database (Alumni Edition)
Medical Database (Alumni Edition)
Science Database (Alumni Edition)
ProQuest Pharma Collection
Technology Research Database
ProQuest SciTech Collection
ProQuest Natural Science Journals
Hospital Premium Collection
Hospital Premium Collection (Alumni Edition)
ProQuest Central (Alumni) (purchase pre-March 2016)
Research Library
ProQuest Central (Alumni)
ProQuest One Sustainability
ProQuest Central UK/Ireland
ProQuest Central Essentials
Biological Science Collection
ProQuest Central
Natural Science Collection
Environmental Sciences and Pollution Management
ProQuest One Community College
ProQuest Central Korea
Engineering Research Database
Health Research Premium Collection
Health Research Premium Collection (Alumni)
ProQuest Central Student
Research Library Prep
AIDS and Cancer Research Abstracts
SciTech Premium Collection
ProQuest Health & Medical Complete (Alumni)
Biological Sciences
Health & Medical Collection (Alumni Edition)
Medical Database
Research Library
Science Database
Algology Mycology and Protozoology Abstracts (Microbiology C)
Biological Science Database
Research Library (Corporate)
Biotechnology and BioEngineering Abstracts
ProQuest Central Premium
ProQuest One Academic
ProQuest Health & Medical Research Collection
ProQuest One Academic Middle East (New)
ProQuest One Health & Nursing
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic
ProQuest One Academic UKI Edition
ProQuest Central China
ProQuest Central Basic
Genetics Abstracts
MEDLINE - Academic
DatabaseTitle CrossRef
Research Library Prep
ProQuest Central Student
Oncogenes and Growth Factors Abstracts
ProQuest Central Essentials
Nucleic Acids Abstracts
SciTech Premium Collection
ProQuest Central China
Environmental Sciences and Pollution Management
ProQuest One Applied & Life Sciences
ProQuest One Sustainability
Health Research Premium Collection
Natural Science Collection
Health & Medical Research Collection
Biological Science Collection
Chemoreception Abstracts
ProQuest Central (New)
ProQuest Medical Library (Alumni)
Virology and AIDS Abstracts
ProQuest Science Journals (Alumni Edition)
ProQuest Biological Science Collection
ProQuest One Academic Eastern Edition
ProQuest Hospital Collection
Health Research Premium Collection (Alumni)
Biological Science Database
Neurosciences Abstracts
ProQuest Hospital Collection (Alumni)
Biotechnology and BioEngineering Abstracts
ProQuest Health & Medical Complete
ProQuest One Academic UKI Edition
Engineering Research Database
ProQuest One Academic
Calcium & Calcified Tissue Abstracts
ProQuest One Academic (New)
Technology Research Database
ProQuest One Academic Middle East (New)
ProQuest Health & Medical Complete (Alumni)
ProQuest Central (Alumni Edition)
ProQuest One Community College
ProQuest One Health & Nursing
Research Library (Alumni Edition)
ProQuest Natural Science Collection
ProQuest Pharma Collection
ProQuest Biology Journals (Alumni Edition)
ProQuest Central
ProQuest Health & Medical Research Collection
Genetics Abstracts
Health and Medicine Complete (Alumni Edition)
ProQuest Central Korea
Bacteriology Abstracts (Microbiology B)
Algology Mycology and Protozoology Abstracts (Microbiology C)
AIDS and Cancer Research Abstracts
ProQuest Research Library
ProQuest Central Basic
Toxicology Abstracts
ProQuest Science Journals
ProQuest SciTech Collection
ProQuest Medical Library
Animal Behavior Abstracts
Immunology Abstracts
ProQuest Central (Alumni)
MEDLINE - Academic
Database_xml – sequence: 1
  dbid: BENPR
  name: ProQuest Databases
  url: http://www.proquest.com/pqcentral?accountid=15518
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Medicine
Biology
EISSN 1546-170X
EndPage 1160
ExternalDocumentID 10_1038_s41591_022_01847_7
Genre Correspondence
Commentary
GroupedDBID ---
.-4
.55
.GJ
0R~
123
1CY
29M
2FS
36B
39C
3O-
3V.
4.4
53G
5BI
5M7
5RE
5S5
70F
7X7
85S
88A
88E
88I
8AO
8FE
8FH
8FI
8FJ
8G5
8R4
8R5
AAEEF
AARCD
AAYOK
AAYZH
AAZLF
ABAWZ
ABCQX
ABDBF
ABDPE
ABEFU
ABJNI
ABLJU
ABOCM
ABUWG
ACBWK
ACGFO
ACGFS
ACGOD
ACIWK
ACMJI
ACPRK
ACUHS
ADBBV
ADFRT
AENEX
AEUYN
AFBBN
AFKRA
AFRAH
AFSHS
AGAYW
AGCDD
AGHTU
AHBCP
AHMBA
AHOSX
AHSBF
AIBTJ
ALFFA
ALIPV
ALMA_UNASSIGNED_HOLDINGS
AMTXH
ARMCB
ASPBG
AVWKF
AXYYD
AZFZN
AZQEC
B0M
BBNVY
BENPR
BHPHI
BKKNO
BPHCQ
BVXVI
CCPQU
CS3
DB5
DU5
DWQXO
EAD
EAP
EBC
EBD
EBS
EE.
EJD
EMB
EMK
EMOBN
EPL
ESX
EXGXG
F5P
FEDTE
FQGFK
FSGXE
FYUFA
GNUQQ
GUQSH
GX1
HCIFZ
HMCUK
HVGLF
HZ~
IAO
IEA
IH2
IHR
IHW
INH
INR
IOF
IOV
ISR
ITC
J5H
L7B
LGEZI
LK8
LOTEE
M0L
M1P
M2O
M2P
M7P
MK0
N9A
NADUK
NNMJJ
NXXTH
O9-
ODYON
P2P
PQQKQ
PROAC
PSQYO
Q2X
RIG
RNS
RNT
RNTTT
RVV
SHXYY
SIXXV
SJN
SNYQT
SOJ
SV3
TAE
TAOOD
TBHMF
TDRGL
TSG
TUS
UKHRP
UQL
X7M
XJT
YHZ
ZGI
~8M
AAYXX
ABFSG
ACSTC
AEZWR
AFANA
AFHIU
AHWEU
AIXLP
ALPWD
ATHPR
CITATION
PUEGO
7QG
7QL
7QP
7QR
7T5
7TK
7TM
7TO
7U7
7U9
7XB
8FD
8FK
AGSTI
C1K
FR3
H94
K9.
M7N
MBDVC
P64
PHGZM
PHGZT
PJZUB
PKEHL
PPXIY
PQEST
PQGLB
PQUKI
PRINS
Q9U
RC3
7X8
ID FETCH-LOGICAL-c352t-8530fe8885016b14b47fc3cce4e1b7d0f4b14e0f696c5580e0cbdea8eb13e45a3
IEDL.DBID BENPR
ISSN 1078-8956
1546-170X
IngestDate Thu Sep 04 18:44:50 EDT 2025
Mon Oct 06 17:39:23 EDT 2025
Thu Apr 24 23:02:10 EDT 2025
Wed Oct 01 04:32:42 EDT 2025
Fri Feb 21 02:37:47 EST 2025
IsPeerReviewed true
IsScholarly true
Issue 6
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c352t-8530fe8885016b14b47fc3cce4e1b7d0f4b14e0f696c5580e0cbdea8eb13e45a3
Notes SourceType-Scholarly Journals-1
ObjectType-Correspondence-1
content type line 14
ObjectType-Commentary-2
content type line 23
ORCID 0000-0002-9975-9994
PQID 2677954121
PQPubID 33975
PageCount 2
ParticipantIDs proquest_miscellaneous_2678425808
proquest_journals_2677954121
crossref_citationtrail_10_1038_s41591_022_01847_7
crossref_primary_10_1038_s41591_022_01847_7
springer_journals_10_1038_s41591_022_01847_7
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2022-06-01
PublicationDateYYYYMMDD 2022-06-01
PublicationDate_xml – month: 06
  year: 2022
  text: 2022-06-01
  day: 01
PublicationDecade 2020
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle Nature medicine
PublicationTitleAbbrev Nat Med
PublicationYear 2022
Publisher Nature Publishing Group US
Nature Publishing Group
Publisher_xml – name: Nature Publishing Group US
– name: Nature Publishing Group
References CR2
Seyyed-Kalantari (CR1) 2021; 27
L Seyyed-Kalantari (1847_CR1) 2021; 27
1847_CR2
References_xml – volume: 27
  start-page: 2176
  year: 2021
  end-page: 2182
  ident: CR1
  article-title: Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations
  publication-title: Nat. Med.
  doi: 10.1038/s41591-021-01595-0
– ident: CR2
– ident: 1847_CR2
  doi: 10.1142/9789811232701_0022
– volume: 27
  start-page: 2176
  year: 2021
  ident: 1847_CR1
  publication-title: Nat. Med.
  doi: 10.1038/s41591-021-01595-0
SSID ssj0003059
Score 2.4687629
SourceID proquest
crossref
springer
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 1159
SubjectTerms 692/308/575
692/700/139
Algorithms
Biomedical and Life Sciences
Biomedicine
Cancer Research
Infectious Diseases
Machine learning
Matters Arising
Metabolic Diseases
Molecular Medicine
Neurosciences
Title Confounding factors need to be accounted for in assessing bias by machine learning algorithms
URI https://link.springer.com/article/10.1038/s41591-022-01847-7
https://www.proquest.com/docview/2677954121
https://www.proquest.com/docview/2678425808
Volume 28
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVLSH
  databaseName: SpringerLink Journals
  customDbUrl:
  mediaType: online
  eissn: 1546-170X
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0003059
  issn: 1078-8956
  databaseCode: AFBBN
  dateStart: 20190101
  isFulltext: true
  providerName: Library Specific Holdings
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3fa9swED7ahI2-jK3bWLYuaLC3TdQ_JEt6GKMZDWXQMMYKeRlGls9doXXaxX3of7-TLCes0D7almV8Ot190p3uA_jYmConGOp4bvKai0JLbhNUvNGFLxRgszpE8E8XxcmZ-L6Uyx1YDGdhfFrlYBODoa5Xzu-RH2aFUkaKNEu_Xt9wzxrlo6sDhYaN1Ar1l1BibBfGma-MNYLx7Hjx4-fGNpN2mz4LUXNNS4N4jCbJ9eGaXJnPAsp8qgLZbK7-d1Vb_HkvZBo80fw5PIsQkh31Y_4CdrDdhyc9qeTdPjw9jeHyl_Dbn-fzvEnUD4vMOqwlf8W6FauQxf-ha4Ku7KJlNoSAfevqwq5ZdceuQrIlssgucc7s5TmJpftztX4FZ_PjX99OeORT4I5gVsfJMycN0pJXEs6rUlEJ1bjcORSYVqpOGkE3MWkKUzgpdYKJq2q0msx5jkLa_DWM2lWLb4ClFqVBkRpnMwJcaERmCfhhbRpaASk5gXQQXelisXHPeXFZhqB3rste3CWJuwziLtUEPm3eue5LbTza-mAYkTJOu3W5VZIJfNg8pgnjoyC2xdVtaONDjzrRE_g8jOS2i4e_-PbxL76DvSwoj9-hOYBR9_cW3xNg6aop7KqlmsL4aD6bLaZRJ_8B9ebnlQ
linkProvider ProQuest
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1Lb9QwEB6VVjwuCAqIhQJGghNYTRwnsQ8V4tFqS7srhFqpF5Q6zqRUarOFpEL75_htjB1nVyDRW49JHFsaz3i-8Yz9AbyqdZkQDLU80UnFZaZSbiLMea0yd1GAEZXP4E-m2fhQfj5Kj1bg93AWxpVVDmuiX6irmXV75Jsiy3OdyljE7y5-cMca5bKrA4WGCdQK1Za_Yiwc7NjD-S8K4dqt3U8036-F2Nk--DjmgWWAWwIfHSd_FdVIgWBK6KeMZSnz2ibWosS4zKuolvQSozrTmU1TFWFkywqNokUuQZmahPq9AWsykZqCv7UP29MvXxe-gKxJ91WPiisKRcKxnShRmy25Tld1JFxpBPkInv_tGpd4958Urfd8O_fgboCs7H2vY_dhBZt1uNmTWM7X4dYkpOcfwDd3ftDxNFE_LDD5sIb8I-tmrEQW5EfPBJXZacOMTzm71uWpaVk5Z-e-uBNZYLM4YebshKah-37ePoTDa5HsI1htZg0-BhYbTDXKWFsjCOChlsIQ0MRK1xRx5ekI4kF0hQ2XmzuOjbPCJ9kTVfTiLkjchRd3kY_gzeKfi_5qjytbbwwzUgQzb4ulUo7g5eIzGajLupgGZ5e-jUt1qkiN4O0wk8su_j_ik6tHfAG3xweT_WJ_d7r3FO4Ir0hud2gDVrufl_iMwFJXPg8ayeD4uo3gDzdNIws
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3BbtQwEB2VIqpeEBRQtxQwEpzA2iR2YvtQVYiyaimtOFBpLyg4zqSt1GZbkgrtr_F1jJ1kVyDRW49JHEcajz1v8sZ-AG8qUwiCoY4LI0ouM51yG6Hilc78QQE2KQODf3Sc7Z_Iz9N0ugK_h70wvqxyWBPDQl3OnP9HPk4ypUwq4yQeV31ZxNe9ye7VNfcKUp5pHeQ0Ohc5xPkvSt-anYM9Guu3STL59O3jPu8VBrgj4NFyilVRhZQEpoR8ilgWUlVOOIcS40KVUSXpJkZVZjKXpjrCyBUlWk0LnECZWkH93oP7SgjjywnVdJHs-XlkunpHzTUlIf2GnUjocUNB09cbJb4ogqIDV38HxSXS_YecDTFv8gge9mCVfei86zGsYL0BDzr5yvkGrB31xPwT-O53DnqFJuqH9Ro-rKbIyNoZK5DZTpSCrgkks_Oa2UA2-9bFuW1YMWeXoawTWa9jccrsxSkZvT27bJ7CyZ3Y9Rms1rMaN4HFFlODMjbOJgTt0MjEEsTE0lSUa6l0BPFgutz1x5p7dY2LPNDrQueduXMydx7MnasRvFu8c9Ud6nFr6-1hRPJ-gjf50h1H8HrxmKam51tsjbOb0MaTnDrSI3g_jOSyi_9_cev2L76CNXL9_MvB8eFzWE-CH_nfQtuw2v68wReEktriZXBHBj_u2v__ADOlIKU
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Confounding+factors+need+to+be+accounted+for+in+assessing+bias+by+machine+learning+algorithms&rft.jtitle=Nature+medicine&rft.au=Mukherjee%2C+Pritam&rft.au=Shen%2C+Thomas+C.&rft.au=Liu%2C+Jianfei&rft.au=Mathai%2C+Tejas&rft.date=2022-06-01&rft.issn=1078-8956&rft.eissn=1546-170X&rft.volume=28&rft.issue=6&rft.spage=1159&rft.epage=1160&rft_id=info:doi/10.1038%2Fs41591-022-01847-7&rft.externalDBID=n%2Fa&rft.externalDocID=10_1038_s41591_022_01847_7
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1078-8956&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1078-8956&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1078-8956&client=summon