Periodic Manual Algorithm Updates and Generalizability: A Developer’s Response. Comment on “Evaluation of Four Artificial Intelligence–Assisted Self-Diagnosis Apps on Three Diagnoses: Two-Year Follow-Up Study”

Saved in:
Bibliographic Details
Published inJournal of medical Internet research Vol. 23; no. 6; p. e26514
Main Authors Gilbert, Stephen, Fenech, Matthew, Idris, Anisa, Türk, Ewelina
Format Journal Article
LanguageEnglish
Published Toronto, Canada JMIR Publications 16.06.2021
Subjects
Letter to the Editor
Online AccessGet full text
ISSN1438-8871
1439-4456
1438-8871
DOI10.2196/26514

Cover

Author Idris, Anisa
Fenech, Matthew
Türk, Ewelina
Gilbert, Stephen
AuthorAffiliation 1 Ada Health Berlin Germany
AuthorAffiliation_xml – name: 1 Ada Health Berlin Germany
Author_xml – sequence: 1
  givenname: Stephen
  orcidid: 0000-0002-1997-1689
  surname: Gilbert
  fullname: Gilbert, Stephen
– sequence: 2
  givenname: Matthew
  orcidid: 0000-0001-7933-4617
  surname: Fenech
  fullname: Fenech, Matthew
– sequence: 3
  givenname: Anisa
  orcidid: 0000-0003-0355-6904
  surname: Idris
  fullname: Idris, Anisa
– sequence: 4
  givenname: Ewelina
  orcidid: 0000-0003-3954-1210
  surname: Türk
  fullname: Türk, Ewelina
BookMark eNp1kk9v0zAYxiM0xLay7-ALCAllxI6TJjsgRd0fKg2BWHvgFDn2m9aTY2d20qqc-h04IcEH49pPgvtHiE3iZPvx49_72o9PgyNtNATBGY7OCc7TdyRNMH0WnGAaZ2GWDfHRP_Pj4NS5-ygiEc3xi-A4pjgmKcUnwe_PYKURkqOPTPdMoULNjJXdvEHTVrAOHGJaoBvQYJmS31gllexWF6hAl7AAZVqwm_UPh76Aa412cI5GpmlAd8hotFn_vFow1bNO-pWp0bXpLSpsJ2vJpa821h0oJWegOWzW3wvnpOtAoDtQdXgp2Uwbr6Cibd2WN5lbAHTQwV2gydKEX4FZD1bKLMNpi-66Xqw2618vg-c1Uw7ODuMgmF5fTUYfwttPN-NRcRtyGqVdGFdZSkgsUspozAjhhFU0YSyjOY-gripR81wkhCZR7k9QURGCkyFgHEOUEIgHwXjPFYbdl62VDbOr0jBZ7gRjZyXzF-YKyphgkiVQZ1GWUprGFYmE4HHtOZxCxD3r9Z7V65atlkypv0Aclducy13O3vh-b2z7qgHB_Xv7eB5Vf7yj5bycmUWZkeEwTraANweANQ89uK5spOM-C6bB9K4kCcXDLKf-owyCV3srt8Y5C_V_e3r7xMdlt0vedyDVE_cfnAzghw
CitedBy_id crossref_primary_10_1016_j_compbiomed_2023_107544
crossref_primary_10_3390_healthcare12161661
crossref_primary_10_2196_30545
Cites_doi 10.1136/bmjopen-2020-040269
10.2196/19713
10.2196/18097
ContentType Journal Article
Copyright Stephen Gilbert, Matthew Fenech, Anisa Idris, Ewelina Türk. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 16.06.2021. 2021
Copyright_xml – notice: Stephen Gilbert, Matthew Fenech, Anisa Idris, Ewelina Türk. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 16.06.2021. 2021
DBID AAYXX
CITATION
7X8
5PM
ADTOC
UNPAY
DOA
DOI 10.2196/26514
DatabaseName CrossRef
MEDLINE - Academic
PubMed Central (Full Participant titles)
Unpaywall for CDI: Periodical Content
Unpaywall
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
MEDLINE - Academic
Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: UNPAY
  name: Unpaywall
  url: https://proxy.k.utb.cz/login?url=https://unpaywall.org/
  sourceTypes: Open Access Repository
DeliveryMethod fulltext_linktorsrc
Discipline Medicine
Library & Information Science
EISSN 1438-8871
ExternalDocumentID oai_doaj_org_article_321285ef80864463b20ddc3f052c4e0c
10.2196/26514
PMC8277354
10_2196_26514
GroupedDBID ---
.4I
.DC
29L
2WC
36B
53G
5GY
5VS
77I
77K
7RV
7X7
8FI
8FJ
AAFWJ
AAKPC
AAWTL
AAYXX
ABDBF
ABIVO
ABUWG
ACGFO
ADBBV
AEGXH
AENEX
AFKRA
AFPKN
AIAGR
ALMA_UNASSIGNED_HOLDINGS
ALSLI
AOIJS
BAWUL
BCNDV
BENPR
CCPQU
CITATION
CNYFK
CS3
DIK
DU5
DWQXO
E3Z
EAP
EBD
EBS
EJD
ELW
EMB
EMOBN
ESX
F5P
FRP
FYUFA
GROUPED_DOAJ
GX1
HMCUK
HYE
KQ8
M1O
M48
NAPCQ
OK1
OVT
P2P
PGMZT
PHGZM
PHGZT
PIMPY
PPXIY
PQQKQ
PRQQA
PUEGO
RNS
RPM
SJN
SV3
TR2
UKHRP
XSB
7X8
5PM
ADRAZ
ADTOC
C1A
IAO
ICO
IEA
IHR
INH
ISN
ITC
O5R
O5S
UNPAY
WOQ
ID FETCH-LOGICAL-c406t-3b86223d64a43a22c2ab45aa849c0efbbdfc9d524509c404db22157e113e052e3
IEDL.DBID M48
ISSN 1438-8871
1439-4456
IngestDate Tue Oct 14 18:59:45 EDT 2025
Sun Oct 26 03:38:00 EDT 2025
Tue Sep 30 16:34:40 EDT 2025
Thu Sep 04 16:23:12 EDT 2025
Wed Oct 01 02:47:36 EDT 2025
Thu Apr 24 23:10:27 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 6
Language English
License This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.
cc-by
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c406t-3b86223d64a43a22c2ab45aa849c0efbbdfc9d524509c404db22157e113e052e3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ORCID 0000-0001-7933-4617
0000-0003-0355-6904
0000-0003-3954-1210
0000-0002-1997-1689
OpenAccessLink http://journals.scholarsportal.info/openUrl.xqy?doi=10.2196/26514
PMID 34132641
PQID 2541789441
PQPubID 23479
ParticipantIDs doaj_primary_oai_doaj_org_article_321285ef80864463b20ddc3f052c4e0c
unpaywall_primary_10_2196_26514
pubmedcentral_primary_oai_pubmedcentral_nih_gov_8277354
proquest_miscellaneous_2541789441
crossref_primary_10_2196_26514
crossref_citationtrail_10_2196_26514
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2021-06-16
PublicationDateYYYYMMDD 2021-06-16
PublicationDate_xml – month: 06
  year: 2021
  text: 2021-06-16
  day: 16
PublicationDecade 2020
PublicationPlace Toronto, Canada
PublicationPlace_xml – name: Toronto, Canada
PublicationTitle Journal of medical Internet research
PublicationYear 2021
Publisher JMIR Publications
Publisher_xml – name: JMIR Publications
References ref2
ref1
ref4
ref3
ref5
References_xml – ident: ref4
  doi: 10.1136/bmjopen-2020-040269
– ident: ref5
  doi: 10.2196/19713
– ident: ref2
– ident: ref3
– ident: ref1
  doi: 10.2196/18097
SSID ssj0020491
Score 2.3439932
SourceID doaj
unpaywall
pubmedcentral
proquest
crossref
SourceType Open Website
Open Access Repository
Aggregation Database
Enrichment Source
Index Database
StartPage e26514
SubjectTerms Letter to the Editor
SummonAdditionalLinks – databaseName: DOAJ Directory of Open Access Journals
  dbid: DOA
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1Nb9MwGLbQDgMJTTBAlLHxIk3cwhLHjpPdCqwaSEUIWmmcosQfW6WQVE2rqrf-B05I8MO49pfwOnGrdkLiwjHfr-PH9vPKjx8TciqEirnv555Uhnosw7qIExF4XBohIj8PwtiuRu5_jC6H7MMVv9ra6stqwlp74PbHnYXYt8Zcmxi5N6YuYU59pWRofE4l0760va8fJ-tkyqVayHuDfXLfCp0RYmc04gHbGXkag_4dVnlbE3l3Vo6zxTwriq0Bp_eAHDimCN02wofkji4PybFbZwCvwC0ksj8WXAs9JPt9N1f-iPz-hOCq8Aj6mfUdhW5xXU1G05tvMBzbPL-GrFTgfKetuMvKZBfn0AWnJNKT1fJHDZ9bGa1-DXY1CQYO-MXV8ufFxigcKgM9jLcJtrWkgPdbXp-r5XeEgQWUgi-6MN67VuA3qgFZcG3fN0BMaXDndX0Og3nlfcVmiC8uimruDcdgNY-L1fLXYzLsXQzeXnpuIwdPIl-YemGOeRMNVcQyFmaUSprljGdZzBLpa5PnyshEccqQveATTOUUmYjQQRBqrGcdPiF7ZVXqpwQiprlRzHCtDFPIT5BfBTo3sVCJkDzpkNN1JafSuZzbzTaKFLMdi4W0wUKHnGxuG7e2HrdveGMRsrloXbibE4jN1GEz_Rc2O-TlGl8ptlo7FZOVuprVKablgYgT5KIdInaAt_PF3Svl6Kbx_46pECHHEF9sIPr3Qjz7H4U4Iveo1fHY_Zqi52RvOpnpYyRi0_ykaXN_AOxoOgo
  priority: 102
  providerName: Directory of Open Access Journals
– databaseName: Unpaywall
  dbid: UNPAY
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwhV1bb9MwFLamTRpIiMsAUaDDSBNvKYljx8neCqwaSJ0maKXtKUp8YRUhqZpWVXnqf-AJCX4Yr_0lHCdu1VQg3nJx4hP5O8l34nM-I3TCuQyZ66aOkJo4NIGxCCPuOUxozgM39fzQVCP3L4LzIf1wxa72UHtdC7M1fw--FLwmATPLVB8EDKj2PjoYXlx2r6uKIXBUcBCv3o4cCkzgEN1pXNf41lSS_A0euZsFeWuWj5PFPMmyrU9M7179N7CslAlNZsmXzmyadsS3Hd3Gf1p_H9215BJ3azQ8QHsqP0JtW5qAX2Fbe2TGAlunPkKHfTu9_hD9vgQ8FrCH-4mRKsXd7HMxGU1vvuLh2PwaKHGSS2ylqk0-mMmsXZziLrbJR2qyWv4o8cc681Z1sClAgSfH0ONq-fNsoy2OC417YG9lbK1igd9vyYOult8BOQaDEn9SmXbe1TmBoxIDcS7N_QYAQ4XtcVWe4sG8cK7Bc-HGWVbMneEYmzTJxWr56xEa9s4Gb88du_aDI4BiTB0_hVCL-DKgCfUTQgRJUsqSJKSRcJVOU6lFJBmhQHjgCipTAuSFK8_zlcuI8h-j_bzI1ROEA6qYllQzJTWVQGmAknkq1SGXERcsaqGTNUpiYYXRzfocWQwBkhnGuBrGFjreNBvXSiC7Dd4YiG1OGuHu6gAgIrbvgdgHqhAypUMIJSES91PiSil8DTYLqlzRQi_XAI3B0c3sTZKrYlbGEMl7PIyAvrYQbyC30WPzTD66qSTDQ8K5z8DEFxuM__0hnv63xTN0m5i8HrN-U_Ac7U8nM9UGYjZNj617_gEh6zxx
  priority: 102
  providerName: Unpaywall
Title Periodic Manual Algorithm Updates and Generalizability: A Developer’s Response. Comment on “Evaluation of Four Artificial Intelligence–Assisted Self-Diagnosis Apps on Three Diagnoses: Two-Year Follow-Up Study”
URI https://www.proquest.com/docview/2541789441
https://pubmed.ncbi.nlm.nih.gov/PMC8277354
https://doi.org/10.2196/26514
https://doaj.org/article/321285ef80864463b20ddc3f052c4e0c
UnpaywallVersion publishedVersion
Volume 23
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAFT
  databaseName: Open Access Digital Library
  customDbUrl:
  eissn: 1438-8871
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0020491
  issn: 1439-4456
  databaseCode: KQ8
  dateStart: 19990101
  isFulltext: true
  titleUrlDefault: http://grweb.coalliance.org/oadl/oadl.html
  providerName: Colorado Alliance of Research Libraries
– providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 1438-8871
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0020491
  issn: 1439-4456
  databaseCode: DOA
  dateStart: 19990101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVEBS
  databaseName: EBSCOhost Academic Search Ultimate - TFS
  customDbUrl: https://search.ebscohost.com/login.aspx?authtype=ip,shib&custid=s3936755&profile=ehost&defaultdb=asn
  eissn: 1438-8871
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0020491
  issn: 1439-4456
  databaseCode: ABDBF
  dateStart: 20050101
  isFulltext: true
  titleUrlDefault: https://search.ebscohost.com/direct.asp?db=asn
  providerName: EBSCOhost
– providerCode: PRVBFR
  databaseName: Free Medical Journals - Free Access to All
  customDbUrl:
  eissn: 1438-8871
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0020491
  issn: 1439-4456
  databaseCode: DIK
  dateStart: 19990101
  isFulltext: true
  titleUrlDefault: http://www.freemedicaljournals.com
  providerName: Flying Publisher
– providerCode: PRVFQY
  databaseName: GFMER Free Medical Journals
  customDbUrl:
  eissn: 1438-8871
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0020491
  issn: 1439-4456
  databaseCode: GX1
  dateStart: 19990101
  isFulltext: true
  titleUrlDefault: http://www.gfmer.ch/Medical_journals/Free_medical.php
  providerName: Geneva Foundation for Medical Education and Research
– providerCode: PRVAQN
  databaseName: PubMed Central
  customDbUrl:
  eissn: 1438-8871
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0020491
  issn: 1439-4456
  databaseCode: RPM
  dateStart: 19990101
  isFulltext: true
  titleUrlDefault: https://www.ncbi.nlm.nih.gov/pmc/
  providerName: National Library of Medicine
– providerCode: PRVPQU
  databaseName: Library Science Database
  customDbUrl:
  eissn: 1438-8871
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0020491
  issn: 1439-4456
  databaseCode: M1O
  dateStart: 20010101
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/libraryscience
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Proquest Central
  customDbUrl: http://www.proquest.com/pqcentral?accountid=15518
  eissn: 1438-8871
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0020491
  issn: 1439-4456
  databaseCode: BENPR
  dateStart: 20010101
  isFulltext: true
  titleUrlDefault: https://www.proquest.com/central
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: ProQuest_Health & Medical Collection
  customDbUrl:
  eissn: 1438-8871
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0020491
  issn: 1439-4456
  databaseCode: 7X7
  dateStart: 20010101
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/healthcomplete
  providerName: ProQuest
– providerCode: PRVFZP
  databaseName: Scholars Portal Journals: Open Access
  customDbUrl:
  eissn: 1438-8871
  dateEnd: 20250131
  omitProxy: true
  ssIdentifier: ssj0020491
  issn: 1439-4456
  databaseCode: M48
  dateStart: 20100201
  isFulltext: true
  titleUrlDefault: http://journals.scholarsportal.info
  providerName: Scholars Portal
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1Bb9MwFLZgk8okhGCAKLBipIlbRuLYcTIJoQ5aDaSWajTSdoqS2N4qhaQ0rUpv_Q-ckOCHce0v4Tn1qmbaiUulxonzGn-v_l78_D2EDjkXPrPtxEqFIhaNYSz8gDsWSxXnnp04rq93I_f63mlIP5-zrWxC8wDLW0M7XU8qnGRHP74v3oPDv9NpzACgt8RjupT1LkxOga7e0KObhQQCBLiKuahe8ASy0ED3a5ftoYb-Hwda4NRmpkrAv8Y6b-ZM3pvl43gxj7Nsa0LqPkQPDJPE7fXQP0J3ZL6PDsw-BPwGm41G-sFj48H7qNEza-mP0d8BgK-Ab7gXa11S3M4ui8loevUNh2P9HqDEcS6w0aXWyV86jXZxjNvYZBrJyWr5q8Rn6zRbeYT1bhMwHMMdV8vfnY2QOC4U7oK9lbFryQr8aUsLdLX8CTDRgBP4q8yU9XGdADgqMbDkUvc3BMxJbI7L8hgP54V1AW4KHWdZMbfCMdY5kYvV8s8TFHY7ww-nlin0YKXAJ6aWm0BcRVzh0Zi6MSEpiRPK4tinQWpLlSRCpYFghAK7gSuoSAgwFS4dx5U2I9J9inbyIpfPEPaoZEpQxaRQVAB_Af7lyET5XAQ8ZUETHV4PcpQaFXRdjCOLIBrSsIgqWDRRa3PaeC37cfOEE42QTaNW6a4OFJPLyDh95AIv8JlUPsSNEHa7CbGFSF0FNqdU2mkTvb7GVwRerZdq4lwWszKCsN3hfgBctYl4DXi1O9Zb8tFVpQ_uE85dBia-2kD09h_x_L_7foH2iE7u0UWcvJdoZzqZyQNgZ9Okhe7yc95Cuyed_uCsVb3jgM-e86VVeSa0hP1B--IfimFH4Q
linkProvider Scholars Portal
linkToUnpaywall http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwhV1bb9MwFLamTRpIiMsAUaDDSBNvKYljx8neCqwaSJ0maKXtKUp8YRUhqZpWVXnqf-AJCX4Yr_0lHCdu1VQg3nJx4hP5O8l34nM-I3TCuQyZ66aOkJo4NIGxCCPuOUxozgM39fzQVCP3L4LzIf1wxa72UHtdC7M1fw--FLwmATPLVB8EDKj2PjoYXlx2r6uKIXBUcBCv3o4cCkzgEN1pXNf41lSS_A0euZsFeWuWj5PFPMmyrU9M7179N7CslAlNZsmXzmyadsS3Hd3Gf1p_H9215BJ3azQ8QHsqP0JtW5qAX2Fbe2TGAlunPkKHfTu9_hD9vgQ8FrCH-4mRKsXd7HMxGU1vvuLh2PwaKHGSS2ylqk0-mMmsXZziLrbJR2qyWv4o8cc681Z1sClAgSfH0ONq-fNsoy2OC417YG9lbK1igd9vyYOult8BOQaDEn9SmXbe1TmBoxIDcS7N_QYAQ4XtcVWe4sG8cK7Bc-HGWVbMneEYmzTJxWr56xEa9s4Gb88du_aDI4BiTB0_hVCL-DKgCfUTQgRJUsqSJKSRcJVOU6lFJBmhQHjgCipTAuSFK8_zlcuI8h-j_bzI1ROEA6qYllQzJTWVQGmAknkq1SGXERcsaqGTNUpiYYXRzfocWQwBkhnGuBrGFjreNBvXSiC7Dd4YiG1OGuHu6gAgIrbvgdgHqhAypUMIJSES91PiSil8DTYLqlzRQi_XAI3B0c3sTZKrYlbGEMl7PIyAvrYQbyC30WPzTD66qSTDQ8K5z8DEFxuM__0hnv63xTN0m5i8HrN-U_Ac7U8nM9UGYjZNj617_gEh6zxx
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Periodic+Manual+Algorithm+Updates+and+Generalizability%3A+A+Developer%E2%80%99s+Response.+Comment+on+%E2%80%9CEvaluation+of+Four+Artificial+Intelligence%E2%80%93Assisted+Self-Diagnosis+Apps+on+Three+Diagnoses%3A+Two-Year+Follow-Up+Study%E2%80%9D&rft.jtitle=Journal+of+medical+Internet+research&rft.au=Gilbert%2C+Stephen&rft.au=Fenech%2C+Matthew&rft.au=Idris%2C+Anisa&rft.au=T%C3%BCrk%2C+Ewelina&rft.date=2021-06-16&rft.pub=JMIR+Publications&rft.issn=1439-4456&rft.eissn=1438-8871&rft.volume=23&rft.issue=6&rft_id=info:doi/10.2196%2F26514&rft_id=info%3Apmid%2F34132641&rft.externalDocID=PMC8277354
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1438-8871&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1438-8871&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1438-8871&client=summon