Minimal Hip Joint Space Width Measured on X-rays by an Artificial Intelligence Algorithm—A Study of Reliability and Agreement
Minimal joint space width (mJSW) is a radiographic measurement used in the diagnosis of hip osteoarthritis. A large variance when measuring mJSW highlights the need for a supporting diagnostic tool. This study aimed to estimate the reliability of a deep learning algorithm designed to measure the mJS...
Saved in:
Published in | BioMedInformatics Vol. 3; no. 3; pp. 714 - 723 |
---|---|
Main Authors | , , , , , , , , |
Format | Journal Article |
Language | English |
Published |
MDPI AG
01.09.2023
|
Subjects | |
Online Access | Get full text |
ISSN | 2673-7426 2673-7426 |
DOI | 10.3390/biomedinformatics3030046 |
Cover
Abstract | Minimal joint space width (mJSW) is a radiographic measurement used in the diagnosis of hip osteoarthritis. A large variance when measuring mJSW highlights the need for a supporting diagnostic tool. This study aimed to estimate the reliability of a deep learning algorithm designed to measure the mJSW in pelvic radiographs and to estimate agreement between the algorithm and orthopedic surgeons, radiologists, and a reporting radiographer. The algorithm was highly consistent when measuring mJSW with a mean difference at 0.00. Human readers, however, were subject to variance with a repeatability coefficient of up to 1.31. Statistically, although not clinically significant, differences were found between the algorithm’s and all readers’ measurements with mean measured differences ranging from −0.78 to −0.36 mm. In conclusion, the algorithm was highly reliable, and the mean measured difference between the human readers combined and the algorithm was low, i.e., −0.5 mm bilaterally. Given the consistency of the algorithm, it may be a useful tool for monitoring hip osteoarthritis. |
---|---|
AbstractList | Minimal joint space width (mJSW) is a radiographic measurement used in the diagnosis of hip osteoarthritis. A large variance when measuring mJSW highlights the need for a supporting diagnostic tool. This study aimed to estimate the reliability of a deep learning algorithm designed to measure the mJSW in pelvic radiographs and to estimate agreement between the algorithm and orthopedic surgeons, radiologists, and a reporting radiographer. The algorithm was highly consistent when measuring mJSW with a mean difference at 0.00. Human readers, however, were subject to variance with a repeatability coefficient of up to 1.31. Statistically, although not clinically significant, differences were found between the algorithm’s and all readers’ measurements with mean measured differences ranging from −0.78 to −0.36 mm. In conclusion, the algorithm was highly reliable, and the mean measured difference between the human readers combined and the algorithm was low, i.e., −0.5 mm bilaterally. Given the consistency of the algorithm, it may be a useful tool for monitoring hip osteoarthritis. |
Author | Lundemann, Michael Jensen, Janni Haubro, Martin Haagen Varnum, Claus Rasmussen, Janne Andersen, Anne Mathilde Overgaard, Søren Rasmussen, Benjamin S. B. Graumann, Ole |
Author_xml | – sequence: 1 givenname: Anne Mathilde orcidid: 0009-0005-3162-0370 surname: Andersen fullname: Andersen, Anne Mathilde – sequence: 2 givenname: Benjamin S. B. orcidid: 0000-0002-7357-0755 surname: Rasmussen fullname: Rasmussen, Benjamin S. B. – sequence: 3 givenname: Ole surname: Graumann fullname: Graumann, Ole – sequence: 4 givenname: Søren orcidid: 0000-0001-6829-4787 surname: Overgaard fullname: Overgaard, Søren – sequence: 5 givenname: Michael surname: Lundemann fullname: Lundemann, Michael – sequence: 6 givenname: Martin Haagen surname: Haubro fullname: Haubro, Martin Haagen – sequence: 7 givenname: Claus surname: Varnum fullname: Varnum, Claus – sequence: 8 givenname: Janne surname: Rasmussen fullname: Rasmussen, Janne – sequence: 9 givenname: Janni surname: Jensen fullname: Jensen, Janni |
BookMark | eNqNkd9qFTEQh4NUsB77DnmB1exmd5PcCEtRe6SlYBW9W2bz53RKNjlkc5C90ofwCX0SU48UEYReZQjzfTM_5jk5CTFYQmjNXnKu2KsJ42wNBhfTDBn1whlnrO2fkNOmF7wSbdOf_FU_I2fLcscYa6TgjZKn5NsVBpzB0wvc0_cRQ6Y3e9CWfkaTb-mVheWQrKEx0C9VgnWh00oh0CFldKixkNuQrfe4s6Fgg9_FhPl2_vn9x0Bv8sGsNDr6wXqECT3me9rQYZesnW3IL8hTB36xZ3_eDfn09s3H84vq8vrd9ny4rHSjWF-ZyTljbK90W1aH3tRdqToluenUxLQUXVszyXRnmVIgBJTMNZcdNKCbtucbsj16TYS7cZ9K5rSOEXD8_RHTboQSSXs7TnyyknPZtrJpnWkVc0xIMTHeKS2KdUPU0XUIe1i_gvcPwpqN94cZ_3eYwr4-sjrFZUnWjRpz6YghJ0D_GIH8R_Do2b8AaTazBQ |
CitedBy_id | crossref_primary_10_1016_j_radi_2024_02_020 crossref_primary_10_3390_biomedinformatics4030109 crossref_primary_10_1016_j_radi_2024_04_020 |
Cites_doi | 10.1177/096228029900800204 10.1016/j.joca.2014.05.017 10.1097/OPX.0000000000000513 10.1371/journal.pone.0178992 10.1016/j.jmir.2018.04.025 10.1007/s12325-016-0409-3 10.1148/radiol.2020190925 10.1007/s00256-011-1293-1 10.1007/s00198-021-06130-y 10.3390/diagnostics12112597 10.1373/clinchem.2015.246280 10.1136/ard.2003.018424 10.1177/1947603519888793 10.1080/00016470410004085 10.1007/s11999-008-0124-8 10.1016/j.jclinepi.2010.03.002 10.1016/j.jbspin.2010.10.014 10.1007/s11547-022-01476-7 10.1136/annrheumdis-2016-210815 10.1016/j.arthro.2020.07.009 |
ContentType | Journal Article |
DBID | AAYXX CITATION ADTOC UNPAY DOA |
DOI | 10.3390/biomedinformatics3030046 |
DatabaseName | CrossRef Unpaywall for CDI: Periodical Content Unpaywall DOAJ Directory of Open Access Journals |
DatabaseTitle | CrossRef |
DatabaseTitleList | CrossRef |
Database_xml | – sequence: 1 dbid: DOA name: DOAJ: Directory of Open Access Journal (DOAJ) url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: UNPAY name: Unpaywall url: https://proxy.k.utb.cz/login?url=https://unpaywall.org/ sourceTypes: Open Access Repository |
DeliveryMethod | fulltext_linktorsrc |
EISSN | 2673-7426 |
EndPage | 723 |
ExternalDocumentID | oai_doaj_org_article_b3be833844824fd490f0787b0359c771 10.3390/biomedinformatics3030046 10_3390_biomedinformatics3030046 |
GroupedDBID | AAYXX ABDBF AFZYC ALMA_UNASSIGNED_HOLDINGS CITATION GROUPED_DOAJ MODMG M~E ADTOC UNPAY |
ID | FETCH-LOGICAL-c2906-dbffdde69c4287a6d15c425983d59b0c87541080c5e099a77a2671385a2ac2463 |
IEDL.DBID | DOA |
ISSN | 2673-7426 |
IngestDate | Wed Aug 27 01:21:07 EDT 2025 Wed Oct 01 15:56:35 EDT 2025 Tue Jul 01 03:25:48 EDT 2025 Thu Apr 24 22:54:33 EDT 2025 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 3 |
Language | English |
License | https://creativecommons.org/licenses/by/4.0 cc-by |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c2906-dbffdde69c4287a6d15c425983d59b0c87541080c5e099a77a2671385a2ac2463 |
ORCID | 0000-0001-6829-4787 0000-0002-7357-0755 0009-0005-3162-0370 |
OpenAccessLink | https://doaj.org/article/b3be833844824fd490f0787b0359c771 |
PageCount | 10 |
ParticipantIDs | doaj_primary_oai_doaj_org_article_b3be833844824fd490f0787b0359c771 unpaywall_primary_10_3390_biomedinformatics3030046 crossref_citationtrail_10_3390_biomedinformatics3030046 crossref_primary_10_3390_biomedinformatics3030046 |
ProviderPackageCode | CITATION AAYXX |
PublicationCentury | 2000 |
PublicationDate | 2023-09-01 |
PublicationDateYYYYMMDD | 2023-09-01 |
PublicationDate_xml | – month: 09 year: 2023 text: 2023-09-01 day: 01 |
PublicationDecade | 2020 |
PublicationTitle | BioMedInformatics |
PublicationYear | 2023 |
Publisher | MDPI AG |
Publisher_xml | – name: MDPI AG |
References | Ratzlaff (ref_19) 2014; 22 Peterlein (ref_20) 2008; 466 Troelsen (ref_5) 2012; 59 Kottner (ref_11) 2011; 64 ref_13 Abdullah (ref_3) 2022; 127 ref_10 Sakellariou (ref_7) 2017; 76 Alzyoud (ref_21) 2018; 49 ref_1 Murphy (ref_4) 2016; 33 Bland (ref_14) 1999; 8 Terjesen (ref_22) 2012; 41 Bossuyt (ref_12) 2015; 61 Carkeet (ref_15) 2015; 92 Bessa (ref_23) 2020; 36 Lequesne (ref_17) 2004; 63 Nehrer (ref_18) 2021; 13 Sohn (ref_9) 2020; 295 Ornetti (ref_16) 2011; 78 Gebre (ref_2) 2022; 33 ref_6 Jacobsen (ref_8) 2004; 75 |
References_xml | – ident: ref_6 – volume: 8 start-page: 135 year: 1999 ident: ref_14 article-title: Measuring agreement in method comparison studies publication-title: Stat. Methods Med. Res. doi: 10.1177/096228029900800204 – volume: 22 start-page: 1481 year: 2014 ident: ref_19 article-title: Location-specific hip joint space width for progression of hip osteoarthritis--data from the osteoarthritis initiative publication-title: Osteoarthr. Cartil. doi: 10.1016/j.joca.2014.05.017 – volume: 92 start-page: e71 year: 2015 ident: ref_15 article-title: Exact parametric confidence intervals for Bland-Altman limits of agreement publication-title: Optom. Vis. Sci. doi: 10.1097/OPX.0000000000000513 – ident: ref_1 doi: 10.1371/journal.pone.0178992 – volume: 49 start-page: 316 year: 2018 ident: ref_21 article-title: Optimum Positioning for Anteroposterior Pelvis Radiography: A Literature Review publication-title: J. Med. Imaging Radiat. Sci. doi: 10.1016/j.jmir.2018.04.025 – volume: 33 start-page: 1921 year: 2016 ident: ref_4 article-title: Hip Osteoarthritis: Etiopathogenesis and Implications for Management publication-title: Adv. Ther. doi: 10.1007/s12325-016-0409-3 – volume: 295 start-page: 136 year: 2020 ident: ref_9 article-title: Development and Validation of a Multitask Deep Learning Model for Severity Grading of Hip Osteoarthritis Features on Radiographs publication-title: Radiology doi: 10.1148/radiol.2020190925 – volume: 41 start-page: 811 year: 2012 ident: ref_22 article-title: Reliability of radiographic parameters in adults with hip dysplasia publication-title: Skeletal Radiol. doi: 10.1007/s00256-011-1293-1 – volume: 33 start-page: 355 year: 2022 ident: ref_2 article-title: Detecting hip osteoarthritis on clinical CT: A deep learning application based on 2-D summation images derived from CT publication-title: Osteoporos. Int. doi: 10.1007/s00198-021-06130-y – volume: 59 start-page: B4450 year: 2012 ident: ref_5 article-title: Assessment of adult hip dysplasia and the outcome of surgical treatment publication-title: Dan. Med. J. – ident: ref_13 doi: 10.3390/diagnostics12112597 – ident: ref_10 – volume: 61 start-page: 1446 year: 2015 ident: ref_12 article-title: STARD 2015: An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies publication-title: Clin. Chem. doi: 10.1373/clinchem.2015.246280 – volume: 63 start-page: 1145 year: 2004 ident: ref_17 article-title: The normal hip joint space: Variations in width, shape, and architecture on 223 pelvic radiographs publication-title: Ann. Rheum. Dis. doi: 10.1136/ard.2003.018424 – volume: 13 start-page: 957s year: 2021 ident: ref_18 article-title: Automated Knee Osteoarthritis Assessment Increases Physicians’ Agreement Rate and Accuracy: Data from the Osteoarthritis Initiative publication-title: Cartilage doi: 10.1177/1947603519888793 – volume: 75 start-page: 713 year: 2004 ident: ref_8 article-title: Radiographic case definitions and prevalence of osteoarthrosis of the hip: A survey of 4 151 subjects in the Osteoarthritis Substudy of the Copenhagen City Heart Study publication-title: Acta Orthop. Scand. doi: 10.1080/00016470410004085 – volume: 466 start-page: 809 year: 2008 ident: ref_20 article-title: Comparison of pelvic radiographs in weightbearing and supine positions publication-title: Clin. Orthop. Relat. Res. doi: 10.1007/s11999-008-0124-8 – volume: 64 start-page: 96 year: 2011 ident: ref_11 article-title: Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed publication-title: J. Clin. Epidemiol. doi: 10.1016/j.jclinepi.2010.03.002 – volume: 78 start-page: 499 year: 2011 ident: ref_16 article-title: Influence of the experience of the reader on reliability of joint space width measurement. A cross-sectional multiple reading study in hip osteoarthritis publication-title: Joint Bone Spine doi: 10.1016/j.jbspin.2010.10.014 – volume: 127 start-page: 398 year: 2022 ident: ref_3 article-title: Automatic detection and classification of knee osteoarthritis using deep learning approach publication-title: Radiol. Med. doi: 10.1007/s11547-022-01476-7 – volume: 76 start-page: 1484 year: 2017 ident: ref_7 article-title: EULAR recommendations for the use of imaging in the clinical management of peripheral joint osteoarthritis publication-title: Ann. Rheum. Dis. doi: 10.1136/annrheumdis-2016-210815 – volume: 36 start-page: 2843 year: 2020 ident: ref_23 article-title: No Differences in Hip Joint Space Measurements Between Weightbearing or Supine Anteroposterior Pelvic Radiographs publication-title: Arthroscopy doi: 10.1016/j.arthro.2020.07.009 |
SSID | ssj0002873298 |
Score | 2.2686346 |
Snippet | Minimal joint space width (mJSW) is a radiographic measurement used in the diagnosis of hip osteoarthritis. A large variance when measuring mJSW highlights the... |
SourceID | doaj unpaywall crossref |
SourceType | Open Website Open Access Repository Enrichment Source Index Database |
StartPage | 714 |
SubjectTerms | artificial intelligence deep learning minimal joint space width osteoarthritis radiology X-ray |
SummonAdditionalLinks | – databaseName: Unpaywall dbid: UNPAY link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnZ1ba9swFMdFlz6MPXQb21hKN_SwVzW-SJYNheKOlayQMtjCsodhdHNrmtohdVrSl_ZD7BPuk-wc2wldoVCKX4zx8U1H0vnLRz8R8skY5FpJyQQ3lmEEzZT1OAuMn3PryYBLnI08Oo6GY340EZMNsreaC4NplSDFi6aRDiIZMtBu0SCEjUeDmc33L7txJKSICOhNefKMbEb4e6lHNsfH39JfuJ7cyrJN3glB2Q_a-ewdjxQZyNB6ozz8r0dqwP0vyPNFOVPLKzWd3ultDl-S36vnbJNMznYXtd411_cQjk99kVdkqwtDadr6zWuy4co35GZUlMU5HB4WM3pUFWVNv4OkdvRnYetTOmqHEy2tSjphc7W8oHpJVdlcpQVR0K93CJ80nZ5U86I-Pf97-yelmLG4pFVOMQu6pYOjtaUpSP5mkPItGR9--fF5yLoFGphBSjyzOs-heYwSg8JLRdYXsCeSOLQi0Z4BLcQxh9EIB4GoklLBh_DDWKhAmYBH4TvSK6vSvSc0dtJ6DuI551nuS618F8g4N0JLqcFp-kSuCikzHb0cF9GYZqBisHizh4q3T_y15awleDzC5gD9YH0-MribA9X8JOuqdKZD7WJQ-CBwA55bnng5xFtSIxTRSOn3SbD2okffefspRjukV88X7gOER7X-2NWCf93IEwg priority: 102 providerName: Unpaywall |
Title | Minimal Hip Joint Space Width Measured on X-rays by an Artificial Intelligence Algorithm—A Study of Reliability and Agreement |
URI | https://www.mdpi.com/2673-7426/3/3/46/pdf?version=1693539749 https://doaj.org/article/b3be833844824fd490f0787b0359c771 |
UnpaywallVersion | publishedVersion |
Volume | 3 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
journalDatabaseRights | – providerCode: PRVAON databaseName: DOAJ: Directory of Open Access Journal (DOAJ) customDbUrl: eissn: 2673-7426 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0002873298 issn: 2673-7426 databaseCode: DOA dateStart: 20210101 isFulltext: true titleUrlDefault: https://www.doaj.org/ providerName: Directory of Open Access Journals – providerCode: PRVEBS databaseName: EBSCOhost Academic Search Ultimate customDbUrl: https://search.ebscohost.com/login.aspx?authtype=ip,shib&custid=s3936755&profile=ehost&defaultdb=asn eissn: 2673-7426 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0002873298 issn: 2673-7426 databaseCode: ABDBF dateStart: 20220601 isFulltext: true titleUrlDefault: https://search.ebscohost.com/direct.asp?db=asn providerName: EBSCOhost – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources (ISSN International Center) customDbUrl: eissn: 2673-7426 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0002873298 issn: 2673-7426 databaseCode: M~E dateStart: 20210101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3NTttAEF5VcCg9IFBbEShoD1wt7PXaax-dQhSQgpDaqOnJ2j-DUWJHwQjlRB-iT8iTMOM1UXpAcOjNXnm8q5nRznyr2W8IOdYaea2E8CKujYcZtCeNzz2mg4IbXzAu8Dby6DIejvnFJJqstfrCmjBHD-wUd6JCZRPAUQAjGC8MT_0CoppQSD2nRXt7nEEYWwNTt-2RkQhZmrjSnRBw_Ym7zd6xkSIDMuzdCA7_iUctbf8n8vG-msvlg5xO12LNYIdsd0kizdzidskHW30mj6OyKmcwPCzn9KIuq4b-AMBr6a_SNDd05A77DK0rOvEWcnlH1ZLKqv2Lo4mg52v8mzSbXteLsrmZPf35m1GsJ1zSuqBYo-y4u1Ha0AwAeXuE-IWMB2c_vw-9rn2Cp5HD3TOqKGDzilONsEjGJojgKUqT0ESp8jUgFY4VhjqykCZKISSLAbImkWRSMx6HX8lGVVd2j9DECuNbyLasb3gglAwsE0mhIyWEApP2iHhRYq47bnFscTHNAWOg-vPX1N8jwUpy7vg13iHTRzutvkeG7HYA_Cbv_CZ_y296hK2s_O6Z9__HzAdkC3vWu0K1b2SjWdzbQ8hsGnVENrP-aX9w1DozvI0vr7Lfz4QV_OE |
linkProvider | Directory of Open Access Journals |
linkToUnpaywall | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnZ1ba9swFMdFlz6MPXQb21hKN_SwVzW-SJYNheKOlayQMtjCsodhdHNrmtohdVrSl_ZD7BPuk-wc2wldoVCKX4zx8U1H0vnLRz8R8skY5FpJyQQ3lmEEzZT1OAuMn3PryYBLnI08Oo6GY340EZMNsreaC4NplSDFi6aRDiIZMtBu0SCEjUeDmc33L7txJKSICOhNefKMbEb4e6lHNsfH39JfuJ7cyrJN3glB2Q_a-ewdjxQZyNB6ozz8r0dqwP0vyPNFOVPLKzWd3ultDl-S36vnbJNMznYXtd411_cQjk99kVdkqwtDadr6zWuy4co35GZUlMU5HB4WM3pUFWVNv4OkdvRnYetTOmqHEy2tSjphc7W8oHpJVdlcpQVR0K93CJ80nZ5U86I-Pf97-yelmLG4pFVOMQu6pYOjtaUpSP5mkPItGR9--fF5yLoFGphBSjyzOs-heYwSg8JLRdYXsCeSOLQi0Z4BLcQxh9EIB4GoklLBh_DDWKhAmYBH4TvSK6vSvSc0dtJ6DuI551nuS618F8g4N0JLqcFp-kSuCikzHb0cF9GYZqBisHizh4q3T_y15awleDzC5gD9YH0-MribA9X8JOuqdKZD7WJQ-CBwA55bnng5xFtSIxTRSOn3SbD2okffefspRjukV88X7gOER7X-2NWCf93IEwg |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Minimal+Hip+Joint+Space+Width+Measured+on+X-rays+by+an+Artificial+Intelligence+Algorithm%E2%80%94A+Study+of+Reliability+and+Agreement&rft.jtitle=BioMedInformatics&rft.au=Anne+Mathilde+Andersen&rft.au=Benjamin+S.+B.+Rasmussen&rft.au=Ole+Graumann&rft.au=S%C3%B8ren+Overgaard&rft.date=2023-09-01&rft.pub=MDPI+AG&rft.eissn=2673-7426&rft.volume=3&rft.issue=3&rft.spage=714&rft.epage=723&rft_id=info:doi/10.3390%2Fbiomedinformatics3030046&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_b3be833844824fd490f0787b0359c771 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2673-7426&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2673-7426&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2673-7426&client=summon |