Minimal Hip Joint Space Width Measured on X-rays by an Artificial Intelligence Algorithm—A Study of Reliability and Agreement

Minimal joint space width (mJSW) is a radiographic measurement used in the diagnosis of hip osteoarthritis. A large variance when measuring mJSW highlights the need for a supporting diagnostic tool. This study aimed to estimate the reliability of a deep learning algorithm designed to measure the mJS...

Full description

Saved in:
Bibliographic Details
Published inBioMedInformatics Vol. 3; no. 3; pp. 714 - 723
Main Authors Andersen, Anne Mathilde, Rasmussen, Benjamin S. B., Graumann, Ole, Overgaard, Søren, Lundemann, Michael, Haubro, Martin Haagen, Varnum, Claus, Rasmussen, Janne, Jensen, Janni
Format Journal Article
LanguageEnglish
Published MDPI AG 01.09.2023
Subjects
Online AccessGet full text
ISSN2673-7426
2673-7426
DOI10.3390/biomedinformatics3030046

Cover

Abstract Minimal joint space width (mJSW) is a radiographic measurement used in the diagnosis of hip osteoarthritis. A large variance when measuring mJSW highlights the need for a supporting diagnostic tool. This study aimed to estimate the reliability of a deep learning algorithm designed to measure the mJSW in pelvic radiographs and to estimate agreement between the algorithm and orthopedic surgeons, radiologists, and a reporting radiographer. The algorithm was highly consistent when measuring mJSW with a mean difference at 0.00. Human readers, however, were subject to variance with a repeatability coefficient of up to 1.31. Statistically, although not clinically significant, differences were found between the algorithm’s and all readers’ measurements with mean measured differences ranging from −0.78 to −0.36 mm. In conclusion, the algorithm was highly reliable, and the mean measured difference between the human readers combined and the algorithm was low, i.e., −0.5 mm bilaterally. Given the consistency of the algorithm, it may be a useful tool for monitoring hip osteoarthritis.
AbstractList Minimal joint space width (mJSW) is a radiographic measurement used in the diagnosis of hip osteoarthritis. A large variance when measuring mJSW highlights the need for a supporting diagnostic tool. This study aimed to estimate the reliability of a deep learning algorithm designed to measure the mJSW in pelvic radiographs and to estimate agreement between the algorithm and orthopedic surgeons, radiologists, and a reporting radiographer. The algorithm was highly consistent when measuring mJSW with a mean difference at 0.00. Human readers, however, were subject to variance with a repeatability coefficient of up to 1.31. Statistically, although not clinically significant, differences were found between the algorithm’s and all readers’ measurements with mean measured differences ranging from −0.78 to −0.36 mm. In conclusion, the algorithm was highly reliable, and the mean measured difference between the human readers combined and the algorithm was low, i.e., −0.5 mm bilaterally. Given the consistency of the algorithm, it may be a useful tool for monitoring hip osteoarthritis.
Author Lundemann, Michael
Jensen, Janni
Haubro, Martin Haagen
Varnum, Claus
Rasmussen, Janne
Andersen, Anne Mathilde
Overgaard, Søren
Rasmussen, Benjamin S. B.
Graumann, Ole
Author_xml – sequence: 1
  givenname: Anne Mathilde
  orcidid: 0009-0005-3162-0370
  surname: Andersen
  fullname: Andersen, Anne Mathilde
– sequence: 2
  givenname: Benjamin S. B.
  orcidid: 0000-0002-7357-0755
  surname: Rasmussen
  fullname: Rasmussen, Benjamin S. B.
– sequence: 3
  givenname: Ole
  surname: Graumann
  fullname: Graumann, Ole
– sequence: 4
  givenname: Søren
  orcidid: 0000-0001-6829-4787
  surname: Overgaard
  fullname: Overgaard, Søren
– sequence: 5
  givenname: Michael
  surname: Lundemann
  fullname: Lundemann, Michael
– sequence: 6
  givenname: Martin Haagen
  surname: Haubro
  fullname: Haubro, Martin Haagen
– sequence: 7
  givenname: Claus
  surname: Varnum
  fullname: Varnum, Claus
– sequence: 8
  givenname: Janne
  surname: Rasmussen
  fullname: Rasmussen, Janne
– sequence: 9
  givenname: Janni
  surname: Jensen
  fullname: Jensen, Janni
BookMark eNqNkd9qFTEQh4NUsB77DnmB1exmd5PcCEtRe6SlYBW9W2bz53RKNjlkc5C90ofwCX0SU48UEYReZQjzfTM_5jk5CTFYQmjNXnKu2KsJ42wNBhfTDBn1whlnrO2fkNOmF7wSbdOf_FU_I2fLcscYa6TgjZKn5NsVBpzB0wvc0_cRQ6Y3e9CWfkaTb-mVheWQrKEx0C9VgnWh00oh0CFldKixkNuQrfe4s6Fgg9_FhPl2_vn9x0Bv8sGsNDr6wXqECT3me9rQYZesnW3IL8hTB36xZ3_eDfn09s3H84vq8vrd9ny4rHSjWF-ZyTljbK90W1aH3tRdqToluenUxLQUXVszyXRnmVIgBJTMNZcdNKCbtucbsj16TYS7cZ9K5rSOEXD8_RHTboQSSXs7TnyyknPZtrJpnWkVc0xIMTHeKS2KdUPU0XUIe1i_gvcPwpqN94cZ_3eYwr4-sjrFZUnWjRpz6YghJ0D_GIH8R_Do2b8AaTazBQ
CitedBy_id crossref_primary_10_1016_j_radi_2024_02_020
crossref_primary_10_3390_biomedinformatics4030109
crossref_primary_10_1016_j_radi_2024_04_020
Cites_doi 10.1177/096228029900800204
10.1016/j.joca.2014.05.017
10.1097/OPX.0000000000000513
10.1371/journal.pone.0178992
10.1016/j.jmir.2018.04.025
10.1007/s12325-016-0409-3
10.1148/radiol.2020190925
10.1007/s00256-011-1293-1
10.1007/s00198-021-06130-y
10.3390/diagnostics12112597
10.1373/clinchem.2015.246280
10.1136/ard.2003.018424
10.1177/1947603519888793
10.1080/00016470410004085
10.1007/s11999-008-0124-8
10.1016/j.jclinepi.2010.03.002
10.1016/j.jbspin.2010.10.014
10.1007/s11547-022-01476-7
10.1136/annrheumdis-2016-210815
10.1016/j.arthro.2020.07.009
ContentType Journal Article
DBID AAYXX
CITATION
ADTOC
UNPAY
DOA
DOI 10.3390/biomedinformatics3030046
DatabaseName CrossRef
Unpaywall for CDI: Periodical Content
Unpaywall
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
DatabaseTitleList CrossRef

Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ: Directory of Open Access Journal (DOAJ)
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: UNPAY
  name: Unpaywall
  url: https://proxy.k.utb.cz/login?url=https://unpaywall.org/
  sourceTypes: Open Access Repository
DeliveryMethod fulltext_linktorsrc
EISSN 2673-7426
EndPage 723
ExternalDocumentID oai_doaj_org_article_b3be833844824fd490f0787b0359c771
10.3390/biomedinformatics3030046
10_3390_biomedinformatics3030046
GroupedDBID AAYXX
ABDBF
AFZYC
ALMA_UNASSIGNED_HOLDINGS
CITATION
GROUPED_DOAJ
MODMG
M~E
ADTOC
UNPAY
ID FETCH-LOGICAL-c2906-dbffdde69c4287a6d15c425983d59b0c87541080c5e099a77a2671385a2ac2463
IEDL.DBID DOA
ISSN 2673-7426
IngestDate Wed Aug 27 01:21:07 EDT 2025
Wed Oct 01 15:56:35 EDT 2025
Tue Jul 01 03:25:48 EDT 2025
Thu Apr 24 22:54:33 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 3
Language English
License https://creativecommons.org/licenses/by/4.0
cc-by
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c2906-dbffdde69c4287a6d15c425983d59b0c87541080c5e099a77a2671385a2ac2463
ORCID 0000-0001-6829-4787
0000-0002-7357-0755
0009-0005-3162-0370
OpenAccessLink https://doaj.org/article/b3be833844824fd490f0787b0359c771
PageCount 10
ParticipantIDs doaj_primary_oai_doaj_org_article_b3be833844824fd490f0787b0359c771
unpaywall_primary_10_3390_biomedinformatics3030046
crossref_citationtrail_10_3390_biomedinformatics3030046
crossref_primary_10_3390_biomedinformatics3030046
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2023-09-01
PublicationDateYYYYMMDD 2023-09-01
PublicationDate_xml – month: 09
  year: 2023
  text: 2023-09-01
  day: 01
PublicationDecade 2020
PublicationTitle BioMedInformatics
PublicationYear 2023
Publisher MDPI AG
Publisher_xml – name: MDPI AG
References Ratzlaff (ref_19) 2014; 22
Peterlein (ref_20) 2008; 466
Troelsen (ref_5) 2012; 59
Kottner (ref_11) 2011; 64
ref_13
Abdullah (ref_3) 2022; 127
ref_10
Sakellariou (ref_7) 2017; 76
Alzyoud (ref_21) 2018; 49
ref_1
Murphy (ref_4) 2016; 33
Bland (ref_14) 1999; 8
Terjesen (ref_22) 2012; 41
Bossuyt (ref_12) 2015; 61
Carkeet (ref_15) 2015; 92
Bessa (ref_23) 2020; 36
Lequesne (ref_17) 2004; 63
Nehrer (ref_18) 2021; 13
Sohn (ref_9) 2020; 295
Ornetti (ref_16) 2011; 78
Gebre (ref_2) 2022; 33
ref_6
Jacobsen (ref_8) 2004; 75
References_xml – ident: ref_6
– volume: 8
  start-page: 135
  year: 1999
  ident: ref_14
  article-title: Measuring agreement in method comparison studies
  publication-title: Stat. Methods Med. Res.
  doi: 10.1177/096228029900800204
– volume: 22
  start-page: 1481
  year: 2014
  ident: ref_19
  article-title: Location-specific hip joint space width for progression of hip osteoarthritis--data from the osteoarthritis initiative
  publication-title: Osteoarthr. Cartil.
  doi: 10.1016/j.joca.2014.05.017
– volume: 92
  start-page: e71
  year: 2015
  ident: ref_15
  article-title: Exact parametric confidence intervals for Bland-Altman limits of agreement
  publication-title: Optom. Vis. Sci.
  doi: 10.1097/OPX.0000000000000513
– ident: ref_1
  doi: 10.1371/journal.pone.0178992
– volume: 49
  start-page: 316
  year: 2018
  ident: ref_21
  article-title: Optimum Positioning for Anteroposterior Pelvis Radiography: A Literature Review
  publication-title: J. Med. Imaging Radiat. Sci.
  doi: 10.1016/j.jmir.2018.04.025
– volume: 33
  start-page: 1921
  year: 2016
  ident: ref_4
  article-title: Hip Osteoarthritis: Etiopathogenesis and Implications for Management
  publication-title: Adv. Ther.
  doi: 10.1007/s12325-016-0409-3
– volume: 295
  start-page: 136
  year: 2020
  ident: ref_9
  article-title: Development and Validation of a Multitask Deep Learning Model for Severity Grading of Hip Osteoarthritis Features on Radiographs
  publication-title: Radiology
  doi: 10.1148/radiol.2020190925
– volume: 41
  start-page: 811
  year: 2012
  ident: ref_22
  article-title: Reliability of radiographic parameters in adults with hip dysplasia
  publication-title: Skeletal Radiol.
  doi: 10.1007/s00256-011-1293-1
– volume: 33
  start-page: 355
  year: 2022
  ident: ref_2
  article-title: Detecting hip osteoarthritis on clinical CT: A deep learning application based on 2-D summation images derived from CT
  publication-title: Osteoporos. Int.
  doi: 10.1007/s00198-021-06130-y
– volume: 59
  start-page: B4450
  year: 2012
  ident: ref_5
  article-title: Assessment of adult hip dysplasia and the outcome of surgical treatment
  publication-title: Dan. Med. J.
– ident: ref_13
  doi: 10.3390/diagnostics12112597
– ident: ref_10
– volume: 61
  start-page: 1446
  year: 2015
  ident: ref_12
  article-title: STARD 2015: An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies
  publication-title: Clin. Chem.
  doi: 10.1373/clinchem.2015.246280
– volume: 63
  start-page: 1145
  year: 2004
  ident: ref_17
  article-title: The normal hip joint space: Variations in width, shape, and architecture on 223 pelvic radiographs
  publication-title: Ann. Rheum. Dis.
  doi: 10.1136/ard.2003.018424
– volume: 13
  start-page: 957s
  year: 2021
  ident: ref_18
  article-title: Automated Knee Osteoarthritis Assessment Increases Physicians’ Agreement Rate and Accuracy: Data from the Osteoarthritis Initiative
  publication-title: Cartilage
  doi: 10.1177/1947603519888793
– volume: 75
  start-page: 713
  year: 2004
  ident: ref_8
  article-title: Radiographic case definitions and prevalence of osteoarthrosis of the hip: A survey of 4 151 subjects in the Osteoarthritis Substudy of the Copenhagen City Heart Study
  publication-title: Acta Orthop. Scand.
  doi: 10.1080/00016470410004085
– volume: 466
  start-page: 809
  year: 2008
  ident: ref_20
  article-title: Comparison of pelvic radiographs in weightbearing and supine positions
  publication-title: Clin. Orthop. Relat. Res.
  doi: 10.1007/s11999-008-0124-8
– volume: 64
  start-page: 96
  year: 2011
  ident: ref_11
  article-title: Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed
  publication-title: J. Clin. Epidemiol.
  doi: 10.1016/j.jclinepi.2010.03.002
– volume: 78
  start-page: 499
  year: 2011
  ident: ref_16
  article-title: Influence of the experience of the reader on reliability of joint space width measurement. A cross-sectional multiple reading study in hip osteoarthritis
  publication-title: Joint Bone Spine
  doi: 10.1016/j.jbspin.2010.10.014
– volume: 127
  start-page: 398
  year: 2022
  ident: ref_3
  article-title: Automatic detection and classification of knee osteoarthritis using deep learning approach
  publication-title: Radiol. Med.
  doi: 10.1007/s11547-022-01476-7
– volume: 76
  start-page: 1484
  year: 2017
  ident: ref_7
  article-title: EULAR recommendations for the use of imaging in the clinical management of peripheral joint osteoarthritis
  publication-title: Ann. Rheum. Dis.
  doi: 10.1136/annrheumdis-2016-210815
– volume: 36
  start-page: 2843
  year: 2020
  ident: ref_23
  article-title: No Differences in Hip Joint Space Measurements Between Weightbearing or Supine Anteroposterior Pelvic Radiographs
  publication-title: Arthroscopy
  doi: 10.1016/j.arthro.2020.07.009
SSID ssj0002873298
Score 2.2686346
Snippet Minimal joint space width (mJSW) is a radiographic measurement used in the diagnosis of hip osteoarthritis. A large variance when measuring mJSW highlights the...
SourceID doaj
unpaywall
crossref
SourceType Open Website
Open Access Repository
Enrichment Source
Index Database
StartPage 714
SubjectTerms artificial intelligence
deep learning
minimal joint space width
osteoarthritis
radiology
X-ray
SummonAdditionalLinks – databaseName: Unpaywall
  dbid: UNPAY
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnZ1ba9swFMdFlz6MPXQb21hKN_SwVzW-SJYNheKOlayQMtjCsodhdHNrmtohdVrSl_ZD7BPuk-wc2wldoVCKX4zx8U1H0vnLRz8R8skY5FpJyQQ3lmEEzZT1OAuMn3PryYBLnI08Oo6GY340EZMNsreaC4NplSDFi6aRDiIZMtBu0SCEjUeDmc33L7txJKSICOhNefKMbEb4e6lHNsfH39JfuJ7cyrJN3glB2Q_a-ewdjxQZyNB6ozz8r0dqwP0vyPNFOVPLKzWd3ultDl-S36vnbJNMznYXtd411_cQjk99kVdkqwtDadr6zWuy4co35GZUlMU5HB4WM3pUFWVNv4OkdvRnYetTOmqHEy2tSjphc7W8oHpJVdlcpQVR0K93CJ80nZ5U86I-Pf97-yelmLG4pFVOMQu6pYOjtaUpSP5mkPItGR9--fF5yLoFGphBSjyzOs-heYwSg8JLRdYXsCeSOLQi0Z4BLcQxh9EIB4GoklLBh_DDWKhAmYBH4TvSK6vSvSc0dtJ6DuI551nuS618F8g4N0JLqcFp-kSuCikzHb0cF9GYZqBisHizh4q3T_y15awleDzC5gD9YH0-MribA9X8JOuqdKZD7WJQ-CBwA55bnng5xFtSIxTRSOn3SbD2okffefspRjukV88X7gOER7X-2NWCf93IEwg
  priority: 102
  providerName: Unpaywall
Title Minimal Hip Joint Space Width Measured on X-rays by an Artificial Intelligence Algorithm—A Study of Reliability and Agreement
URI https://www.mdpi.com/2673-7426/3/3/46/pdf?version=1693539749
https://doaj.org/article/b3be833844824fd490f0787b0359c771
UnpaywallVersion publishedVersion
Volume 3
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAON
  databaseName: DOAJ: Directory of Open Access Journal (DOAJ)
  customDbUrl:
  eissn: 2673-7426
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0002873298
  issn: 2673-7426
  databaseCode: DOA
  dateStart: 20210101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVEBS
  databaseName: EBSCOhost Academic Search Ultimate
  customDbUrl: https://search.ebscohost.com/login.aspx?authtype=ip,shib&custid=s3936755&profile=ehost&defaultdb=asn
  eissn: 2673-7426
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0002873298
  issn: 2673-7426
  databaseCode: ABDBF
  dateStart: 20220601
  isFulltext: true
  titleUrlDefault: https://search.ebscohost.com/direct.asp?db=asn
  providerName: EBSCOhost
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources (ISSN International Center)
  customDbUrl:
  eissn: 2673-7426
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0002873298
  issn: 2673-7426
  databaseCode: M~E
  dateStart: 20210101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3NTttAEF5VcCg9IFBbEShoD1wt7PXaax-dQhSQgpDaqOnJ2j-DUWJHwQjlRB-iT8iTMOM1UXpAcOjNXnm8q5nRznyr2W8IOdYaea2E8CKujYcZtCeNzz2mg4IbXzAu8Dby6DIejvnFJJqstfrCmjBHD-wUd6JCZRPAUQAjGC8MT_0CoppQSD2nRXt7nEEYWwNTt-2RkQhZmrjSnRBw_Ym7zd6xkSIDMuzdCA7_iUctbf8n8vG-msvlg5xO12LNYIdsd0kizdzidskHW30mj6OyKmcwPCzn9KIuq4b-AMBr6a_SNDd05A77DK0rOvEWcnlH1ZLKqv2Lo4mg52v8mzSbXteLsrmZPf35m1GsJ1zSuqBYo-y4u1Ha0AwAeXuE-IWMB2c_vw-9rn2Cp5HD3TOqKGDzilONsEjGJojgKUqT0ESp8jUgFY4VhjqykCZKISSLAbImkWRSMx6HX8lGVVd2j9DECuNbyLasb3gglAwsE0mhIyWEApP2iHhRYq47bnFscTHNAWOg-vPX1N8jwUpy7vg13iHTRzutvkeG7HYA_Cbv_CZ_y296hK2s_O6Z9__HzAdkC3vWu0K1b2SjWdzbQ8hsGnVENrP-aX9w1DozvI0vr7Lfz4QV_OE
linkProvider Directory of Open Access Journals
linkToUnpaywall http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnZ1ba9swFMdFlz6MPXQb21hKN_SwVzW-SJYNheKOlayQMtjCsodhdHNrmtohdVrSl_ZD7BPuk-wc2wldoVCKX4zx8U1H0vnLRz8R8skY5FpJyQQ3lmEEzZT1OAuMn3PryYBLnI08Oo6GY340EZMNsreaC4NplSDFi6aRDiIZMtBu0SCEjUeDmc33L7txJKSICOhNefKMbEb4e6lHNsfH39JfuJ7cyrJN3glB2Q_a-ewdjxQZyNB6ozz8r0dqwP0vyPNFOVPLKzWd3ultDl-S36vnbJNMznYXtd411_cQjk99kVdkqwtDadr6zWuy4co35GZUlMU5HB4WM3pUFWVNv4OkdvRnYetTOmqHEy2tSjphc7W8oHpJVdlcpQVR0K93CJ80nZ5U86I-Pf97-yelmLG4pFVOMQu6pYOjtaUpSP5mkPItGR9--fF5yLoFGphBSjyzOs-heYwSg8JLRdYXsCeSOLQi0Z4BLcQxh9EIB4GoklLBh_DDWKhAmYBH4TvSK6vSvSc0dtJ6DuI551nuS618F8g4N0JLqcFp-kSuCikzHb0cF9GYZqBisHizh4q3T_y15awleDzC5gD9YH0-MribA9X8JOuqdKZD7WJQ-CBwA55bnng5xFtSIxTRSOn3SbD2okffefspRjukV88X7gOER7X-2NWCf93IEwg
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Minimal+Hip+Joint+Space+Width+Measured+on+X-rays+by+an+Artificial+Intelligence+Algorithm%E2%80%94A+Study+of+Reliability+and+Agreement&rft.jtitle=BioMedInformatics&rft.au=Anne+Mathilde+Andersen&rft.au=Benjamin+S.+B.+Rasmussen&rft.au=Ole+Graumann&rft.au=S%C3%B8ren+Overgaard&rft.date=2023-09-01&rft.pub=MDPI+AG&rft.eissn=2673-7426&rft.volume=3&rft.issue=3&rft.spage=714&rft.epage=723&rft_id=info:doi/10.3390%2Fbiomedinformatics3030046&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_b3be833844824fd490f0787b0359c771
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2673-7426&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2673-7426&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2673-7426&client=summon