Using natural language processing to identify opioid use disorder in electronic health record data

•NLP methods can identify OUD cases in unstructured EHR data.•Use of NLP can identify OUD cases that would be missed by ICD-10-CM codes alone.•NLP should be considered for epidemiological studies involving EHR data.•NLP methods can be implemented using open source tools such as Python. As opioid pre...

Full description

Saved in:
Bibliographic Details
Published inInternational journal of medical informatics (Shannon, Ireland) Vol. 170; p. 104963
Main Authors Singleton, Jade, Li, Chengxi, Akpunonu, Peter D., Abner, Erin L., Kucharska-Newton, Anna M.
Format Journal Article
LanguageEnglish
Published Ireland Elsevier B.V 01.02.2023
Subjects
Online AccessGet full text
ISSN1386-5056
1872-8243
1872-8243
DOI10.1016/j.ijmedinf.2022.104963

Cover

Abstract •NLP methods can identify OUD cases in unstructured EHR data.•Use of NLP can identify OUD cases that would be missed by ICD-10-CM codes alone.•NLP should be considered for epidemiological studies involving EHR data.•NLP methods can be implemented using open source tools such as Python. As opioid prescriptions have risen, there has also been an increase in opioid use disorder (OUD) and its adverse outcomes. Accurate and complete epidemiologic surveillance of OUD, to inform prevention strategies, presents challenges. The objective of this study was to ascertain prevalence of OUD using two methods to identify OUD in electronic health records (EHR): applying natural language processing (NLP) for text mining of unstructured clinical notes and using ICD-10-CM diagnostic codes. Data were drawn from EHR records for hospital and emergency department patient visits to a large regional academic medical center from 2017 to 2019. International Classification of Disease, 10th Edition, Clinic Modification (ICD-10-CM) discharge codes were extracted for each visit. To develop the rule-based NLP algorithm, a stepwise process was used. First, a small sample of visits from 2017 was used to develop initial dictionaries. Next, EHR corresponding to 30,124 visits from 2018 were used to develop and evaluate the rule-based algorithm. A random sample of the results were manually reviewed to identify and address shortcomings in the algorithm, and to estimate sensitivity and specificity of the two methods of ascertainment. Last, the final algorithm was then applied to 29,212 visits from 2019 to estimate OUD prevalence. While there was substantial overlap in the identified records (n = 1,381 [59.2 %]), overall n = 2,332 unique visits were identified. Of the total unique visits, 430 (18.4 %) were identified only by ICD-10-CM codes, and 521 (22.3 %) were identified only by NLP. The prevalence of visits with evidence of an OUD diagnosis in this sample, ascertained using only ICD-10-CM codes, was 1,811/29,212 (6.1 %). Including the additional 521 visits identified only by NLP, the estimated prevalence of OUD is 2,332/29,212 (7.9 %), an increase of 29.5 % compared to the use of ICD-10-CM codes alone. The estimated sensitivity and specificity of the NLP-based OUD classification were 81.8 % and 97.5 %, respectively, relative to gold-standard manual review by an expert addiction medicine physician. NLP-based algorithms can automate data extraction and identify evidence of opioid use disorder from unstructured electronic healthcare records. The most complete ascertainment of OUD in EHR was combined NLP with ICD-10-CM codes. NLP should be considered for epidemiological studies involving EHR data.
AbstractList •NLP methods can identify OUD cases in unstructured EHR data.•Use of NLP can identify OUD cases that would be missed by ICD-10-CM codes alone.•NLP should be considered for epidemiological studies involving EHR data.•NLP methods can be implemented using open source tools such as Python. As opioid prescriptions have risen, there has also been an increase in opioid use disorder (OUD) and its adverse outcomes. Accurate and complete epidemiologic surveillance of OUD, to inform prevention strategies, presents challenges. The objective of this study was to ascertain prevalence of OUD using two methods to identify OUD in electronic health records (EHR): applying natural language processing (NLP) for text mining of unstructured clinical notes and using ICD-10-CM diagnostic codes. Data were drawn from EHR records for hospital and emergency department patient visits to a large regional academic medical center from 2017 to 2019. International Classification of Disease, 10th Edition, Clinic Modification (ICD-10-CM) discharge codes were extracted for each visit. To develop the rule-based NLP algorithm, a stepwise process was used. First, a small sample of visits from 2017 was used to develop initial dictionaries. Next, EHR corresponding to 30,124 visits from 2018 were used to develop and evaluate the rule-based algorithm. A random sample of the results were manually reviewed to identify and address shortcomings in the algorithm, and to estimate sensitivity and specificity of the two methods of ascertainment. Last, the final algorithm was then applied to 29,212 visits from 2019 to estimate OUD prevalence. While there was substantial overlap in the identified records (n = 1,381 [59.2 %]), overall n = 2,332 unique visits were identified. Of the total unique visits, 430 (18.4 %) were identified only by ICD-10-CM codes, and 521 (22.3 %) were identified only by NLP. The prevalence of visits with evidence of an OUD diagnosis in this sample, ascertained using only ICD-10-CM codes, was 1,811/29,212 (6.1 %). Including the additional 521 visits identified only by NLP, the estimated prevalence of OUD is 2,332/29,212 (7.9 %), an increase of 29.5 % compared to the use of ICD-10-CM codes alone. The estimated sensitivity and specificity of the NLP-based OUD classification were 81.8 % and 97.5 %, respectively, relative to gold-standard manual review by an expert addiction medicine physician. NLP-based algorithms can automate data extraction and identify evidence of opioid use disorder from unstructured electronic healthcare records. The most complete ascertainment of OUD in EHR was combined NLP with ICD-10-CM codes. NLP should be considered for epidemiological studies involving EHR data.
As opioid prescriptions have risen, there has also been an increase in opioid use disorder (OUD) and its adverse outcomes. Accurate and complete epidemiologic surveillance of OUD, to inform prevention strategies, presents challenges. The objective of this study was to ascertain prevalence of OUD using two methods to identify OUD in electronic health records (EHR): applying natural language processing (NLP) for text mining of unstructured clinical notes and using ICD-10-CM diagnostic codes.BACKGROUNDAs opioid prescriptions have risen, there has also been an increase in opioid use disorder (OUD) and its adverse outcomes. Accurate and complete epidemiologic surveillance of OUD, to inform prevention strategies, presents challenges. The objective of this study was to ascertain prevalence of OUD using two methods to identify OUD in electronic health records (EHR): applying natural language processing (NLP) for text mining of unstructured clinical notes and using ICD-10-CM diagnostic codes.Data were drawn from EHR records for hospital and emergency department patient visits to a large regional academic medical center from 2017 to 2019. International Classification of Disease, 10th Edition, Clinic Modification (ICD-10-CM) discharge codes were extracted for each visit. To develop the rule-based NLP algorithm, a stepwise process was used. First, a small sample of visits from 2017 was used to develop initial dictionaries. Next, EHR corresponding to 30,124 visits from 2018 were used to develop and evaluate the rule-based algorithm. A random sample of the results were manually reviewed to identify and address shortcomings in the algorithm, and to estimate sensitivity and specificity of the two methods of ascertainment. Last, the final algorithm was then applied to 29,212 visits from 2019 to estimate OUD prevalence.METHODSData were drawn from EHR records for hospital and emergency department patient visits to a large regional academic medical center from 2017 to 2019. International Classification of Disease, 10th Edition, Clinic Modification (ICD-10-CM) discharge codes were extracted for each visit. To develop the rule-based NLP algorithm, a stepwise process was used. First, a small sample of visits from 2017 was used to develop initial dictionaries. Next, EHR corresponding to 30,124 visits from 2018 were used to develop and evaluate the rule-based algorithm. A random sample of the results were manually reviewed to identify and address shortcomings in the algorithm, and to estimate sensitivity and specificity of the two methods of ascertainment. Last, the final algorithm was then applied to 29,212 visits from 2019 to estimate OUD prevalence.While there was substantial overlap in the identified records (n = 1,381 [59.2 %]), overall n = 2,332 unique visits were identified. Of the total unique visits, 430 (18.4 %) were identified only by ICD-10-CM codes, and 521 (22.3 %) were identified only by NLP. The prevalence of visits with evidence of an OUD diagnosis in this sample, ascertained using only ICD-10-CM codes, was 1,811/29,212 (6.1 %). Including the additional 521 visits identified only by NLP, the estimated prevalence of OUD is 2,332/29,212 (7.9 %), an increase of 29.5 % compared to the use of ICD-10-CM codes alone. The estimated sensitivity and specificity of the NLP-based OUD classification were 81.8 % and 97.5 %, respectively, relative to gold-standard manual review by an expert addiction medicine physician.RESULTSWhile there was substantial overlap in the identified records (n = 1,381 [59.2 %]), overall n = 2,332 unique visits were identified. Of the total unique visits, 430 (18.4 %) were identified only by ICD-10-CM codes, and 521 (22.3 %) were identified only by NLP. The prevalence of visits with evidence of an OUD diagnosis in this sample, ascertained using only ICD-10-CM codes, was 1,811/29,212 (6.1 %). Including the additional 521 visits identified only by NLP, the estimated prevalence of OUD is 2,332/29,212 (7.9 %), an increase of 29.5 % compared to the use of ICD-10-CM codes alone. The estimated sensitivity and specificity of the NLP-based OUD classification were 81.8 % and 97.5 %, respectively, relative to gold-standard manual review by an expert addiction medicine physician.NLP-based algorithms can automate data extraction and identify evidence of opioid use disorder from unstructured electronic healthcare records. The most complete ascertainment of OUD in EHR was combined NLP with ICD-10-CM codes. NLP should be considered for epidemiological studies involving EHR data.CONCLUSIONNLP-based algorithms can automate data extraction and identify evidence of opioid use disorder from unstructured electronic healthcare records. The most complete ascertainment of OUD in EHR was combined NLP with ICD-10-CM codes. NLP should be considered for epidemiological studies involving EHR data.
As opioid prescriptions have risen, there has also been an increase in opioid use disorder (OUD) and its adverse outcomes. Accurate and complete epidemiologic surveillance of OUD, to inform prevention strategies, presents challenges. The objective of this study was to ascertain prevalence of OUD using two methods to identify OUD in electronic health records (EHR): applying natural language processing (NLP) for text mining of unstructured clinical notes and using ICD-10-CM diagnostic codes. Data were drawn from EHR records for hospital and emergency department patient visits to a large regional academic medical center from 2017 to 2019. International Classification of Disease, 10th Edition, Clinic Modification (ICD-10-CM) discharge codes were extracted for each visit. To develop the rule-based NLP algorithm, a stepwise process was used. First, a small sample of visits from 2017 was used to develop initial dictionaries. Next, EHR corresponding to 30,124 visits from 2018 were used to develop and evaluate the rule-based algorithm. A random sample of the results were manually reviewed to identify and address shortcomings in the algorithm, and to estimate sensitivity and specificity of the two methods of ascertainment. Last, the final algorithm was then applied to 29,212 visits from 2019 to estimate OUD prevalence. While there was substantial overlap in the identified records (n = 1,381 [59.2 %]), overall n = 2,332 unique visits were identified. Of the total unique visits, 430 (18.4 %) were identified only by ICD-10-CM codes, and 521 (22.3 %) were identified only by NLP. The prevalence of visits with evidence of an OUD diagnosis in this sample, ascertained using only ICD-10-CM codes, was 1,811/29,212 (6.1 %). Including the additional 521 visits identified only by NLP, the estimated prevalence of OUD is 2,332/29,212 (7.9 %), an increase of 29.5 % compared to the use of ICD-10-CM codes alone. The estimated sensitivity and specificity of the NLP-based OUD classification were 81.8 % and 97.5 %, respectively, relative to gold-standard manual review by an expert addiction medicine physician. NLP-based algorithms can automate data extraction and identify evidence of opioid use disorder from unstructured electronic healthcare records. The most complete ascertainment of OUD in EHR was combined NLP with ICD-10-CM codes. NLP should be considered for epidemiological studies involving EHR data.
ArticleNumber 104963
Author Li, Chengxi
Akpunonu, Peter D.
Singleton, Jade
Abner, Erin L.
Kucharska-Newton, Anna M.
Author_xml – sequence: 1
  givenname: Jade
  surname: Singleton
  fullname: Singleton, Jade
  email: jade.singleton@seattlechildrens.org
  organization: Department of Epidemiology, College of Public Health, University of Kentucky, Lexington, KY 40536, United States
– sequence: 2
  givenname: Chengxi
  surname: Li
  fullname: Li, Chengxi
  organization: Department of Computer Science, College of Engineering, University of Kentucky, Lexington, KY 40526, United States
– sequence: 3
  givenname: Peter D.
  surname: Akpunonu
  fullname: Akpunonu, Peter D.
  organization: Emergency Medicine & Medical Toxicology, University of Kentucky Hospital, Lexington, KY 40536, United States
– sequence: 4
  givenname: Erin L.
  surname: Abner
  fullname: Abner, Erin L.
  organization: Department of Epidemiology, College of Public Health, University of Kentucky, Lexington, KY 40536, United States
– sequence: 5
  givenname: Anna M.
  surname: Kucharska-Newton
  fullname: Kucharska-Newton, Anna M.
  organization: Department of Epidemiology, College of Public Health, University of Kentucky, Lexington, KY 40536, United States
BackLink https://www.ncbi.nlm.nih.gov/pubmed/36521420$$D View this record in MEDLINE/PubMed
BookMark eNqNkUtv3CAUhVGVqnn-hYhlN57yMNiWqqpV1JcUKZtmjTC-ntwpA1PAkebfl2SSLrJJVyDud46455ySoxADEHLJ2Yozrj9sVrjZwoRhXgkmRH1sBy3fkBPed6LpRSuP6l32ulFM6WNymvOGMd4x1b4jx1IrwVvBTsh4mzGsabBlSdZTb8N6sWuguxQd5MdZiRQnCAXnPY07jDjRJQOdMMc0QaIYKHhwJcWAjt6B9eWOJnB1Sidb7Dl5O1uf4eLpPCO3377-uvrRXN98_3n15bpxrZClcUo71k1Wj51qbS_qHjA6YLNi_QjaTZzDIHk722EcrRAzF8ClawfruB6clmfk_cG3_v3PArmYLWYHvu4EcclGdEqpTqphqOjlE7qMNUWzS7i1aW-ec6mAPgAuxZwTzP8QzsxDAWZjngswDwWYQwFV-PGF0GGxBWMoyaJ_Xf75IIca1D1CMtkhBFfJmmgxU8TXLT69sHAeazPW_4b9_xj8BZ69vBo
CitedBy_id crossref_primary_10_1177_10442073241228838
crossref_primary_10_1002_cpt_2864
crossref_primary_10_1002_lrh2_10445
crossref_primary_10_2196_53366
crossref_primary_10_3390_biomedinformatics4020062
crossref_primary_10_1007_s11916_024_01319_2
crossref_primary_10_2196_54449
crossref_primary_10_1097_YCO_0000000000000870
crossref_primary_10_1097_ADM_0000000000001276
crossref_primary_10_1002_emp2_13106
crossref_primary_10_1111_inm_70003
crossref_primary_10_1177_10442073241304108
crossref_primary_10_3390_healthcare12070799
Cites_doi 10.1111/pme.12768
10.1016/j.ijmedinf.2017.09.008
10.1016/j.jbi.2017.11.011
10.21037/apm.2020.03.04
10.2196/12239
10.1111/j.1475-6773.2005.00444.x
10.2196/15794
10.14745/ccdr.v46i06a02
10.1001/jamanetworkopen.2020.15909
10.2196/17984
10.1159/000065122
10.1136/amiajnl-2011-000464
10.1177/14604582221107808
10.1136/injuryprev-2021-SAVIR.81
10.5455/aim.2008.16.159-161
10.1186/s13326-019-0213-5
10.1093/jamia/ocv180
10.1038/s41372-021-00965-3
10.1111/j.1475-6773.2007.00822.x
10.1093/jamia/ocz040
10.1016/j.ijmedinf.2015.09.002
10.23970/AHRQEPCREGISTRIES3ADDENDUM2
ContentType Journal Article
Copyright 2022
Copyright © 2022. Published by Elsevier B.V.
Copyright_xml – notice: 2022
– notice: Copyright © 2022. Published by Elsevier B.V.
DBID AAYXX
CITATION
CGR
CUY
CVF
ECM
EIF
NPM
7X8
DOI 10.1016/j.ijmedinf.2022.104963
DatabaseName CrossRef
Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
MEDLINE - Academic
DatabaseTitle CrossRef
MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
MEDLINE - Academic
DatabaseTitleList
MEDLINE - Academic

MEDLINE
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: EIF
  name: MEDLINE
  url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search
  sourceTypes: Index Database
DeliveryMethod fulltext_linktorsrc
Discipline Medicine
EISSN 1872-8243
ExternalDocumentID 36521420
10_1016_j_ijmedinf_2022_104963
S1386505622002775
Genre Journal Article
GroupedDBID ---
--K
--M
-~X
.1-
.FO
.GJ
.~1
0R~
1B1
1P~
1RT
1~.
1~5
29J
4.4
457
4G.
53G
5GY
5VS
7-5
71M
8P~
AABNK
AAEDT
AAEDW
AAIKJ
AAKOC
AALRI
AAOAW
AAQFI
AAQXK
AATTM
AAWTL
AAXKI
AAXUO
AAYFN
AAYWO
ABBOA
ABBQC
ABDPE
ABFNM
ABJNI
ABMAC
ABMZM
ABWVN
ABXDB
ACDAQ
ACGFS
ACIEU
ACIUM
ACJTP
ACLOT
ACNNM
ACRLP
ACRPL
ACVFH
ACZNC
ADBBV
ADCNI
ADEZE
ADJOM
ADMUD
ADNMO
AEBSH
AEIPS
AEKER
AENEX
AEUPX
AEVXI
AFJKZ
AFPUW
AFRHN
AFTJW
AFXBA
AFXIZ
AGHFR
AGQPQ
AGUBO
AGYEJ
AHZHX
AIALX
AIEXJ
AIGII
AIIUN
AIKHN
AITUG
AJRQY
AJUYK
AKBMS
AKRWK
AKYEP
ALMA_UNASSIGNED_HOLDINGS
AMRAJ
ANKPU
ANZVX
AOUOD
APXCP
ASPBG
AVWKF
AXJTR
AZFZN
BKOJK
BLXMC
BNPGV
CS3
DU5
EBS
EFJIC
EFKBS
EFLBG
EJD
EO8
EO9
EP2
EP3
F5P
FDB
FEDTE
FGOYB
FIRID
FNPLU
FYGXN
G-Q
GBLVA
GBOLZ
HVGLF
HZ~
IHE
J1W
KOM
M41
MO0
N9A
O-L
O9-
OAUVE
OZT
P-8
P-9
P2P
PC.
Q38
R2-
ROL
RPZ
SCC
SDF
SDG
SDP
SEL
SES
SEW
SNG
SPC
SPCBC
SSH
SSV
SSZ
T5K
UHS
Z5R
~G-
~HD
AACTN
AFCTW
AFKWA
AJOXV
AMFUW
RIG
AAYXX
CITATION
AGCQF
AGRNS
CGR
CUY
CVF
ECM
EIF
NPM
7X8
ID FETCH-LOGICAL-c423t-c56c07da6b754a82872ebce0f508be6cd11e9314fa9bba22f12e13c49ac169c63
IEDL.DBID .~1
ISSN 1386-5056
1872-8243
IngestDate Thu Oct 02 06:38:10 EDT 2025
Mon Jul 21 06:03:16 EDT 2025
Thu Apr 24 23:12:50 EDT 2025
Wed Oct 29 21:14:53 EDT 2025
Tue Dec 03 03:44:27 EST 2024
Tue Oct 14 19:33:54 EDT 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Keywords Opioid use disorder
Natural language processing
Electronic healthcare records
Language English
License Copyright © 2022. Published by Elsevier B.V.
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c423t-c56c07da6b754a82872ebce0f508be6cd11e9314fa9bba22f12e13c49ac169c63
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
PMID 36521420
PQID 2755573599
PQPubID 23479
ParticipantIDs proquest_miscellaneous_2755573599
pubmed_primary_36521420
crossref_primary_10_1016_j_ijmedinf_2022_104963
crossref_citationtrail_10_1016_j_ijmedinf_2022_104963
elsevier_sciencedirect_doi_10_1016_j_ijmedinf_2022_104963
elsevier_clinicalkey_doi_10_1016_j_ijmedinf_2022_104963
PublicationCentury 2000
PublicationDate February 2023
2023-02-00
20230201
PublicationDateYYYYMMDD 2023-02-01
PublicationDate_xml – month: 02
  year: 2023
  text: February 2023
PublicationDecade 2020
PublicationPlace Ireland
PublicationPlace_xml – name: Ireland
PublicationTitle International journal of medical informatics (Shannon, Ireland)
PublicationTitleAlternate Int J Med Inform
PublicationYear 2023
Publisher Elsevier B.V
Publisher_xml – name: Elsevier B.V
References Spasic, Nenadic (b0120) 2020; 8
E.T, Sholle, L.C, Pinheiro, P, Adekkanattu, M.A, Davila, S.B, Johnson, J, Pathak, S, Sinha, C, Li, S.A, Lubansky, M.M, Safford, T.R, Campion Underserved populations with missing race ethnicity data differ significantly from those with structured race/ethnicity documentation 2019.
Chartash, Paek, Dziura, Ross, Nogee, Boccio, Hines, Schott, Jeffery, Patel, Platts-Mills, Ahmed, Brandt, Couturier, Melnick (b0020) 2019; 7
S.I, Ranapurwala, I, Alam, M, Clark, T, Carey, P.R, Chelminski, B, Pence, J, Korte, W, L-T, M, Wolfson, S, Christensen, M, Capata, H, Douglas, L, Greenblat, L, Bowlby, J, Spangler, S, Marshall. LIMITATIONS OF OPIOID USE DISORDER (OUD) ICD CODES: DEVELOPMENT AND VALIDATION OF A NEW OUD IDENTIFICATION ALGORITHM IN ELECTRONIC MEDICAL RECORDS.
10 2021 2-3.
Beam, Lee, Hirst, Beam, Parad (b0010) 2021; 41
Ford, Carroll, Smith, Scott, Cassell (b0025) 2016; 23
O'Malley, Cook, Price, Wildes, Hurdle, Ashton (b0070) 2005; 40
2019 DOI
79:45128-34.
26:722-729.
Carrell, Cronkite, Palmer, Saunders, Gross, Masters, Hylan, Von Korff (b0015) 2015; 84
Kurbasic, Pandza, Masic, Huseinagic, Tandir, Alicajic, Toromanovic (b0045) 2008; 16
Pendergrass, Crawford (b0085) 2019; 100
Sheikhalishahi, Miotto, Dudley, Lavelli, Rinaldi, Osmani (b0105) 2019; 7
Zhu, Lenert, Barth, Simpson, Li, Kopscik, Brady (b0140) 2022; 28
Kirson, Shei, Rice, Enloe, Bodnar, Birnbaum, Holly, Ben-Joseph (b0040) 2015; 16
Mezzich (b0055) 2002; 35
Baclic, Tunis, Young, Doan, Swerdfeger, Schonfeld (b0005) 2020; 46
Meystre, Savova, Kipper-Schuler, Hurdle (b0050) 2008; 173
Wang, Wang, Rastegar-Mojarad, Moon, Shen, Afzal, Liu, Zeng, Mehrabi, Sohn, Liu (b0130) 2018; 77
Nadkarni, Ohno-Machado, Chapman (b0060) 2011; 18
Smart, Kase, Taylor, Lumsden, Smith, Stein (b0115) 2020; 17
Palumbo, Adamson, Krishnamurthy, Manoharan, Beiler, Seiwell, Young, Metpally, Crist, Doyle, Ferraro, Li, Berrettini, Robishaw, Troiani (b0080) 2020; 3
Piotrkowicz, Johnson, Hall (b0090) 2019; 10
.
Kaye, Jones, Kaye, Ripoll, Galan, Beakley, Calixto, Bolden, Urman, Manchikanti (b0035) 2017; 20
Vest, Grannis, Haut, Halverson, Menachemi (b0125) 2017; 107
Office of the Secretary, H. 2014. Administrative Simplification: Change to the Compliance Date for the International Classification of Diseases, 10th Revision (ICD-10-CM and ICD-10-PCS) Medical Data Code Sets. Final rule.
Quan, Li, Saunders, Parsons, Nilsson, Alibhai, Ghali, Investigators (b0095) 2008; 43
Neoplasms. 2021. C00-D49
Wong, Cheung (b0135) 2020; 9
R.E, Gliklich, M.B, Leavy, N.A, Dreyer. . Tools and Technologies for Registry Interoperability, Registries for Evaluating Patient Outcomes A User’s Guide, 3rd Edition, Addendum 2.
Carrell (10.1016/j.ijmedinf.2022.104963_b0015) 2015; 84
O'Malley (10.1016/j.ijmedinf.2022.104963_b0070) 2005; 40
Vest (10.1016/j.ijmedinf.2022.104963_b0125) 2017; 107
Baclic (10.1016/j.ijmedinf.2022.104963_b0005) 2020; 46
Wang (10.1016/j.ijmedinf.2022.104963_b0130) 2018; 77
Quan (10.1016/j.ijmedinf.2022.104963_b0095) 2008; 43
Wong (10.1016/j.ijmedinf.2022.104963_b0135) 2020; 9
Meystre (10.1016/j.ijmedinf.2022.104963_b0050) 2008; 173
Smart (10.1016/j.ijmedinf.2022.104963_b0115) 2020; 17
Kirson (10.1016/j.ijmedinf.2022.104963_b0040) 2015; 16
Palumbo (10.1016/j.ijmedinf.2022.104963_b0080) 2020; 3
Piotrkowicz (10.1016/j.ijmedinf.2022.104963_b0090) 2019; 10
Kurbasic (10.1016/j.ijmedinf.2022.104963_b0045) 2008; 16
Beam (10.1016/j.ijmedinf.2022.104963_b0010) 2021; 41
10.1016/j.ijmedinf.2022.104963_b0100
10.1016/j.ijmedinf.2022.104963_b0065
Zhu (10.1016/j.ijmedinf.2022.104963_b0140) 2022; 28
Chartash (10.1016/j.ijmedinf.2022.104963_b0020) 2019; 7
Spasic (10.1016/j.ijmedinf.2022.104963_b0120) 2020; 8
Sheikhalishahi (10.1016/j.ijmedinf.2022.104963_b0105) 2019; 7
Ford (10.1016/j.ijmedinf.2022.104963_b0025) 2016; 23
Mezzich (10.1016/j.ijmedinf.2022.104963_b0055) 2002; 35
Kaye (10.1016/j.ijmedinf.2022.104963_b0035) 2017; 20
Nadkarni (10.1016/j.ijmedinf.2022.104963_b0060) 2011; 18
10.1016/j.ijmedinf.2022.104963_b0110
Pendergrass (10.1016/j.ijmedinf.2022.104963_b0085) 2019; 100
10.1016/j.ijmedinf.2022.104963_b0075
10.1016/j.ijmedinf.2022.104963_b0030
References_xml – volume: 84
  start-page: 1057
  year: 2015
  end-page: 1064
  ident: b0015
  article-title: Using natural language processing to identify problem usage of prescription opioids
  publication-title: Int. J. Med. Inf.
– reference: . 26:722-729.
– volume: 77
  start-page: 34
  year: 2018
  end-page: 49
  ident: b0130
  article-title: Clinical information extraction applications: A literature review
  publication-title: J. Biomed. Inform.
– volume: 173
  start-page: 128
  year: 2008
  end-page: 145
  ident: b0050
  article-title: Extracting Information from Textual Documents in the electronic health record A review of recent research
  publication-title: IMIA Yearbook of Med. Informatics.
– volume: 41
  start-page: 764
  year: 2021
  end-page: 771
  ident: b0010
  article-title: Specificity of International Classification of Diseases codes for bronchopulmonary dysplasia: an investigation using electronic health record data and a large insurance database
  publication-title: J. Perinatol.
– volume: 16
  start-page: 159
  year: 2008
  end-page: 161
  ident: b0045
  article-title: The advantages and limitations of international classification of diseases, injuries and causes of death from aspect of existing health care system of bosnia and herzegovina
  publication-title: Acta. Inform Med.
– reference: 2019 DOI:
– volume: 100
  start-page: 1
  year: 2019
  end-page: 28
  ident: b0085
  article-title: Using electronic health records to generate phenotypes for research
  publication-title: Curr. Protoc. Hum. Genet.
– volume: 7
  start-page: 1
  year: 2019
  end-page: 8
  ident: b0105
  article-title: Natural language processing of clinical notes on chronic diseases: systematic review
  publication-title: JMIR Med. Inform.
– volume: 20
  start-page: 111
  year: 2017
  end-page: 133
  ident: b0035
  article-title: Prescription opioid abuse in chronic pain an updated review of opioid abuse predictors and strategies to curb opioid abuse Part1
  publication-title: Pain Physician
– volume: 18
  start-page: 544
  year: 2011
  end-page: 551
  ident: b0060
  article-title: Natural language processing: an introduction
  publication-title: J. Am. Med. Inform. Assoc.
– reference: S.I, Ranapurwala, I, Alam, M, Clark, T, Carey, P.R, Chelminski, B, Pence, J, Korte, W, L-T, M, Wolfson, S, Christensen, M, Capata, H, Douglas, L, Greenblat, L, Bowlby, J, Spangler, S, Marshall. LIMITATIONS OF OPIOID USE DISORDER (OUD) ICD CODES: DEVELOPMENT AND VALIDATION OF A NEW OUD IDENTIFICATION ALGORITHM IN ELECTRONIC MEDICAL RECORDS.
– reference: 79:45128-34.
– volume: 3
  start-page: 1
  year: 2020
  end-page: 12
  ident: b0080
  article-title: Assessment of probable opioid use disorder using electronic health record documentation
  publication-title: JAMA Netw. Open
– reference: Office of the Secretary, H. 2014. Administrative Simplification: Change to the Compliance Date for the International Classification of Diseases, 10th Revision (ICD-10-CM and ICD-10-PCS) Medical Data Code Sets. Final rule.
– reference: R.E, Gliklich, M.B, Leavy, N.A, Dreyer. . Tools and Technologies for Registry Interoperability, Registries for Evaluating Patient Outcomes A User’s Guide, 3rd Edition, Addendum 2.
– volume: 8
  start-page: 1
  year: 2020
  end-page: 19
  ident: b0120
  article-title: Clinical Text Data in Machine Learning: Systematic Review
  publication-title: JMIR Med. Inform.
– volume: 43
  start-page: 1424
  year: 2008
  end-page: 1441
  ident: b0095
  article-title: Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database
  publication-title: Health Serv. Res.
– reference: E.T, Sholle, L.C, Pinheiro, P, Adekkanattu, M.A, Davila, S.B, Johnson, J, Pathak, S, Sinha, C, Li, S.A, Lubansky, M.M, Safford, T.R, Campion Underserved populations with missing race ethnicity data differ significantly from those with structured race/ethnicity documentation 2019.
– volume: 40
  start-page: 1620
  year: 2005
  end-page: 1639
  ident: b0070
  article-title: Measuring diagnoses: ICD code accuracy
  publication-title: Health Serv. Res.
– volume: 23
  start-page: 1007
  year: 2016
  end-page: 1015
  ident: b0025
  article-title: Extracting information from the text of electronic medical records to improve case detection: a systematic review
  publication-title: J. Am. Med. Inform. Assoc.
– reference: . 10 2021 2-3.
– volume: 17
  start-page: 1
  year: 2020
  end-page: 14
  ident: b0115
  article-title: Strengths and weaknesses of existing data sources to support research to address the opioids crisis
  publication-title: Prev. Med. Rep.
– reference: .
– volume: 46
  start-page: 161
  year: 2020
  end-page: 168
  ident: b0005
  article-title: Challenges and opportunities for public health made possible by advances in natural language processing
  publication-title: Can. Commun. Dis. Rep.
– volume: 9
  start-page: 558
  year: 2020
  end-page: 570
  ident: b0135
  article-title: Optimization of opioid utility in cancer pain populations
  publication-title: Ann. Palliat. Med.
– reference: Neoplasms. 2021. C00-D49:
– volume: 28
  start-page: 1
  year: 2022
  end-page: 17
  ident: b0140
  article-title: Automatically identifying opioid use disorder in non-cancer patients on chronic opioid therapy
  publication-title: Health Informatics J.
– volume: 7
  start-page: 1
  year: 2019
  end-page: 10
  ident: b0020
  article-title: Identifying opioid use disorder in the emergency department: multi-system electronic health record-based computable phenotype derivation and validation study
  publication-title: JMIR Med. Inform.
– volume: 16
  start-page: 1325
  year: 2015
  end-page: 1332
  ident: b0040
  article-title: The Burden of Undiagnosed Opioid Abuse Among commercially Insured Individuals
  publication-title: Pain Med.
– volume: 10
  start-page: 21
  year: 2019
  end-page: 29
  ident: b0090
  article-title: Finding relevant free-text radiology reports at scale with IBM Watson Content Analytics: a feasibility study in the UK NHS
  publication-title: J. Biomed. Semantics.
– volume: 107
  start-page: 101
  year: 2017
  end-page: 106
  ident: b0125
  article-title: Using structured and unstructured data to identify patients' need for services that address the social determinants of health
  publication-title: Int. J. Med. Inf.
– volume: 35
  start-page: 72
  year: 2002
  end-page: 75
  ident: b0055
  article-title: International Surveys on the Use of ICD-10 and Related Diagnostic Systems
  publication-title: Psychopathology
– volume: 16
  start-page: 1325
  issue: 7
  year: 2015
  ident: 10.1016/j.ijmedinf.2022.104963_b0040
  article-title: The Burden of Undiagnosed Opioid Abuse Among commercially Insured Individuals
  publication-title: Pain Med.
  doi: 10.1111/pme.12768
– volume: 173
  start-page: 128
  year: 2008
  ident: 10.1016/j.ijmedinf.2022.104963_b0050
  article-title: Extracting Information from Textual Documents in the electronic health record A review of recent research
  publication-title: IMIA Yearbook of Med. Informatics.
– volume: 100
  start-page: 1
  year: 2019
  ident: 10.1016/j.ijmedinf.2022.104963_b0085
  article-title: Using electronic health records to generate phenotypes for research
  publication-title: Curr. Protoc. Hum. Genet.
– volume: 107
  start-page: 101
  year: 2017
  ident: 10.1016/j.ijmedinf.2022.104963_b0125
  article-title: Using structured and unstructured data to identify patients' need for services that address the social determinants of health
  publication-title: Int. J. Med. Inf.
  doi: 10.1016/j.ijmedinf.2017.09.008
– volume: 77
  start-page: 34
  year: 2018
  ident: 10.1016/j.ijmedinf.2022.104963_b0130
  article-title: Clinical information extraction applications: A literature review
  publication-title: J. Biomed. Inform.
  doi: 10.1016/j.jbi.2017.11.011
– volume: 9
  start-page: 558
  issue: 2
  year: 2020
  ident: 10.1016/j.ijmedinf.2022.104963_b0135
  article-title: Optimization of opioid utility in cancer pain populations
  publication-title: Ann. Palliat. Med.
  doi: 10.21037/apm.2020.03.04
– volume: 7
  start-page: 1
  year: 2019
  ident: 10.1016/j.ijmedinf.2022.104963_b0105
  article-title: Natural language processing of clinical notes on chronic diseases: systematic review
  publication-title: JMIR Med. Inform.
  doi: 10.2196/12239
– volume: 20
  start-page: 111
  year: 2017
  ident: 10.1016/j.ijmedinf.2022.104963_b0035
  article-title: Prescription opioid abuse in chronic pain an updated review of opioid abuse predictors and strategies to curb opioid abuse Part1
  publication-title: Pain Physician
– volume: 40
  start-page: 1620
  issue: 5p2
  year: 2005
  ident: 10.1016/j.ijmedinf.2022.104963_b0070
  article-title: Measuring diagnoses: ICD code accuracy
  publication-title: Health Serv. Res.
  doi: 10.1111/j.1475-6773.2005.00444.x
– volume: 7
  start-page: 1
  year: 2019
  ident: 10.1016/j.ijmedinf.2022.104963_b0020
  article-title: Identifying opioid use disorder in the emergency department: multi-system electronic health record-based computable phenotype derivation and validation study
  publication-title: JMIR Med. Inform.
  doi: 10.2196/15794
– volume: 46
  start-page: 161
  year: 2020
  ident: 10.1016/j.ijmedinf.2022.104963_b0005
  article-title: Challenges and opportunities for public health made possible by advances in natural language processing
  publication-title: Can. Commun. Dis. Rep.
  doi: 10.14745/ccdr.v46i06a02
– volume: 3
  start-page: 1
  year: 2020
  ident: 10.1016/j.ijmedinf.2022.104963_b0080
  article-title: Assessment of probable opioid use disorder using electronic health record documentation
  publication-title: JAMA Netw. Open
  doi: 10.1001/jamanetworkopen.2020.15909
– volume: 8
  start-page: 1
  year: 2020
  ident: 10.1016/j.ijmedinf.2022.104963_b0120
  article-title: Clinical Text Data in Machine Learning: Systematic Review
  publication-title: JMIR Med. Inform.
  doi: 10.2196/17984
– volume: 35
  start-page: 72
  year: 2002
  ident: 10.1016/j.ijmedinf.2022.104963_b0055
  article-title: International Surveys on the Use of ICD-10 and Related Diagnostic Systems
  publication-title: Psychopathology
  doi: 10.1159/000065122
– volume: 18
  start-page: 544
  issue: 5
  year: 2011
  ident: 10.1016/j.ijmedinf.2022.104963_b0060
  article-title: Natural language processing: an introduction
  publication-title: J. Am. Med. Inform. Assoc.
  doi: 10.1136/amiajnl-2011-000464
– volume: 28
  start-page: 1
  year: 2022
  ident: 10.1016/j.ijmedinf.2022.104963_b0140
  article-title: Automatically identifying opioid use disorder in non-cancer patients on chronic opioid therapy
  publication-title: Health Informatics J.
  doi: 10.1177/14604582221107808
– ident: 10.1016/j.ijmedinf.2022.104963_b0100
  doi: 10.1136/injuryprev-2021-SAVIR.81
– ident: 10.1016/j.ijmedinf.2022.104963_b0075
– volume: 16
  start-page: 159
  year: 2008
  ident: 10.1016/j.ijmedinf.2022.104963_b0045
  article-title: The advantages and limitations of international classification of diseases, injuries and causes of death from aspect of existing health care system of bosnia and herzegovina
  publication-title: Acta. Inform Med.
  doi: 10.5455/aim.2008.16.159-161
– volume: 10
  start-page: 21
  year: 2019
  ident: 10.1016/j.ijmedinf.2022.104963_b0090
  article-title: Finding relevant free-text radiology reports at scale with IBM Watson Content Analytics: a feasibility study in the UK NHS
  publication-title: J. Biomed. Semantics.
  doi: 10.1186/s13326-019-0213-5
– volume: 23
  start-page: 1007
  year: 2016
  ident: 10.1016/j.ijmedinf.2022.104963_b0025
  article-title: Extracting information from the text of electronic medical records to improve case detection: a systematic review
  publication-title: J. Am. Med. Inform. Assoc.
  doi: 10.1093/jamia/ocv180
– volume: 41
  start-page: 764
  issue: 4
  year: 2021
  ident: 10.1016/j.ijmedinf.2022.104963_b0010
  article-title: Specificity of International Classification of Diseases codes for bronchopulmonary dysplasia: an investigation using electronic health record data and a large insurance database
  publication-title: J. Perinatol.
  doi: 10.1038/s41372-021-00965-3
– volume: 43
  start-page: 1424
  year: 2008
  ident: 10.1016/j.ijmedinf.2022.104963_b0095
  article-title: Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database
  publication-title: Health Serv. Res.
  doi: 10.1111/j.1475-6773.2007.00822.x
– ident: 10.1016/j.ijmedinf.2022.104963_b0110
  doi: 10.1093/jamia/ocz040
– volume: 17
  start-page: 1
  year: 2020
  ident: 10.1016/j.ijmedinf.2022.104963_b0115
  article-title: Strengths and weaknesses of existing data sources to support research to address the opioids crisis
  publication-title: Prev. Med. Rep.
– volume: 84
  start-page: 1057
  issue: 12
  year: 2015
  ident: 10.1016/j.ijmedinf.2022.104963_b0015
  article-title: Using natural language processing to identify problem usage of prescription opioids
  publication-title: Int. J. Med. Inf.
  doi: 10.1016/j.ijmedinf.2015.09.002
– ident: 10.1016/j.ijmedinf.2022.104963_b0030
  doi: 10.23970/AHRQEPCREGISTRIES3ADDENDUM2
– ident: 10.1016/j.ijmedinf.2022.104963_b0065
SSID ssj0017054
Score 2.4695385
Snippet •NLP methods can identify OUD cases in unstructured EHR data.•Use of NLP can identify OUD cases that would be missed by ICD-10-CM codes alone.•NLP should be...
As opioid prescriptions have risen, there has also been an increase in opioid use disorder (OUD) and its adverse outcomes. Accurate and complete epidemiologic...
SourceID proquest
pubmed
crossref
elsevier
SourceType Aggregation Database
Index Database
Enrichment Source
Publisher
StartPage 104963
SubjectTerms Algorithms
Analgesics, Opioid
Electronic Health Records
Electronic healthcare records
Humans
Natural Language Processing
Opioid use disorder
Opioid-Related Disorders - diagnosis
Opioid-Related Disorders - epidemiology
Title Using natural language processing to identify opioid use disorder in electronic health record data
URI https://www.clinicalkey.com/#!/content/1-s2.0-S1386505622002775
https://dx.doi.org/10.1016/j.ijmedinf.2022.104963
https://www.ncbi.nlm.nih.gov/pubmed/36521420
https://www.proquest.com/docview/2755573599
Volume 170
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVESC
  databaseName: Baden-Württemberg Complete Freedom Collection (Elsevier)
  customDbUrl:
  eissn: 1872-8243
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0017054
  issn: 1386-5056
  databaseCode: GBLVA
  dateStart: 20110101
  isFulltext: true
  titleUrlDefault: https://www.sciencedirect.com
  providerName: Elsevier
– providerCode: PRVESC
  databaseName: Elsevier ScienceDirect
  customDbUrl:
  eissn: 1872-8243
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0017054
  issn: 1386-5056
  databaseCode: .~1
  dateStart: 19970301
  isFulltext: true
  titleUrlDefault: https://www.sciencedirect.com
  providerName: Elsevier
– providerCode: PRVESC
  databaseName: Elsevier SD Complete Freedom Collection [SCCMFC]
  customDbUrl:
  eissn: 1872-8243
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0017054
  issn: 1386-5056
  databaseCode: ACRLP
  dateStart: 19970301
  isFulltext: true
  titleUrlDefault: https://www.sciencedirect.com
  providerName: Elsevier
– providerCode: PRVESC
  databaseName: ScienceDirect Freedom Collection Journals
  customDbUrl:
  eissn: 1872-8243
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0017054
  issn: 1386-5056
  databaseCode: AIKHN
  dateStart: 19970301
  isFulltext: true
  titleUrlDefault: https://www.sciencedirect.com
  providerName: Elsevier
– providerCode: PRVLSH
  databaseName: Elsevier Journals
  customDbUrl:
  mediaType: online
  eissn: 1872-8243
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0017054
  issn: 1386-5056
  databaseCode: AKRWK
  dateStart: 19970301
  isFulltext: true
  providerName: Library Specific Holdings
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LS8QwEA6LgngR364vInit26Z5bI6yKOtjRXyAt5CkKXSRdtHdgxd_u5mmXfUgCp4KbYa20-nMkJnvG4SObayNzVPp_zSaR5RbF2li-lHfepOmiaZ5zd05uuHDR3r5xJ46aNBiYaCtsvH9wafX3ro502u02ZsURe8-gXGVEL-hz0AIAJpTKmCKwcn7vM0D2GLCYNs-j2D1F5Tw-KQYQwW7BCpPQqDcKXn6U4D6KQGtA9H5KlppMkh8Gh5yDXVcuY6WRk2NfAOZugsA14ydfl27IYknARIA16YVLmqAbv6Gq0lRFRmevTqcNUycuCjx53gcHKCSOGznYGgp3USP52cPg2HUTFKIrE-XppFl3MYi09wIRjVw3BNnrItzn54Zx22WJE6mCc21NEYTkifEJamlUtuES8vTLbRQVqXbQdjFlBpiMuuYpSbmUrtcMC9AnRGOkS5irfqUbWjGYdrFs2r7ycaqVbsCtaug9i7qzeUmgWjjVwnRfh3Vwki941M-FvwqKeeS34ztT7JHrSEo_ydCeUWXrpq9KiIYYyJlUnbRdrCQ-ZuknAG3Xbz7jzvvoWWYdR9axvfRwvRl5g58RjQ1h7XJH6LF08Hd9S0cL66GNx8VGg4A
linkProvider Elsevier
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LT9wwEB4BlQoXRF-wPIor9Ro2cfxYHxEqWijLpSBxs2zHkbJCyYrdPXDht-OJk6U9ICpxixKPkkwmMyPPN98A_HSpsa7MVfjTWJkw4XxiqB0lIxdMmmWGlS135-RajG_Z5R2_W4OzvhcGYZWd748-vfXW3Zlhp83hrKqGfzIcV4nxG3EGUvJ1-MB4OAhGffK0wnkgXUycbDsSCS7_q014elJNsYRdI5cnpVjvVCJ_LUK9loG2keh8B7a7FJKcxqf8BGu-_gwfJ12R_AvYFgZAWsrOsK7fkSSz2BOA1xYNqdoO3fKRNLOqqQqynHtSdFScpKrJy3wcEnslSdzPIYgp_Qq3579uzsZJN0ohcSFfWiSOC5fKwggrOTNIck-9dT4tQ35mvXBFlnmVZ6w0ylpDaZlRn-WOKeMyoZzIv8FG3dR-D4hPGbPUFs5zx2wqlPGl5EGAeSs9pwPgvfq063jGcdzFve4BZVPdq12j2nVU-wCGK7lZZNp4U0L2X0f3faTB8-kQDN6UVCvJf6ztv2R_9Iagw6-I9RVT-2Y511RyzmXOlRrAbrSQ1ZvkgiO5Xbr_jjsfw-b4ZnKlry6ufx_AFg6-j_jxQ9hYPCz9UUiPFvZ7a_7PxB8OAA
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Using+natural+language+processing+to+identify+opioid+use+disorder+in+electronic+health+record+data&rft.jtitle=International+journal+of+medical+informatics+%28Shannon%2C+Ireland%29&rft.au=Singleton%2C+Jade&rft.au=Li%2C+Chengxi&rft.au=Akpunonu%2C+Peter+D.&rft.au=Abner%2C+Erin+L.&rft.date=2023-02-01&rft.pub=Elsevier+B.V&rft.issn=1386-5056&rft.volume=170&rft_id=info:doi/10.1016%2Fj.ijmedinf.2022.104963&rft.externalDocID=S1386505622002775
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1386-5056&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1386-5056&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1386-5056&client=summon