Impacts of the Journal Evaluation Program of the Korean Association of Medical Journal Editors (KAMJE) on the Quality of the Member Journals

In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years. Quality...

Full description

Saved in:
Bibliographic Details
Published inJournal of Korean medical science Vol. 33; no. 48; pp. e305 - 5
Main Authors Yang, Hee-Jin, Oh, Se Jeong, Hong, Sung-Tae
Format Journal Article
LanguageEnglish
Published Korea (South) The Korean Academy of Medical Sciences 26.11.2018
대한의학회
Subjects
Online AccessGet full text
ISSN1011-8934
1598-6357
1598-6357
DOI10.3346/jkms.2018.33.e305

Cover

Abstract In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years. Quality measures used in the study comprised 3 assessment categories; self-assessment by journal editors, assessment of the journals by KAMJE reviewers, and by Korean health science librarians. Each used detailed criteria to score the journals on a scale of 0 to 5 or 6 in multiple dimensions. We compared scores at baseline evaluation and those after 7 years for 129 journals and compared improvements in journals indexed vs. not-indexed by the Web of Science (Science Citation Index Expanded; SCIE). Among 251 KAMJE member journals at the end of 2015, 227 passed evaluation criteria and 129 (56%) had both baseline and 7-year follow-up assessment data. The journals showed improvement overall (increase in median [interquartile range; IQR] score from baseline, 0.47 [0.64]; 95% confidence interval [CI], 0.44-0.61; < 0.001) and within each category (median [IQR] increase by editor's assessment, 0.17 [0.83]; 95% CI, 0.04-0.26; = 0.007; by reviewer's, 0.45 [1.00]; 95% CI, 0.29-0.57; < 0.001; by librarian's, 1.75 [1.08]; 95% CI, 1.77-2.18, < 0.001). Before the foundation of KAMJE in 1996, there were only 5 Korean medical journals indexed in the MEDLINE and none in SCIE, but 24 journals in the MEDLINE and 34 journals in SCIE were indexed by 2016. The KAMJE journal evaluation program successfully contributes improving the quality of the member journals.
AbstractList In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years.BACKGROUNDIn 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years.Quality measures used in the study comprised 3 assessment categories; self-assessment by journal editors, assessment of the journals by KAMJE reviewers, and by Korean health science librarians. Each used detailed criteria to score the journals on a scale of 0 to 5 or 6 in multiple dimensions. We compared scores at baseline evaluation and those after 7 years for 129 journals and compared improvements in journals indexed vs. not-indexed by the Web of Science (Science Citation Index Expanded; SCIE).METHODSQuality measures used in the study comprised 3 assessment categories; self-assessment by journal editors, assessment of the journals by KAMJE reviewers, and by Korean health science librarians. Each used detailed criteria to score the journals on a scale of 0 to 5 or 6 in multiple dimensions. We compared scores at baseline evaluation and those after 7 years for 129 journals and compared improvements in journals indexed vs. not-indexed by the Web of Science (Science Citation Index Expanded; SCIE).Among 251 KAMJE member journals at the end of 2015, 227 passed evaluation criteria and 129 (56%) had both baseline and 7-year follow-up assessment data. The journals showed improvement overall (increase in median [interquartile range; IQR] score from baseline, 0.47 [0.64]; 95% confidence interval [CI], 0.44-0.61; P < 0.001) and within each category (median [IQR] increase by editor's assessment, 0.17 [0.83]; 95% CI, 0.04-0.26; P = 0.007; by reviewer's, 0.45 [1.00]; 95% CI, 0.29-0.57; P < 0.001; by librarian's, 1.75 [1.08]; 95% CI, 1.77-2.18, P < 0.001). Before the foundation of KAMJE in 1996, there were only 5 Korean medical journals indexed in the MEDLINE and none in SCIE, but 24 journals in the MEDLINE and 34 journals in SCIE were indexed by 2016.RESULTSAmong 251 KAMJE member journals at the end of 2015, 227 passed evaluation criteria and 129 (56%) had both baseline and 7-year follow-up assessment data. The journals showed improvement overall (increase in median [interquartile range; IQR] score from baseline, 0.47 [0.64]; 95% confidence interval [CI], 0.44-0.61; P < 0.001) and within each category (median [IQR] increase by editor's assessment, 0.17 [0.83]; 95% CI, 0.04-0.26; P = 0.007; by reviewer's, 0.45 [1.00]; 95% CI, 0.29-0.57; P < 0.001; by librarian's, 1.75 [1.08]; 95% CI, 1.77-2.18, P < 0.001). Before the foundation of KAMJE in 1996, there were only 5 Korean medical journals indexed in the MEDLINE and none in SCIE, but 24 journals in the MEDLINE and 34 journals in SCIE were indexed by 2016.The KAMJE journal evaluation program successfully contributes improving the quality of the member journals.CONCLUSIONThe KAMJE journal evaluation program successfully contributes improving the quality of the member journals.
In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years. Quality measures used in the study comprised 3 assessment categories; self-assessment by journal editors, assessment of the journals by KAMJE reviewers, and by Korean health science librarians. Each used detailed criteria to score the journals on a scale of 0 to 5 or 6 in multiple dimensions. We compared scores at baseline evaluation and those after 7 years for 129 journals and compared improvements in journals indexed vs. not-indexed by the Web of Science (Science Citation Index Expanded; SCIE). Among 251 KAMJE member journals at the end of 2015, 227 passed evaluation criteria and 129 (56%) had both baseline and 7-year follow-up assessment data. The journals showed improvement overall (increase in median [interquartile range; IQR] score from baseline, 0.47 [0.64]; 95% confidence interval [CI], 0.44-0.61; < 0.001) and within each category (median [IQR] increase by editor's assessment, 0.17 [0.83]; 95% CI, 0.04-0.26; = 0.007; by reviewer's, 0.45 [1.00]; 95% CI, 0.29-0.57; < 0.001; by librarian's, 1.75 [1.08]; 95% CI, 1.77-2.18, < 0.001). Before the foundation of KAMJE in 1996, there were only 5 Korean medical journals indexed in the MEDLINE and none in SCIE, but 24 journals in the MEDLINE and 34 journals in SCIE were indexed by 2016. The KAMJE journal evaluation program successfully contributes improving the quality of the member journals.
Background: In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years. Methods: Quality measures used in the study comprised 3 assessment categories; self- assessment by journal editors, assessment of the journals by KAMJE reviewers, and by Korean health science librarians. Each used detailed criteria to score the journals on a scale of 0 to 5 or 6 in multiple dimensions. We compared scores at baseline evaluation and those after 7 years for 129 journals and compared improvements in journals indexed vs. not-indexed by the Web of Science (Science Citation Index Expanded; SCIE). Results: Among 251 KAMJE member journals at the end of 2015, 227 passed evaluation criteria and 129 (56%) had both baseline and 7-year follow-up assessment data. The journals showed improvement overall (increase in median [interquartile range; IQR] score from baseline, 0.47 [0.64]; 95% confidence interval [CI], 0.44–0.61; P < 0.001) and within each category (median [IQR] increase by editor's assessment, 0.17 [0.83]; 95% CI, 0.04–0.26; P = 0.007; by reviewer's, 0.45 [1.00]; 95% CI, 0.29–0.57; P < 0.001; by librarian's, 1.75 [1.08]; 95% CI, 1.77–2.18, P < 0.001). Before the foundation of KAMJE in 1996, there were only 5 Korean medical journals indexed in the MEDLINE and none in SCIE, but 24 journals in the MEDLINE and 34 journals in SCIE were indexed by 2016. Conclusion: The KAMJE journal evaluation program successfully contributes improving the quality of the member journals. KCI Citation Count: 0
Author Yang, Hee-Jin
Oh, Se Jeong
Hong, Sung-Tae
AuthorAffiliation 2 Department of Neurosurgery, Seoul Metropolitan Government-Seoul National University Boramae Medical Center, Seoul, Korea
1 The Korean Association of Medical Journal Editors, Seoul, Korea
3 Department of Surgery, The Catholic University of Korea, Incheon St. Mary's Hospital, Incheon, Korea
4 Department of Parasitology and Tropical Medicine, Seoul National University College of Medicine, Seoul, Korea
AuthorAffiliation_xml – name: 3 Department of Surgery, The Catholic University of Korea, Incheon St. Mary's Hospital, Incheon, Korea
– name: 4 Department of Parasitology and Tropical Medicine, Seoul National University College of Medicine, Seoul, Korea
– name: 2 Department of Neurosurgery, Seoul Metropolitan Government-Seoul National University Boramae Medical Center, Seoul, Korea
– name: 1 The Korean Association of Medical Journal Editors, Seoul, Korea
Author_xml – sequence: 1
  givenname: Hee-Jin
  orcidid: 0000-0002-6413-1363
  surname: Yang
  fullname: Yang, Hee-Jin
  organization: The Korean Association of Medical Journal Editors, Seoul, Korea., Department of Neurosurgery, Seoul Metropolitan Government-Seoul National University Boramae Medical Center, Seoul, Korea
– sequence: 2
  givenname: Se Jeong
  orcidid: 0000-0002-2583-4218
  surname: Oh
  fullname: Oh, Se Jeong
  organization: The Korean Association of Medical Journal Editors, Seoul, Korea., Department of Surgery, The Catholic University of Korea, Incheon St. Mary's Hospital, Incheon, Korea
– sequence: 3
  givenname: Sung-Tae
  orcidid: 0000-0002-0300-1944
  surname: Hong
  fullname: Hong, Sung-Tae
  organization: The Korean Association of Medical Journal Editors, Seoul, Korea., Department of Parasitology and Tropical Medicine, Seoul National University College of Medicine, Seoul, Korea
BackLink https://www.ncbi.nlm.nih.gov/pubmed/30473649$$D View this record in MEDLINE/PubMed
https://www.kci.go.kr/kciportal/ci/sereArticleSearch/ciSereArtiView.kci?sereArticleSearchBean.artiId=ART002404825$$DAccess content in National Research Foundation of Korea (NRF)
BookMark eNp1kstu2zAQRYkiRfNoP6CbQstkIZdvS5sCRuA2TmL0gXRNUBSZMJZIl6QC5B_60aHsKGgLdDUczD33Epg5BgfOOw3AewRnhFD-8X7TxxmGqMrtTBPIXoEjxOqq5ITND_IbIlRWNaGH4DjGewgxY5i8AYcE0jnhtD4Cv1f9VqoUC2-KdKeLSz8EJ7ti-SC7QSbrXfEt-Nsg-0lx5YOWrljE6JXdK_JkrVurMvfCtzb5EIvTq8X6cnlWZNUIfx9kZ9Pj5LXWfaPDBMW34LXJRb97rifg5-flzflFef31y-p8cV0qSkgquaK6xQqhmqvWNIialjJoJGnqllNlEDYE4XlDEMOK1IhAzRvVMNpgZCSryAk42_u6YMRGWeGl3dVbLzZBLH7crASpKOUcZu2nvXY7NL1ulXYpyE5sg-1leNyRf0-cvcs-D4JjWiPOs8Hps0HwvwYdk-htVLrrpNN-iAIjUkGa08Z_ffgz6yVkWlcWzPcCFXyMQRuhbNrtIEfbTiAoxsMQ42GI8TByK8bDyCT6h5zM_888AaUrvfM
CitedBy_id crossref_primary_10_3346_jkms_2019_34_e184
crossref_primary_10_3340_jkns_2022_0185
Cites_doi 10.3346/jkms.2014.29.2.172
10.3346/jkms.2018.33.e247
10.3346/jkms.2013.28.5.648
ContentType Journal Article
Copyright 2018 The Korean Academy of Medical Sciences. 2018 The Korean Academy of Medical Sciences
Copyright_xml – notice: 2018 The Korean Academy of Medical Sciences. 2018 The Korean Academy of Medical Sciences
DBID AAYXX
CITATION
CGR
CUY
CVF
ECM
EIF
NPM
7X8
5PM
ACYCR
DOI 10.3346/jkms.2018.33.e305
DatabaseName CrossRef
Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
MEDLINE - Academic
PubMed Central (Full Participant titles)
Korean Citation Index
DatabaseTitle CrossRef
MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
MEDLINE - Academic
DatabaseTitleList MEDLINE - Academic
MEDLINE

Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: EIF
  name: MEDLINE
  url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search
  sourceTypes: Index Database
DeliveryMethod fulltext_linktorsrc
Discipline Medicine
EISSN 1598-6357
EndPage 5
ExternalDocumentID oai_kci_go_kr_ARTI_3844660
PMC6249166
30473649
10_3346_jkms_2018_33_e305
Genre Journal Article
GeographicLocations Republic of Korea
GeographicLocations_xml – name: Republic of Korea
GrantInformation_xml – fundername: ;
GroupedDBID ---
29K
2WC
3O-
5-W
53G
5GY
8JR
8XY
9ZL
AAYXX
ADBBV
ADRAZ
AENEX
ALMA_UNASSIGNED_HOLDINGS
AOIJS
BAWUL
CITATION
CS3
D-I
DIK
DU5
E3Z
EBS
EF.
EJD
F5P
FRP
GROUPED_DOAJ
GX1
HYE
KQ8
M48
O5R
O5S
OK1
OVT
PGMZT
RNS
RPM
TR2
W2D
XSB
CGR
CUY
CVF
ECM
EIF
M~E
NPM
7X8
5PM
08R
ACYCR
ID FETCH-LOGICAL-c433t-6c4ed2c1196cdfb14fd450fa3b9d64cf12f3127b3152c39130e6bcb54b21fa583
IEDL.DBID M48
ISSN 1011-8934
1598-6357
IngestDate Tue Nov 21 21:42:52 EST 2023
Thu Aug 21 18:20:56 EDT 2025
Fri Jul 11 01:20:46 EDT 2025
Thu Jan 02 22:55:56 EST 2025
Thu Apr 24 22:50:55 EDT 2025
Tue Jul 01 01:45:00 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 48
Keywords KoreaMed
Global Indexing Database
Korean Association of Medical Journal Editors
Journal Evaluation
Language English
License This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (https://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c433t-6c4ed2c1196cdfb14fd450fa3b9d64cf12f3127b3152c39130e6bcb54b21fa583
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ORCID 0000-0002-0300-1944
0000-0002-6413-1363
0000-0002-2583-4218
OpenAccessLink http://journals.scholarsportal.info/openUrl.xqy?doi=10.3346/jkms.2018.33.e305
PMID 30473649
PQID 2138048448
PQPubID 23479
PageCount 5
ParticipantIDs nrf_kci_oai_kci_go_kr_ARTI_3844660
pubmedcentral_primary_oai_pubmedcentral_nih_gov_6249166
proquest_miscellaneous_2138048448
pubmed_primary_30473649
crossref_citationtrail_10_3346_jkms_2018_33_e305
crossref_primary_10_3346_jkms_2018_33_e305
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2018-11-26
PublicationDateYYYYMMDD 2018-11-26
PublicationDate_xml – month: 11
  year: 2018
  text: 2018-11-26
  day: 26
PublicationDecade 2010
PublicationPlace Korea (South)
PublicationPlace_xml – name: Korea (South)
PublicationTitle Journal of Korean medical science
PublicationTitleAlternate J Korean Med Sci
PublicationYear 2018
Publisher The Korean Academy of Medical Sciences
대한의학회
Publisher_xml – name: The Korean Academy of Medical Sciences
– name: 대한의학회
References 10.3346/jkms.2018.33.e305_ref5
KAMJE (10.3346/jkms.2018.33.e305_ref7) 2016
Gasparyan (10.3346/jkms.2018.33.e305_ref8) 2018; 33
Kim (10.3346/jkms.2018.33.e305_ref6) 2014; 29
10.3346/jkms.2018.33.e305_ref2
10.3346/jkms.2018.33.e305_ref4
Suh (10.3346/jkms.2018.33.e305_ref1) 2013; 28
10.3346/jkms.2018.33.e305_ref3
References_xml – volume-title: Twenty-Year History of the Korean Association of Medical Journal Editors, 1996–2016
  year: 2016
  ident: 10.3346/jkms.2018.33.e305_ref7
– ident: 10.3346/jkms.2018.33.e305_ref5
– ident: 10.3346/jkms.2018.33.e305_ref4
– ident: 10.3346/jkms.2018.33.e305_ref2
– ident: 10.3346/jkms.2018.33.e305_ref3
– volume: 29
  start-page: 172
  issue: 2
  year: 2014
  ident: 10.3346/jkms.2018.33.e305_ref6
  publication-title: J Korean Med Sci
  doi: 10.3346/jkms.2014.29.2.172
– volume: 33
  start-page: e247
  issue: 35
  year: 2018
  ident: 10.3346/jkms.2018.33.e305_ref8
  publication-title: J Korean Med Sci
  doi: 10.3346/jkms.2018.33.e247
– volume: 28
  start-page: 648
  issue: 5
  year: 2013
  ident: 10.3346/jkms.2018.33.e305_ref1
  publication-title: J Korean Med Sci
  doi: 10.3346/jkms.2013.28.5.648
SSID ssj0025523
Score 2.1834948
Snippet In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation...
Background: In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the...
SourceID nrf
pubmedcentral
proquest
pubmed
crossref
SourceType Open Website
Open Access Repository
Aggregation Database
Index Database
Enrichment Source
StartPage e305
SubjectTerms Databases, Factual
Original
Peer Review
Program Evaluation
Publishing - statistics & numerical data
Republic of Korea
의학일반
Title Impacts of the Journal Evaluation Program of the Korean Association of Medical Journal Editors (KAMJE) on the Quality of the Member Journals
URI https://www.ncbi.nlm.nih.gov/pubmed/30473649
https://www.proquest.com/docview/2138048448
https://pubmed.ncbi.nlm.nih.gov/PMC6249166
https://www.kci.go.kr/kciportal/ci/sereArticleSearch/ciSereArtiView.kci?sereArticleSearchBean.artiId=ART002404825
Volume 33
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
ispartofPNX Journal of Korean Medical Science, 2018, 33(48), , pp.1-5
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1La9wwEBZpAqWX0nfdpotacmgLDpYly_YhlBA2ZLNsyaELuQnrlS6b2snuBpr_0B_dGb-aDUshJyM8I2GNHjP-pG8I2WPOOl24KLQpl6HwhsM6aIrQ8kSkRWFzWZMkTb7Lk6k4PU_Ot0iX3qrtwOXG0A7zSU0Xl_u_r2-_wYQ_wIiTI0I5_4XE2yyD4r7jyGi6U8NFeJJP9KACOM9xc96esRC2adGAnJurWNumHpULv8kDvX-Q8s7OdPyMPG1dSnrYjIHnZMuVL8jjSQuavyR_RvVNyCWtPAV3j3YKw57om541p7Q6iXEFrmRJ75gO37SYzj99O8NUPfTz-HByOvxCQQqVG1aO266uicOUI53S8hWZHg9_HJ2EbRKG0AjOV6E0wtnYMJipxnrNhLciiXzBdW6lMJ7FnrM41RwcAcNz6HUntdGJ0DHzRZLx12S7rEr3llBudBrZIvJpmgkTOZ1D9Oa9d1AltJAEJOr6XJmWoRwTZVwqiFTQTArNpNBMUFRopoB87VWuGnqO_wl_AkOquZkpJNXG50Wl5gsFocNI8Qyh7SggHzs7K5hpCJ8UpatuoCrGM1jvIJ4NyJvG7n2bCF5yKfKApGsjohfABtfflLOfNZu3hACYSfnuIV_ynjzBIt6JjOUu2V4tbtwHcI5WegBhwWg8qH8tDOrh_xcQFRBI
linkProvider Scholars Portal
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Impacts+of+the+Journal+Evaluation+Program+of+the+Korean+Association+of+Medical+Journal+Editors+%28KAMJE%29+on+the+Quality+of+the+Member+Journals&rft.jtitle=Journal+of+Korean+medical+science&rft.au=Yang%2C+Hee-Jin&rft.au=Oh%2C+Se+Jeong&rft.au=Hong%2C+Sung-Tae&rft.date=2018-11-26&rft.issn=1011-8934&rft.eissn=1598-6357&rft.volume=33&rft.issue=48&rft_id=info:doi/10.3346%2Fjkms.2018.33.e305&rft.externalDBID=n%2Fa&rft.externalDocID=10_3346_jkms_2018_33_e305
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1011-8934&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1011-8934&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1011-8934&client=summon