Impacts of the Journal Evaluation Program of the Korean Association of Medical Journal Editors (KAMJE) on the Quality of the Member Journals
In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years. Quality...
Saved in:
Published in | Journal of Korean medical science Vol. 33; no. 48; pp. e305 - 5 |
---|---|
Main Authors | , , |
Format | Journal Article |
Language | English |
Published |
Korea (South)
The Korean Academy of Medical Sciences
26.11.2018
대한의학회 |
Subjects | |
Online Access | Get full text |
ISSN | 1011-8934 1598-6357 1598-6357 |
DOI | 10.3346/jkms.2018.33.e305 |
Cover
Abstract | In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years.
Quality measures used in the study comprised 3 assessment categories; self-assessment by journal editors, assessment of the journals by KAMJE reviewers, and by Korean health science librarians. Each used detailed criteria to score the journals on a scale of 0 to 5 or 6 in multiple dimensions. We compared scores at baseline evaluation and those after 7 years for 129 journals and compared improvements in journals indexed vs. not-indexed by the Web of Science (Science Citation Index Expanded; SCIE).
Among 251 KAMJE member journals at the end of 2015, 227 passed evaluation criteria and 129 (56%) had both baseline and 7-year follow-up assessment data. The journals showed improvement overall (increase in median [interquartile range; IQR] score from baseline, 0.47 [0.64]; 95% confidence interval [CI], 0.44-0.61;
< 0.001) and within each category (median [IQR] increase by editor's assessment, 0.17 [0.83]; 95% CI, 0.04-0.26;
= 0.007; by reviewer's, 0.45 [1.00]; 95% CI, 0.29-0.57;
< 0.001; by librarian's, 1.75 [1.08]; 95% CI, 1.77-2.18,
< 0.001). Before the foundation of KAMJE in 1996, there were only 5 Korean medical journals indexed in the MEDLINE and none in SCIE, but 24 journals in the MEDLINE and 34 journals in SCIE were indexed by 2016.
The KAMJE journal evaluation program successfully contributes improving the quality of the member journals. |
---|---|
AbstractList | In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years.BACKGROUNDIn 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years.Quality measures used in the study comprised 3 assessment categories; self-assessment by journal editors, assessment of the journals by KAMJE reviewers, and by Korean health science librarians. Each used detailed criteria to score the journals on a scale of 0 to 5 or 6 in multiple dimensions. We compared scores at baseline evaluation and those after 7 years for 129 journals and compared improvements in journals indexed vs. not-indexed by the Web of Science (Science Citation Index Expanded; SCIE).METHODSQuality measures used in the study comprised 3 assessment categories; self-assessment by journal editors, assessment of the journals by KAMJE reviewers, and by Korean health science librarians. Each used detailed criteria to score the journals on a scale of 0 to 5 or 6 in multiple dimensions. We compared scores at baseline evaluation and those after 7 years for 129 journals and compared improvements in journals indexed vs. not-indexed by the Web of Science (Science Citation Index Expanded; SCIE).Among 251 KAMJE member journals at the end of 2015, 227 passed evaluation criteria and 129 (56%) had both baseline and 7-year follow-up assessment data. The journals showed improvement overall (increase in median [interquartile range; IQR] score from baseline, 0.47 [0.64]; 95% confidence interval [CI], 0.44-0.61; P < 0.001) and within each category (median [IQR] increase by editor's assessment, 0.17 [0.83]; 95% CI, 0.04-0.26; P = 0.007; by reviewer's, 0.45 [1.00]; 95% CI, 0.29-0.57; P < 0.001; by librarian's, 1.75 [1.08]; 95% CI, 1.77-2.18, P < 0.001). Before the foundation of KAMJE in 1996, there were only 5 Korean medical journals indexed in the MEDLINE and none in SCIE, but 24 journals in the MEDLINE and 34 journals in SCIE were indexed by 2016.RESULTSAmong 251 KAMJE member journals at the end of 2015, 227 passed evaluation criteria and 129 (56%) had both baseline and 7-year follow-up assessment data. The journals showed improvement overall (increase in median [interquartile range; IQR] score from baseline, 0.47 [0.64]; 95% confidence interval [CI], 0.44-0.61; P < 0.001) and within each category (median [IQR] increase by editor's assessment, 0.17 [0.83]; 95% CI, 0.04-0.26; P = 0.007; by reviewer's, 0.45 [1.00]; 95% CI, 0.29-0.57; P < 0.001; by librarian's, 1.75 [1.08]; 95% CI, 1.77-2.18, P < 0.001). Before the foundation of KAMJE in 1996, there were only 5 Korean medical journals indexed in the MEDLINE and none in SCIE, but 24 journals in the MEDLINE and 34 journals in SCIE were indexed by 2016.The KAMJE journal evaluation program successfully contributes improving the quality of the member journals.CONCLUSIONThe KAMJE journal evaluation program successfully contributes improving the quality of the member journals. In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years. Quality measures used in the study comprised 3 assessment categories; self-assessment by journal editors, assessment of the journals by KAMJE reviewers, and by Korean health science librarians. Each used detailed criteria to score the journals on a scale of 0 to 5 or 6 in multiple dimensions. We compared scores at baseline evaluation and those after 7 years for 129 journals and compared improvements in journals indexed vs. not-indexed by the Web of Science (Science Citation Index Expanded; SCIE). Among 251 KAMJE member journals at the end of 2015, 227 passed evaluation criteria and 129 (56%) had both baseline and 7-year follow-up assessment data. The journals showed improvement overall (increase in median [interquartile range; IQR] score from baseline, 0.47 [0.64]; 95% confidence interval [CI], 0.44-0.61; < 0.001) and within each category (median [IQR] increase by editor's assessment, 0.17 [0.83]; 95% CI, 0.04-0.26; = 0.007; by reviewer's, 0.45 [1.00]; 95% CI, 0.29-0.57; < 0.001; by librarian's, 1.75 [1.08]; 95% CI, 1.77-2.18, < 0.001). Before the foundation of KAMJE in 1996, there were only 5 Korean medical journals indexed in the MEDLINE and none in SCIE, but 24 journals in the MEDLINE and 34 journals in SCIE were indexed by 2016. The KAMJE journal evaluation program successfully contributes improving the quality of the member journals. Background: In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation were indexed in the KoreaMed. Here, we report changes in measures of quality of the KAMJE member journals during the last 20 years. Methods: Quality measures used in the study comprised 3 assessment categories; self- assessment by journal editors, assessment of the journals by KAMJE reviewers, and by Korean health science librarians. Each used detailed criteria to score the journals on a scale of 0 to 5 or 6 in multiple dimensions. We compared scores at baseline evaluation and those after 7 years for 129 journals and compared improvements in journals indexed vs. not-indexed by the Web of Science (Science Citation Index Expanded; SCIE). Results: Among 251 KAMJE member journals at the end of 2015, 227 passed evaluation criteria and 129 (56%) had both baseline and 7-year follow-up assessment data. The journals showed improvement overall (increase in median [interquartile range; IQR] score from baseline, 0.47 [0.64]; 95% confidence interval [CI], 0.44–0.61; P < 0.001) and within each category (median [IQR] increase by editor's assessment, 0.17 [0.83]; 95% CI, 0.04–0.26; P = 0.007; by reviewer's, 0.45 [1.00]; 95% CI, 0.29–0.57; P < 0.001; by librarian's, 1.75 [1.08]; 95% CI, 1.77–2.18, P < 0.001). Before the foundation of KAMJE in 1996, there were only 5 Korean medical journals indexed in the MEDLINE and none in SCIE, but 24 journals in the MEDLINE and 34 journals in SCIE were indexed by 2016. Conclusion: The KAMJE journal evaluation program successfully contributes improving the quality of the member journals. KCI Citation Count: 0 |
Author | Yang, Hee-Jin Oh, Se Jeong Hong, Sung-Tae |
AuthorAffiliation | 2 Department of Neurosurgery, Seoul Metropolitan Government-Seoul National University Boramae Medical Center, Seoul, Korea 1 The Korean Association of Medical Journal Editors, Seoul, Korea 3 Department of Surgery, The Catholic University of Korea, Incheon St. Mary's Hospital, Incheon, Korea 4 Department of Parasitology and Tropical Medicine, Seoul National University College of Medicine, Seoul, Korea |
AuthorAffiliation_xml | – name: 3 Department of Surgery, The Catholic University of Korea, Incheon St. Mary's Hospital, Incheon, Korea – name: 4 Department of Parasitology and Tropical Medicine, Seoul National University College of Medicine, Seoul, Korea – name: 2 Department of Neurosurgery, Seoul Metropolitan Government-Seoul National University Boramae Medical Center, Seoul, Korea – name: 1 The Korean Association of Medical Journal Editors, Seoul, Korea |
Author_xml | – sequence: 1 givenname: Hee-Jin orcidid: 0000-0002-6413-1363 surname: Yang fullname: Yang, Hee-Jin organization: The Korean Association of Medical Journal Editors, Seoul, Korea., Department of Neurosurgery, Seoul Metropolitan Government-Seoul National University Boramae Medical Center, Seoul, Korea – sequence: 2 givenname: Se Jeong orcidid: 0000-0002-2583-4218 surname: Oh fullname: Oh, Se Jeong organization: The Korean Association of Medical Journal Editors, Seoul, Korea., Department of Surgery, The Catholic University of Korea, Incheon St. Mary's Hospital, Incheon, Korea – sequence: 3 givenname: Sung-Tae orcidid: 0000-0002-0300-1944 surname: Hong fullname: Hong, Sung-Tae organization: The Korean Association of Medical Journal Editors, Seoul, Korea., Department of Parasitology and Tropical Medicine, Seoul National University College of Medicine, Seoul, Korea |
BackLink | https://www.ncbi.nlm.nih.gov/pubmed/30473649$$D View this record in MEDLINE/PubMed https://www.kci.go.kr/kciportal/ci/sereArticleSearch/ciSereArtiView.kci?sereArticleSearchBean.artiId=ART002404825$$DAccess content in National Research Foundation of Korea (NRF) |
BookMark | eNp1kstu2zAQRYkiRfNoP6CbQstkIZdvS5sCRuA2TmL0gXRNUBSZMJZIl6QC5B_60aHsKGgLdDUczD33Epg5BgfOOw3AewRnhFD-8X7TxxmGqMrtTBPIXoEjxOqq5ITND_IbIlRWNaGH4DjGewgxY5i8AYcE0jnhtD4Cv1f9VqoUC2-KdKeLSz8EJ7ti-SC7QSbrXfEt-Nsg-0lx5YOWrljE6JXdK_JkrVurMvfCtzb5EIvTq8X6cnlWZNUIfx9kZ9Pj5LXWfaPDBMW34LXJRb97rifg5-flzflFef31y-p8cV0qSkgquaK6xQqhmqvWNIialjJoJGnqllNlEDYE4XlDEMOK1IhAzRvVMNpgZCSryAk42_u6YMRGWeGl3dVbLzZBLH7crASpKOUcZu2nvXY7NL1ulXYpyE5sg-1leNyRf0-cvcs-D4JjWiPOs8Hps0HwvwYdk-htVLrrpNN-iAIjUkGa08Z_ffgz6yVkWlcWzPcCFXyMQRuhbNrtIEfbTiAoxsMQ42GI8TByK8bDyCT6h5zM_888AaUrvfM |
CitedBy_id | crossref_primary_10_3346_jkms_2019_34_e184 crossref_primary_10_3340_jkns_2022_0185 |
Cites_doi | 10.3346/jkms.2014.29.2.172 10.3346/jkms.2018.33.e247 10.3346/jkms.2013.28.5.648 |
ContentType | Journal Article |
Copyright | 2018 The Korean Academy of Medical Sciences. 2018 The Korean Academy of Medical Sciences |
Copyright_xml | – notice: 2018 The Korean Academy of Medical Sciences. 2018 The Korean Academy of Medical Sciences |
DBID | AAYXX CITATION CGR CUY CVF ECM EIF NPM 7X8 5PM ACYCR |
DOI | 10.3346/jkms.2018.33.e305 |
DatabaseName | CrossRef Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed MEDLINE - Academic PubMed Central (Full Participant titles) Korean Citation Index |
DatabaseTitle | CrossRef MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) MEDLINE - Academic |
DatabaseTitleList | MEDLINE - Academic MEDLINE |
Database_xml | – sequence: 1 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: EIF name: MEDLINE url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search sourceTypes: Index Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Medicine |
EISSN | 1598-6357 |
EndPage | 5 |
ExternalDocumentID | oai_kci_go_kr_ARTI_3844660 PMC6249166 30473649 10_3346_jkms_2018_33_e305 |
Genre | Journal Article |
GeographicLocations | Republic of Korea |
GeographicLocations_xml | – name: Republic of Korea |
GrantInformation_xml | – fundername: ; |
GroupedDBID | --- 29K 2WC 3O- 5-W 53G 5GY 8JR 8XY 9ZL AAYXX ADBBV ADRAZ AENEX ALMA_UNASSIGNED_HOLDINGS AOIJS BAWUL CITATION CS3 D-I DIK DU5 E3Z EBS EF. EJD F5P FRP GROUPED_DOAJ GX1 HYE KQ8 M48 O5R O5S OK1 OVT PGMZT RNS RPM TR2 W2D XSB CGR CUY CVF ECM EIF M~E NPM 7X8 5PM 08R ACYCR |
ID | FETCH-LOGICAL-c433t-6c4ed2c1196cdfb14fd450fa3b9d64cf12f3127b3152c39130e6bcb54b21fa583 |
IEDL.DBID | M48 |
ISSN | 1011-8934 1598-6357 |
IngestDate | Tue Nov 21 21:42:52 EST 2023 Thu Aug 21 18:20:56 EDT 2025 Fri Jul 11 01:20:46 EDT 2025 Thu Jan 02 22:55:56 EST 2025 Thu Apr 24 22:50:55 EDT 2025 Tue Jul 01 01:45:00 EDT 2025 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 48 |
Keywords | KoreaMed Global Indexing Database Korean Association of Medical Journal Editors Journal Evaluation |
Language | English |
License | This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (https://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited. |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c433t-6c4ed2c1196cdfb14fd450fa3b9d64cf12f3127b3152c39130e6bcb54b21fa583 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
ORCID | 0000-0002-0300-1944 0000-0002-6413-1363 0000-0002-2583-4218 |
OpenAccessLink | http://journals.scholarsportal.info/openUrl.xqy?doi=10.3346/jkms.2018.33.e305 |
PMID | 30473649 |
PQID | 2138048448 |
PQPubID | 23479 |
PageCount | 5 |
ParticipantIDs | nrf_kci_oai_kci_go_kr_ARTI_3844660 pubmedcentral_primary_oai_pubmedcentral_nih_gov_6249166 proquest_miscellaneous_2138048448 pubmed_primary_30473649 crossref_citationtrail_10_3346_jkms_2018_33_e305 crossref_primary_10_3346_jkms_2018_33_e305 |
ProviderPackageCode | CITATION AAYXX |
PublicationCentury | 2000 |
PublicationDate | 2018-11-26 |
PublicationDateYYYYMMDD | 2018-11-26 |
PublicationDate_xml | – month: 11 year: 2018 text: 2018-11-26 day: 26 |
PublicationDecade | 2010 |
PublicationPlace | Korea (South) |
PublicationPlace_xml | – name: Korea (South) |
PublicationTitle | Journal of Korean medical science |
PublicationTitleAlternate | J Korean Med Sci |
PublicationYear | 2018 |
Publisher | The Korean Academy of Medical Sciences 대한의학회 |
Publisher_xml | – name: The Korean Academy of Medical Sciences – name: 대한의학회 |
References | 10.3346/jkms.2018.33.e305_ref5 KAMJE (10.3346/jkms.2018.33.e305_ref7) 2016 Gasparyan (10.3346/jkms.2018.33.e305_ref8) 2018; 33 Kim (10.3346/jkms.2018.33.e305_ref6) 2014; 29 10.3346/jkms.2018.33.e305_ref2 10.3346/jkms.2018.33.e305_ref4 Suh (10.3346/jkms.2018.33.e305_ref1) 2013; 28 10.3346/jkms.2018.33.e305_ref3 |
References_xml | – volume-title: Twenty-Year History of the Korean Association of Medical Journal Editors, 1996–2016 year: 2016 ident: 10.3346/jkms.2018.33.e305_ref7 – ident: 10.3346/jkms.2018.33.e305_ref5 – ident: 10.3346/jkms.2018.33.e305_ref4 – ident: 10.3346/jkms.2018.33.e305_ref2 – ident: 10.3346/jkms.2018.33.e305_ref3 – volume: 29 start-page: 172 issue: 2 year: 2014 ident: 10.3346/jkms.2018.33.e305_ref6 publication-title: J Korean Med Sci doi: 10.3346/jkms.2014.29.2.172 – volume: 33 start-page: e247 issue: 35 year: 2018 ident: 10.3346/jkms.2018.33.e305_ref8 publication-title: J Korean Med Sci doi: 10.3346/jkms.2018.33.e247 – volume: 28 start-page: 648 issue: 5 year: 2013 ident: 10.3346/jkms.2018.33.e305_ref1 publication-title: J Korean Med Sci doi: 10.3346/jkms.2013.28.5.648 |
SSID | ssj0025523 |
Score | 2.1834948 |
Snippet | In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the initial evaluation... Background: In 1997 the Korean Association of Medical Journal Editors (KAMJE) instituted a program to evaluate member journals. Journals that passed the... |
SourceID | nrf pubmedcentral proquest pubmed crossref |
SourceType | Open Website Open Access Repository Aggregation Database Index Database Enrichment Source |
StartPage | e305 |
SubjectTerms | Databases, Factual Original Peer Review Program Evaluation Publishing - statistics & numerical data Republic of Korea 의학일반 |
Title | Impacts of the Journal Evaluation Program of the Korean Association of Medical Journal Editors (KAMJE) on the Quality of the Member Journals |
URI | https://www.ncbi.nlm.nih.gov/pubmed/30473649 https://www.proquest.com/docview/2138048448 https://pubmed.ncbi.nlm.nih.gov/PMC6249166 https://www.kci.go.kr/kciportal/ci/sereArticleSearch/ciSereArtiView.kci?sereArticleSearchBean.artiId=ART002404825 |
Volume | 33 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
ispartofPNX | Journal of Korean Medical Science, 2018, 33(48), , pp.1-5 |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1La9wwEBZpAqWX0nfdpotacmgLDpYly_YhlBA2ZLNsyaELuQnrlS6b2snuBpr_0B_dGb-aDUshJyM8I2GNHjP-pG8I2WPOOl24KLQpl6HwhsM6aIrQ8kSkRWFzWZMkTb7Lk6k4PU_Ot0iX3qrtwOXG0A7zSU0Xl_u_r2-_wYQ_wIiTI0I5_4XE2yyD4r7jyGi6U8NFeJJP9KACOM9xc96esRC2adGAnJurWNumHpULv8kDvX-Q8s7OdPyMPG1dSnrYjIHnZMuVL8jjSQuavyR_RvVNyCWtPAV3j3YKw57om541p7Q6iXEFrmRJ75gO37SYzj99O8NUPfTz-HByOvxCQQqVG1aO266uicOUI53S8hWZHg9_HJ2EbRKG0AjOV6E0wtnYMJipxnrNhLciiXzBdW6lMJ7FnrM41RwcAcNz6HUntdGJ0DHzRZLx12S7rEr3llBudBrZIvJpmgkTOZ1D9Oa9d1AltJAEJOr6XJmWoRwTZVwqiFTQTArNpNBMUFRopoB87VWuGnqO_wl_AkOquZkpJNXG50Wl5gsFocNI8Qyh7SggHzs7K5hpCJ8UpatuoCrGM1jvIJ4NyJvG7n2bCF5yKfKApGsjohfABtfflLOfNZu3hACYSfnuIV_ynjzBIt6JjOUu2V4tbtwHcI5WegBhwWg8qH8tDOrh_xcQFRBI |
linkProvider | Scholars Portal |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Impacts+of+the+Journal+Evaluation+Program+of+the+Korean+Association+of+Medical+Journal+Editors+%28KAMJE%29+on+the+Quality+of+the+Member+Journals&rft.jtitle=Journal+of+Korean+medical+science&rft.au=Yang%2C+Hee-Jin&rft.au=Oh%2C+Se+Jeong&rft.au=Hong%2C+Sung-Tae&rft.date=2018-11-26&rft.issn=1011-8934&rft.eissn=1598-6357&rft.volume=33&rft.issue=48&rft_id=info:doi/10.3346%2Fjkms.2018.33.e305&rft.externalDBID=n%2Fa&rft.externalDocID=10_3346_jkms_2018_33_e305 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1011-8934&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1011-8934&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1011-8934&client=summon |