Got CER? Educating Pharmacists for Practice in the Future: New Tools for New Challenges

Understanding how treatments work in the real world and in real patients is an important and complex task. In recent years, comparative effectiveness research (CER) studies have become more available for health care providers to inform evidence-based decision making. There is variability in the stre...

Full description

Saved in:
Bibliographic Details
Published inJournal of managed care & specialty pharmacy Vol. 22; no. 6; pp. 609 - 616
Main Authors Perfetto, Eleanor M., Anyanwu, Chinenye, Pickering, Matthew K., Zaghab, Roxanne Ward, Graff, Jennifer S., Eichelberger, Bernadette
Format Journal Article
LanguageEnglish
Published United States Academy of Managed Care Pharmacy 01.06.2016
Subjects
Online AccessGet full text
ISSN2376-0540
2376-1032
DOI10.18553/jmcp.2016.22.6.609

Cover

Abstract Understanding how treatments work in the real world and in real patients is an important and complex task. In recent years, comparative effectiveness research (CER) studies have become more available for health care providers to inform evidence-based decision making. There is variability in the strengths and limitations of this new evidence, and researchers and decision makers are faced with challenges when assessing the quality of these new methods and CER studies. To (a) describe an online tool developed by the CER Collaborative, composed of the Academy of Managed Care Pharmacy, the International Society for Pharmacoeconomics and Outcomes Research, and the National Pharmaceutical Council, and (b) provide an early evaluation of the training program impact on learners' self-reported abilities to evaluate and incorporate CER studies into their decision making. To encourage greater transparency, consistency, and uniformity in the development and assessment of CER studies, the CER Collaborative developed an online tool to assist researchers, new and experienced clinicians, and decision makers in producing and evaluating CER studies. A training program that supports the use of the online tool was developed to improve the ability and confidence of individuals to apply CER study findings in their daily work. Seventy-one health care professionals enrolled in 3 separate cohorts for the training program. Upon completion, learners assessed their abilities to interpret and apply findings from CER studies by completing on online evaluation questionnaire. The first 3 cohorts of learners to complete the training program consisted of 71 current and future health care practitioners and researchers. At completion, learners indicated high confidence in their CER evidence assessment abilities (mean = 4.2). Learners reported a 27.43%-59.86% improvement in capabilities to evaluate various CER studies and identify study design flaws (mean evaluation before CER Certificate Program [CCP] scores = 1.86-3.14 and post-CCP scores = 3.92-4.24). Additionally, 63% of learners indicated that they expected to increase their use of evidence from CER studies in at least 1-2 problem decisions per month. The CER Collaborative has responded to the need for increased practitioner training to improve understanding and application of new CER studies. The CER Collaborative tool and certificate training program are innovative solutions to help decision makers meet the challenges they face in honing their skills to best incorporate credible and relevant CER evidence into their decision making. The CER Collaborative, the development of the questionnaires and web-based tool, and the development of the CER Certificate Program were supported by grants and in-kind contributions from the Academy of Managed Care Pharmacy (AMCP), the International Society for Pharmacoeconomics and Outcomes Research (ISPOR), and the National Pharmaceutical Council (NPC). The University of Maryland School of Pharmacy conducted its work under a contract with the AMCP Foundation and grant funding from the NPC. Perfetto is employed by the University of Maryland and the National Health Council and serves as assistant editor for the Journal of Managed Care & Specialty Pharmacy, consults for Avelere, and serves as a member of advisory boards for the PQA and CMTP. Pickering received support from the NPC for activities related to this research. Eichelberger is employed by the Academy of Managed Care Pharmacy. Eichelberger and Graff are with the CER Collaborative. Graff is employed by the National Pharmaceutical Council. Study concept and design were primarily contributed by Perfetto, Graff, and Eichelberger, along with Anyanwu and assisted by Pickering and Ward Zaghab. Pickering and Ward Zaghab took the lead in data collection, with assistance from the other authors, and data interpretation was performed by Perfetto, Graff, Pickering, and Ward Zaghab, with assistance from the other authors. The manuscript was written by Perfetto and Anyanwu, with assistance from the other authors, and revised by Graff, Perfetto, Anyanwu, and Pickering, assisted by Eichelberger and Ward Zaghab.
AbstractList Understanding how treatments work in the real world and in real patients is an important and complex task. In recent years, comparative effectiveness research (CER) studies have become more available for health care providers to inform evidence-based decision making. There is variability in the strengths and limitations of this new evidence, and researchers and decision makers are faced with challenges when assessing the quality of these new methods and CER studies. To (a) describe an online tool developed by the CER Collaborative, composed of the Academy of Managed Care Pharmacy, the International Society for Pharmacoeconomics and Outcomes Research, and the National Pharmaceutical Council, and (b) provide an early evaluation of the training program impact on learners' self-reported abilities to evaluate and incorporate CER studies into their decision making. To encourage greater transparency, consistency, and uniformity in the development and assessment of CER studies, the CER Collaborative developed an online tool to assist researchers, new and experienced clinicians, and decision makers in producing and evaluating CER studies. A training program that supports the use of the online tool was developed to improve the ability and confidence of individuals to apply CER study findings in their daily work. Seventy-one health care professionals enrolled in 3 separate cohorts for the training program. Upon completion, learners assessed their abilities to interpret and apply findings from CER studies by completing on online evaluation questionnaire. The first 3 cohorts of learners to complete the training program consisted of 71 current and future health care practitioners and researchers. At completion, learners indicated high confidence in their CER evidence assessment abilities (mean = 4.2). Learners reported a 27.43%-59.86% improvement in capabilities to evaluate various CER studies and identify study design flaws (mean evaluation before CER Certificate Program [CCP] scores = 1.86-3.14 and post-CCP scores = 3.92-4.24). Additionally, 63% of learners indicated that they expected to increase their use of evidence from CER studies in at least 1-2 problem decisions per month. The CER Collaborative has responded to the need for increased practitioner training to improve understanding and application of new CER studies. The CER Collaborative tool and certificate training program are innovative solutions to help decision makers meet the challenges they face in honing their skills to best incorporate credible and relevant CER evidence into their decision making. The CER Collaborative, the development of the questionnaires and web-based tool, and the development of the CER Certificate Program were supported by grants and in-kind contributions from the Academy of Managed Care Pharmacy (AMCP), the International Society for Pharmacoeconomics and Outcomes Research (ISPOR), and the National Pharmaceutical Council (NPC). The University of Maryland School of Pharmacy conducted its work under a contract with the AMCP Foundation and grant funding from the NPC. Perfetto is employed by the University of Maryland and the National Health Council and serves as assistant editor for the Journal of Managed Care & Specialty Pharmacy, consults for Avelere, and serves as a member of advisory boards for the PQA and CMTP. Pickering received support from the NPC for activities related to this research. Eichelberger is employed by the Academy of Managed Care Pharmacy. Eichelberger and Graff are with the CER Collaborative. Graff is employed by the National Pharmaceutical Council. Study concept and design were primarily contributed by Perfetto, Graff, and Eichelberger, along with Anyanwu and assisted by Pickering and Ward Zaghab. Pickering and Ward Zaghab took the lead in data collection, with assistance from the other authors, and data interpretation was performed by Perfetto, Graff, Pickering, and Ward Zaghab, with assistance from the other authors. The manuscript was written by Perfetto and Anyanwu, with assistance from the other authors, and revised by Graff, Perfetto, Anyanwu, and Pickering, assisted by Eichelberger and Ward Zaghab.
Author Perfetto, Eleanor M.
Anyanwu, Chinenye
Pickering, Matthew K.
Zaghab, Roxanne Ward
Graff, Jennifer S.
Eichelberger, Bernadette
Author_xml – sequence: 1
  givenname: Eleanor M.
  surname: Perfetto
  fullname: Perfetto, Eleanor M.
– sequence: 2
  givenname: Chinenye
  surname: Anyanwu
  fullname: Anyanwu, Chinenye
– sequence: 3
  givenname: Matthew K.
  surname: Pickering
  fullname: Pickering, Matthew K.
– sequence: 4
  givenname: Roxanne Ward
  surname: Zaghab
  fullname: Zaghab, Roxanne Ward
– sequence: 5
  givenname: Jennifer S.
  surname: Graff
  fullname: Graff, Jennifer S.
– sequence: 6
  givenname: Bernadette
  surname: Eichelberger
  fullname: Eichelberger, Bernadette
BackLink https://www.ncbi.nlm.nih.gov/pubmed/27231789$$D View this record in MEDLINE/PubMed
BookMark eNp9kc1OAjEUhRuDEVSewMT0BRj7w3RaN8QQQBOixGBcNqXTgZJhSjpF49vbETDqwtW9N_ecb3HOOWhVrjIAXGGUYJ6m9Ga90duEIMwSQhKWMCROQIfQjPUwoqR12FHaR23Qres1QojQlHFMz0CbZITijIsOeJ24AIej5wEc5Tutgq2WcLZSfqO0rUMNC-fhzCsdrDbQVjCsDBzvws6bW_ho3uHcuXKvaq7hSpWlqZamvgSnhSpr0z3MC_AyHs2H973p0-RheDft6T5ioccNTjXlGud5sWCE4z7FVGiiRMoLrUihcsIZNSRLi3gZtMj7wihBicoE54pegMGeu90tNibXpgpelXLr7Ub5D-mUlb8_lV3JpXuTMSWRRU4kXP8kfFuPGUWB2Au0d3XtTSG1DTEp1wBtGUnyqxLZVCKbSiQhkslYSfTSP94j_j_XJ2r9kOA
CitedBy_id crossref_primary_10_18553_jmcp_2020_26_12_1604
crossref_primary_10_18553_jmcp_2017_16368
crossref_primary_10_1007_s40271_019_00356_z
crossref_primary_10_1017_S0266462317004408
crossref_primary_10_18553_jmcp_2021_27_1_095
crossref_primary_10_18553_jmcp_2020_26_6_696
Cites_doi 10.1016/j.semradonc.2013.09.002
10.1111/j.1524-4733.2007.00186.x
10.2217/cer.14.68
10.1016/j.jacl.2014.07.007
10.1016/j.jval.2014.01.004
10.1001/archinternmed.2010.5
10.18553/jmcp.2012.18.3.256
10.18553/jmcp.2012.18.s5-a.S19
10.1016/j.jval.2013.12.011
10.1002/pds.2100
10.18553/jmcp.2008.14.3.302
10.1016/j.jacc.2014.05.015
10.1016/j.jval.2014.01.003
ContentType Journal Article
Copyright 2016, Academy of Managed Care Pharmacy. All rights reserved. 2016
Copyright_xml – notice: 2016, Academy of Managed Care Pharmacy. All rights reserved. 2016
DBID AAYXX
CITATION
CGR
CUY
CVF
ECM
EIF
NPM
5PM
DOI 10.18553/jmcp.2016.22.6.609
DatabaseName CrossRef
Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
PubMed Central (Full Participant titles)
DatabaseTitle CrossRef
MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
DatabaseTitleList MEDLINE
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: EIF
  name: MEDLINE
  url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search
  sourceTypes: Index Database
DeliveryMethod fulltext_linktorsrc
EISSN 2376-1032
EndPage 616
ExternalDocumentID PMC10397932
27231789
10_18553_jmcp_2016_22_6_609
Genre Journal Article
GroupedDBID AAYXX
ALMA_UNASSIGNED_HOLDINGS
CITATION
FRP
RPM
CGR
CUY
CVF
ECM
EIF
NPM
5PM
ID FETCH-LOGICAL-c406t-8e15c38c1ddfb628143139c2a958fca2fad2863e275fa2fe0bd49ea932a7988a3
ISSN 2376-0540
IngestDate Thu Aug 21 18:42:04 EDT 2025
Thu Jan 02 22:52:14 EST 2025
Tue Jul 01 01:11:51 EDT 2025
Thu Apr 24 22:50:31 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 6
Language English
License This article is licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use and redistribution provided that the original author and source are credited.
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c406t-8e15c38c1ddfb628143139c2a958fca2fad2863e275fa2fe0bd49ea932a7988a3
Notes The CER Collaborative, the development of the questionnaires and web-based tool, and the development of the CER Certificate Program were supported by grants and in-kind contributions from the Academy of Managed Care Pharmacy (AMCP), the International Society for Pharmacoeconomics and Outcomes Research (ISPOR), and the National Pharmaceutical Council (NPC). The University of Maryland School of Pharmacy conducted its work under a contract with the AMCP Foundation and grant funding from the NPC. Perfetto is employed by the University of Maryland and the National Health Council and serves as assistant editor for the Journal of Managed Care & Specialty Pharmacy, consults for Avelere, and serves as a member of advisory boards for the PQA and CMTP. Pickering received support from the NPC for activities related to this research. Eichelberger is employed by the Academy of Managed Care Pharmacy. Eichelberger and Graff are with the CER Collaborative. Graff is employed by the National Pharmaceutical Council.
Study concept and design were primarily contributed by Perfetto, Graff, and Eichelberger, along with Anyanwu and assisted by Pickering and Ward Zaghab. Pickering and Ward Zaghab took the lead in data collection, with assistance from the other authors, and data interpretation was performed by Perfetto, Graff, Pickering, and Ward Zaghab, with assistance from the other authors. The manuscript was written by Perfetto and Anyanwu, with assistance from the other authors, and revised by Graff, Perfetto, Anyanwu, and Pickering, assisted by Eichelberger and Ward Zaghab.
OpenAccessLink https://pubmed.ncbi.nlm.nih.gov/PMC10397932
PMID 27231789
PageCount 8
ParticipantIDs pubmedcentral_primary_oai_pubmedcentral_nih_gov_10397932
pubmed_primary_27231789
crossref_citationtrail_10_18553_jmcp_2016_22_6_609
crossref_primary_10_18553_jmcp_2016_22_6_609
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2016-06-00
2016-Jun
20160601
PublicationDateYYYYMMDD 2016-06-01
PublicationDate_xml – month: 06
  year: 2016
  text: 2016-06-00
PublicationDecade 2010
PublicationPlace United States
PublicationPlace_xml – name: United States
PublicationTitle Journal of managed care & specialty pharmacy
PublicationTitleAlternate J Manag Care Spec Pharm
PublicationYear 2016
Publisher Academy of Managed Care Pharmacy
Publisher_xml – name: Academy of Managed Care Pharmacy
References Wang A (B1) 2012; 18
Weissman JS (B13) 2015; 4
B12
B25
Berger ML (B20) 2014; 17
B16
Meyer AM (B3) 2014; 24
Morris PB (B7) 2014; 64
Garrison LP (B4) 2007; 10
Biskupiak JE (B11) 2012; 18
Caro JJ (B22) 2014; 17
Murray MD. (B17) 2011; 20
Chambers JD (B5) 2014; 20
Slutsky JR (B2) 2010; 170
Holtorf AP (B14) 2012; 5
Jacobson TA (B8) 2014; 8
Jansen JP (B21) 2014; 17
References_xml – volume: 24
  start-page: 5
  issue: 1
  year: 2014
  ident: B3
  publication-title: Semin Radiat Oncol
  doi: 10.1016/j.semradonc.2013.09.002
– volume: 10
  start-page: 326
  issue: 5
  year: 2007
  ident: B4
  publication-title: Value Health
  doi: 10.1111/j.1524-4733.2007.00186.x
– volume: 4
  start-page: 79
  issue: 2
  year: 2015
  ident: B13
  publication-title: J Comp Eff Res
  doi: 10.2217/cer.14.68
– volume: 18
  start-page: SP71
  issue: 5
  year: 2012
  ident: B1
  publication-title: Am J Manag Care
– volume: 8
  start-page: 473
  issue: 5
  year: 2014
  ident: B8
  publication-title: J Clin Lipidol
  doi: 10.1016/j.jacl.2014.07.007
– volume: 5
  start-page: 428
  issue: 7
  year: 2012
  ident: B14
  publication-title: Am Health Drug Benefits
– volume: 17
  start-page: 157
  issue: 2
  year: 2014
  ident: B21
  publication-title: Value Health
  doi: 10.1016/j.jval.2014.01.004
– volume: 170
  start-page: 403
  issue: 5
  year: 2010
  ident: B2
  publication-title: Arch Intern Med
  doi: 10.1001/archinternmed.2010.5
– ident: B12
  doi: 10.18553/jmcp.2012.18.3.256
– volume: 18
  start-page: S19
  year: 2012
  ident: B11
  publication-title: J Manag Care Pharm
  doi: 10.18553/jmcp.2012.18.s5-a.S19
– volume: 17
  start-page: 143
  issue: 2
  year: 2014
  ident: B20
  publication-title: Value Health
  doi: 10.1016/j.jval.2013.12.011
– ident: B25
– volume: 20
  start-page: 797
  issue: 8
  year: 2011
  ident: B17
  publication-title: Pharmacoepidemiol Drug Saf
  doi: 10.1002/pds.2100
– ident: B16
  doi: 10.18553/jmcp.2008.14.3.302
– volume: 64
  start-page: 196
  issue: 2
  year: 2014
  ident: B7
  publication-title: J Am Coll Cardiol
  doi: 10.1016/j.jacc.2014.05.015
– volume: 20
  start-page: 641
  issue: 8
  year: 2014
  ident: B5
  publication-title: Am J Manag Care
– volume: 17
  start-page: 174
  issue: 2
  year: 2014
  ident: B22
  publication-title: Value Health
  doi: 10.1016/j.jval.2014.01.003
SSID ssj0002356813
Score 2.1410065
Snippet Understanding how treatments work in the real world and in real patients is an important and complex task. In recent years, comparative effectiveness research...
SourceID pubmedcentral
pubmed
crossref
SourceType Open Access Repository
Index Database
Enrichment Source
StartPage 609
SubjectTerms Certification - methods
Certification - standards
Certification - trends
Cohort Studies
Comparative Effectiveness Research - methods
Comparative Effectiveness Research - standards
Comparative Effectiveness Research - trends
Contemporary Subject
Education, Pharmacy, Continuing - methods
Education, Pharmacy, Continuing - standards
Education, Pharmacy, Continuing - trends
Forecasting
Humans
Pharmaceutical Services - standards
Pharmaceutical Services - trends
Pharmacists - standards
Pharmacists - trends
Title Got CER? Educating Pharmacists for Practice in the Future: New Tools for New Challenges
URI https://www.ncbi.nlm.nih.gov/pubmed/27231789
https://pubmed.ncbi.nlm.nih.gov/PMC10397932
Volume 22
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAQN
  databaseName: PubMed Central
  customDbUrl:
  eissn: 2376-1032
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0002356813
  issn: 2376-0540
  databaseCode: RPM
  dateStart: 20140101
  isFulltext: true
  titleUrlDefault: https://www.ncbi.nlm.nih.gov/pmc/
  providerName: National Library of Medicine
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3db9MwELfKeOEFgfgqH5Mf4KkkpE7jJLwgVLVMoEwV6rSJl8ixk61Tl05bqq38efxl3NnOR2Eg2EOjOrXr5O4X-3w5_46Q10EmR75QwhGeYs6IS3ikuO85SsJcCTNKrCT6O5J9vncw-nwUHPV6PzpRS-sqc-X3G_eV3EarcA70irtk_0OzzZ_CCfgO-oUjaBiO_6TjT6tqMJ58feNP60ANWPfPDBk1qE9TLVhGIpnXEY1TzSKCngCMbZyvVktTD0vjOrXK5R-MVhPsqjShtUbNpclfX6GPRPe7aQfbiyKvdJamwWSZixL6SNzW7bAR5dXavPEHS7fcNAibLTDUw-ZasfnIB1-alt_E8YnITFT4tYBpYnBomQFq78WQt1FWBm_ttpnE3gDuu6pF1RkNMXrHQfvSTFztOWQE7A7njHVgy2-cJaJA5_o4PZPIWDrkLmMud7nmaag6uDk_08BhIRjBocl09As59ywZ47t0GOTADLjLQs5Zx2N0auiEeKSzdDd3YMmv8Cre_X4NSE9tO9yylRoDaTt4t2MNzR-Q-xYR9KPB5EPSy8tH5BDwSAGPH2iDRtpBIwWU0RqNdFFSUCw1aHxPAX1UY1HXwlKLxcfkYDqZj_ccm7jDkWAfVk6UDwPpR3KoVJFxFoFNDgsNyUQcRIUUrBCKRdzPWRgUUMq9TI3iXIAQBdLnCf8J2SlXZf6MUM5hAR8z4QkBS__Qi1UUA2SiUMKHhapPWC2iVFpWe0yuskxxdYsiTlHEKYo4ZSzlKYi4T942jc4Nqcvfqz81Im8q1wrqk2hLGU0FJG3f_qVcnGjy9houz2_f9AW51z5KL8lOdbHOX4FpXGW75M7-LNnVCPwJAPC6Ww
linkProvider National Library of Medicine
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Got+CER%3F+Educating+Pharmacists+for+Practice+in+the+Future%3A+New+Tools+for+New+Challenges&rft.jtitle=Journal+of+managed+care+%26+specialty+pharmacy&rft.au=Perfetto%2C+Eleanor+M.&rft.au=Anyanwu%2C+Chinenye&rft.au=Pickering%2C+Matthew+K.&rft.au=Zaghab%2C+Roxanne+Ward&rft.date=2016-06-01&rft.pub=Academy+of+Managed+Care+Pharmacy&rft.issn=2376-0540&rft.eissn=2376-1032&rft.volume=22&rft.issue=6&rft_id=info:doi/10.18553%2Fjmcp.2016.22.6.609&rft_id=info%3Apmid%2F27231789&rft.externalDocID=PMC10397932
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2376-0540&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2376-0540&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2376-0540&client=summon