Assessing Performance and Engagement on a Computer-Based Education Platform for Pharmacy Practice

A computer-based education platform was developed using a theory-based approach to help Canadian pharmacy professionals adopt their full scope of practice. Data from the platform were used to identify factors that impacted user performance and engagement. A de-identified dataset included response da...

Full description

Saved in:
Bibliographic Details
Published inPharmacy Vol. 8; no. 1; p. 26
Main Authors Grindrod, Kelly, Morris, Katherine, Killeen, Rosemary
Format Journal Article
LanguageEnglish
Published Switzerland MDPI AG 24.02.2020
MDPI
Subjects
Online AccessGet full text
ISSN2226-4787
2226-4787
DOI10.3390/pharmacy8010026

Cover

Abstract A computer-based education platform was developed using a theory-based approach to help Canadian pharmacy professionals adopt their full scope of practice. Data from the platform were used to identify factors that impacted user performance and engagement. A de-identified dataset included response data for 21 unique modules, including quiz responses and self-reflection questions. Outcome measures included user performance (mean quiz score) and engagement (completion rate for attempted modules). Analysis of variance (ANOVA), multivariate regression modelling, and machine learning cluster analysis were used to analyze the data. Of the 5290 users, 68% were pharmacists, 11% were technicians, 13% were pharmacy students, and 8% were pharmacy technician students. Four clusters were identified separately for pharmacists and technicians. Clusters with the higher performance and engagement tended to have more users practicing in community pharmacies while the lower performing clusters tended have more internationally trained users. In the regression modelling, pharmacists performed better than technicians and students while students were more engaged (p < 0.0001). Further, internationally trained pharmacists had slightly lower scores but similar engagement compared to domestically trained pharmacists (p < 0.0001). Users demonstrated higher performance on modules related to scope of practice than on clinical topics, and were most engaged with topics directly impacting daily practice such as influenza vaccinations and new and emerging subjects such as cannabis. The cluster analysis suggests that performance and engagement with a computer-based educational platform in pharmacy may be more related to place of practice than to personal demographic factors such as age or gender.
AbstractList A computer-based education platform was developed using a theory-based approach to help Canadian pharmacy professionals adopt their full scope of practice. Data from the platform were used to identify factors that impacted user performance and engagement. A de-identified dataset included response data for 21 unique modules, including quiz responses and self-reflection questions. Outcome measures included user performance (mean quiz score) and engagement (completion rate for attempted modules). Analysis of variance (ANOVA), multivariate regression modelling, and machine learning cluster analysis were used to analyze the data. Of the 5290 users, 68% were pharmacists, 11% were technicians, 13% were pharmacy students, and 8% were pharmacy technician students. Four clusters were identified separately for pharmacists and technicians. Clusters with the higher performance and engagement tended to have more users practicing in community pharmacies while the lower performing clusters tended have more internationally trained users. In the regression modelling, pharmacists performed better than technicians and students while students were more engaged (p < 0.0001). Further, internationally trained pharmacists had slightly lower scores but similar engagement compared to domestically trained pharmacists (p < 0.0001). Users demonstrated higher performance on modules related to scope of practice than on clinical topics, and were most engaged with topics directly impacting daily practice such as influenza vaccinations and new and emerging subjects such as cannabis. The cluster analysis suggests that performance and engagement with a computer-based educational platform in pharmacy may be more related to place of practice than to personal demographic factors such as age or gender.
A computer-based education platform was developed using a theory-based approach to help Canadian pharmacy professionals adopt their full scope of practice. Data from the platform were used to identify factors that impacted user performance and engagement. A de-identified dataset included response data for 21 unique modules, including quiz responses and self-reflection questions. Outcome measures included user performance (mean quiz score) and engagement (completion rate for attempted modules). Analysis of variance (ANOVA), multivariate regression modelling, and machine learning cluster analysis were used to analyze the data. Of the 5290 users, 68% were pharmacists, 11% were technicians, 13% were pharmacy students, and 8% were pharmacy technician students. Four clusters were identified separately for pharmacists and technicians. Clusters with the higher performance and engagement tended to have more users practicing in community pharmacies while the lower performing clusters tended have more internationally trained users. In the regression modelling, pharmacists performed better than technicians and students while students were more engaged (p < 0.0001). Further, internationally trained pharmacists had slightly lower scores but similar engagement compared to domestically trained pharmacists (p < 0.0001). Users demonstrated higher performance on modules related to scope of practice than on clinical topics, and were most engaged with topics directly impacting daily practice such as influenza vaccinations and new and emerging subjects such as cannabis. The cluster analysis suggests that performance and engagement with a computer-based educational platform in pharmacy may be more related to place of practice than to personal demographic factors such as age or gender.A computer-based education platform was developed using a theory-based approach to help Canadian pharmacy professionals adopt their full scope of practice. Data from the platform were used to identify factors that impacted user performance and engagement. A de-identified dataset included response data for 21 unique modules, including quiz responses and self-reflection questions. Outcome measures included user performance (mean quiz score) and engagement (completion rate for attempted modules). Analysis of variance (ANOVA), multivariate regression modelling, and machine learning cluster analysis were used to analyze the data. Of the 5290 users, 68% were pharmacists, 11% were technicians, 13% were pharmacy students, and 8% were pharmacy technician students. Four clusters were identified separately for pharmacists and technicians. Clusters with the higher performance and engagement tended to have more users practicing in community pharmacies while the lower performing clusters tended have more internationally trained users. In the regression modelling, pharmacists performed better than technicians and students while students were more engaged (p < 0.0001). Further, internationally trained pharmacists had slightly lower scores but similar engagement compared to domestically trained pharmacists (p < 0.0001). Users demonstrated higher performance on modules related to scope of practice than on clinical topics, and were most engaged with topics directly impacting daily practice such as influenza vaccinations and new and emerging subjects such as cannabis. The cluster analysis suggests that performance and engagement with a computer-based educational platform in pharmacy may be more related to place of practice than to personal demographic factors such as age or gender.
Audience Academic
Author Morris, Katherine
Killeen, Rosemary
Grindrod, Kelly
AuthorAffiliation 2 Information and Data Management, Ontario College of Pharmacists, Toronto, ON M5R 2R4, Canada; kmorris@ocpinfo.com
1 School of Pharmacy, University of Waterloo, Waterloo, ON N2L 3G1 Canada; rosemary.killeen@uwaterloo.ca
AuthorAffiliation_xml – name: 1 School of Pharmacy, University of Waterloo, Waterloo, ON N2L 3G1 Canada; rosemary.killeen@uwaterloo.ca
– name: 2 Information and Data Management, Ontario College of Pharmacists, Toronto, ON M5R 2R4, Canada; kmorris@ocpinfo.com
Author_xml – sequence: 1
  givenname: Kelly
  orcidid: 0000-0003-1135-0391
  surname: Grindrod
  fullname: Grindrod, Kelly
– sequence: 2
  givenname: Katherine
  surname: Morris
  fullname: Morris, Katherine
– sequence: 3
  givenname: Rosemary
  orcidid: 0000-0003-4116-8283
  surname: Killeen
  fullname: Killeen, Rosemary
BackLink https://www.ncbi.nlm.nih.gov/pubmed/32102464$$D View this record in MEDLINE/PubMed
BookMark eNqNkktv1DAUhSNURB90zQ5FYsMm1K_YzgZpGJVSqRKzgLV149ykGSX2YCeg-fd4OkNpR0IiC8fKPefL8ZHPsxPnHWbZG0o-cF6Rq809hBHsVhNKCJMvsjPGmCyE0urkyf40u4xxTdJTUa7L8lV2yhklTEhxlsEiRoyxd12-wtD6BHQWc3BNfu066HBEN-Xe5ZAv_biZJwzFJ4iYxs1sYerTaDXAtHPmaclXh1D5KoCdeouvs5ctDBEvD--L7Pvn62_LL8Xd15vb5eKusEKUU1HzEivZshoptBKwbaTWSnFNrOWioZrZitS2soI32NSCEKm51VSLhmEDJb_IbvfcxsPabEI_QtgaD715-OBDZyCkQAMaXoNgtOKSKylkpTRvgWItBeWyYsomFtmzZreB7S8YhkcgJWZXvjkqP1k-7i2buR6xsam2AMOzHM8nrr83nf9pFC2pIjvA-wMg-B8zxsmMfbQ4DODQz9EwLqUUREqapO-OpGs_B5fa3alU4ikl_6o6SGfuXevTf-0OahaSs0pJxUhSvX2a-zHwnyuSBFd7gQ0-xoDtf1RRHjlsPz1clRSgH_7p-w3hCuGS
CitedBy_id crossref_primary_10_1109_ACCESS_2021_3100890
crossref_primary_10_1186_s12909_022_03310_0
crossref_primary_10_1016_j_cptl_2021_09_022
crossref_primary_10_3390_su132111960
Cites_doi 10.1007/s11096-007-9114-2
10.3928/00989134-20090401-08
10.1006/ceps.1999.1020
10.1016/j.nedt.2008.08.009
10.1186/s12909-017-1022-0
10.1021/ci00065a010
10.1331/JAPhA.2015.14262
10.1016/j.japh.2018.07.002
10.2196/13997
10.1016/j.sapharm.2010.05.002
10.1211/ijpp.18.01.0006
10.1111/hsc.12717
10.3821/1913-701X-143.1.37
10.1007/s10852-005-9022-1
10.1016/j.csda.2006.11.025
10.1177/1715163516662670
10.1016/j.sapharm.2015.06.007
10.3390/pharmacy7040140
10.1016/j.jmva.2007.07.002
10.3102/00346543071001001
10.1109/ICIMT.2009.27
10.1186/s12916-019-1370-1
10.1001/jama.300.10.1181
10.1080/03610927408827101
10.1186/1748-5908-8-109
10.1016/j.japh.2016.05.002
ContentType Journal Article
Copyright COPYRIGHT 2020 MDPI AG
2020. This work is licensed under http://creativecommons.org/licenses/by/3.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
2020 by the authors. 2020
Copyright_xml – notice: COPYRIGHT 2020 MDPI AG
– notice: 2020. This work is licensed under http://creativecommons.org/licenses/by/3.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
– notice: 2020 by the authors. 2020
DBID AAYXX
CITATION
NPM
3V.
7XB
8FK
8G5
ABUWG
AFKRA
AZQEC
BENPR
CCPQU
DWQXO
GNUQQ
GUQSH
M2O
MBDVC
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQQKQ
PQUKI
PRINS
Q9U
7X8
5PM
ADTOC
UNPAY
DOA
DOI 10.3390/pharmacy8010026
DatabaseName CrossRef
PubMed
ProQuest Central (Corporate)
ProQuest Central (purchase pre-March 2016)
ProQuest Central (Alumni) (purchase pre-March 2016)
Research Library
ProQuest Central (Alumni)
ProQuest Central
ProQuest Central Essentials
ProQuest Central
ProQuest One Community College
ProQuest Central Korea
ProQuest Central Student
Research Library Prep
ProQuest Research Library
Research Library (Corporate)
ProQuest Central Premium
ProQuest One Academic
Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Academic
ProQuest One Academic UKI Edition
ProQuest Central China
ProQuest Central Basic
MEDLINE - Academic
PubMed Central (Full Participant titles)
Unpaywall for CDI: Periodical Content
Unpaywall
Directory of Open Access Journals - DOAJ (NTUSG)
DatabaseTitle CrossRef
PubMed
Publicly Available Content Database
Research Library Prep
ProQuest Central Student
ProQuest One Academic Middle East (New)
ProQuest Central Basic
ProQuest Central Essentials
ProQuest One Academic Eastern Edition
ProQuest Central (Alumni Edition)
ProQuest One Community College
Research Library (Alumni Edition)
ProQuest Central China
ProQuest Central
ProQuest One Academic UKI Edition
ProQuest Central Korea
ProQuest Research Library
ProQuest Central (New)
ProQuest One Academic
ProQuest One Academic (New)
ProQuest Central (Alumni)
MEDLINE - Academic
DatabaseTitleList

MEDLINE - Academic
CrossRef

Publicly Available Content Database
PubMed
Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 3
  dbid: UNPAY
  name: Unpaywall
  url: https://proxy.k.utb.cz/login?url=https://unpaywall.org/
  sourceTypes: Open Access Repository
– sequence: 4
  dbid: BENPR
  name: ProQuest Central
  url: http://www.proquest.com/pqcentral?accountid=15518
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Pharmacy, Therapeutics, & Pharmacology
EISSN 2226-4787
ExternalDocumentID oai_doaj_org_article_3ba421936376469783fa1eb64136927c
10.3390/pharmacy8010026
PMC7151706
A632976720
32102464
10_3390_pharmacy8010026
Genre Journal Article
GeographicLocations Canada
GeographicLocations_xml – name: Canada
GrantInformation_xml – fundername: Ontario College of Pharmacists
  grantid: N/A
GroupedDBID 53G
5VS
8G5
AADQD
AAYXX
ABUWG
ADBBV
ADFRT
AFKRA
AFZYC
ALMA_UNASSIGNED_HOLDINGS
AOIJS
AZQEC
BCNDV
BENPR
BPHCQ
CCPQU
CITATION
DWQXO
GNUQQ
GROUPED_DOAJ
GUQSH
GX1
HYE
IAO
KQ8
M2O
MK0
MODMG
M~E
OK1
PGMZT
PHGZM
PHGZT
PIMPY
PQQKQ
PROAC
RNS
RPM
NPM
IHR
3V.
7XB
8FK
MBDVC
PKEHL
PQEST
PQUKI
PRINS
PUEGO
Q9U
7X8
5PM
ADTOC
IPNFZ
ITC
RIG
UNPAY
ID FETCH-LOGICAL-c445t-b35e96f2be1af6aefd68877380cc34d182c90bc9c43dedb400683c8184d2eda53
IEDL.DBID BENPR
ISSN 2226-4787
IngestDate Fri Oct 03 12:52:44 EDT 2025
Sun Oct 26 04:14:53 EDT 2025
Tue Sep 30 15:15:57 EDT 2025
Thu Oct 02 04:17:17 EDT 2025
Sat Sep 20 14:21:07 EDT 2025
Tue Jun 17 20:58:32 EDT 2025
Mon Jul 21 05:58:18 EDT 2025
Thu Oct 16 04:41:18 EDT 2025
Thu Apr 24 23:13:13 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 1
Keywords computer-based education
pharmacy practice
continuing professional development
online education
Language English
License Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
cc-by
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c445t-b35e96f2be1af6aefd68877380cc34d182c90bc9c43dedb400683c8184d2eda53
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
ORCID 0000-0003-1135-0391
0000-0003-4116-8283
OpenAccessLink https://www.proquest.com/docview/2367517776?pq-origsite=%requestingapplication%&accountid=15518
PMID 32102464
PQID 2367517776
PQPubID 2032348
ParticipantIDs doaj_primary_oai_doaj_org_article_3ba421936376469783fa1eb64136927c
unpaywall_primary_10_3390_pharmacy8010026
pubmedcentral_primary_oai_pubmedcentral_nih_gov_7151706
proquest_miscellaneous_2366640661
proquest_journals_2367517776
gale_infotracmisc_A632976720
pubmed_primary_32102464
crossref_primary_10_3390_pharmacy8010026
crossref_citationtrail_10_3390_pharmacy8010026
PublicationCentury 2000
PublicationDate 20200224
PublicationDateYYYYMMDD 2020-02-24
PublicationDate_xml – month: 2
  year: 2020
  text: 20200224
  day: 24
PublicationDecade 2020
PublicationPlace Switzerland
PublicationPlace_xml – name: Switzerland
– name: Basel
PublicationTitle Pharmacy
PublicationTitleAlternate Pharmacy (Basel)
PublicationYear 2020
Publisher MDPI AG
MDPI
Publisher_xml – name: MDPI AG
– name: MDPI
References Ryan (ref_27) 2000; 25
Hennig (ref_23) 2007; 52
Jokanovic (ref_9) 2016; 12
ref_14
Lawson (ref_19) 1990; 30
Deci (ref_26) 2001; 71
ref_11
Calinski (ref_22) 1974; 3
ref_10
Dolovich (ref_8) 2016; 149
Willis (ref_28) 2019; 27
Cook (ref_12) 2008; 300
Hennig (ref_24) 2008; 99
ref_18
ref_17
Park (ref_13) 2019; 5
Houle (ref_1) 2019; 59
Lloyd (ref_4) 2010; 18
Horiuchi (ref_16) 2009; 29
Dawoud (ref_2) 2011; 7
Law (ref_7) 2015; 55
Makowsky (ref_5) 2013; 8
Kowlowitz (ref_15) 2009; 35
ref_25
Kolhatkar (ref_6) 2016; 56
ref_20
Rosenthal (ref_29) 2010; 143
Tully (ref_3) 2007; 29
Reynolds (ref_21) 1992; 5
References_xml – volume: 29
  start-page: 628
  year: 2007
  ident: ref_3
  article-title: Pharmacists’ changing views of their supplementary prescribing authority
  publication-title: Pharm. World Sci.
  doi: 10.1007/s11096-007-9114-2
– volume: 35
  start-page: 37
  year: 2009
  ident: ref_15
  article-title: Development and dissemination of web-based clinical simulations for continuing geriatric nursing education
  publication-title: J. Gerontol. Nurs.
  doi: 10.3928/00989134-20090401-08
– volume: 25
  start-page: 54
  year: 2000
  ident: ref_27
  article-title: Intrinsic and extrinsic motivations: Classic definitions and new directions
  publication-title: Contemp. Ed. Psych.
  doi: 10.1006/ceps.1999.1020
– volume: 29
  start-page: 140
  year: 2009
  ident: ref_16
  article-title: Evaluation of a web-based graduate continuing nursing education program in Japan: A randomized controlled trial
  publication-title: Nurs. Educ. Today
  doi: 10.1016/j.nedt.2008.08.009
– ident: ref_17
  doi: 10.1186/s12909-017-1022-0
– volume: 30
  start-page: 36
  year: 1990
  ident: ref_19
  article-title: New index for clustering tendency and its application to chemical problems
  publication-title: J. Chem. Inf. Comput. Sci.
  doi: 10.1021/ci00065a010
– volume: 55
  start-page: 398
  year: 2015
  ident: ref_7
  article-title: Impact of allowing pharmacists to independently renew prescriptions: A population-based study
  publication-title: J. Am. Pharm. Assoc.
  doi: 10.1331/JAPhA.2015.14262
– volume: 59
  start-page: 89
  year: 2019
  ident: ref_1
  article-title: Remunerated patient care services and injections by pharmacists: An international update
  publication-title: J. Am. Pharm. Assoc.
  doi: 10.1016/j.japh.2018.07.002
– volume: 5
  start-page: e13997
  year: 2019
  ident: ref_13
  article-title: Microlearning in Health Professions Education: Scoping Review
  publication-title: JMIR Med Educ
  doi: 10.2196/13997
– volume: 7
  start-page: 56
  year: 2011
  ident: ref_2
  article-title: Pharmacist supplementary prescribing: A step toward more independence?
  publication-title: Res. Soc. Adm. Pharm.
  doi: 10.1016/j.sapharm.2010.05.002
– volume: 18
  start-page: 29
  year: 2010
  ident: ref_4
  article-title: ‘It’s showed me the skills that he has’: pharmacists’ and mentors’ views on pharmacist supplementary prescribing
  publication-title: Int. J. Pharm. Pract.
  doi: 10.1211/ijpp.18.01.0006
– volume: 27
  start-page: 999
  year: 2019
  ident: ref_28
  article-title: Extending the scope of community pharmacists’ practice to patients requiring urgent care—An evaluation of a training programme using the Theoretical Domains Framework
  publication-title: Health Soc. Care Community
  doi: 10.1111/hsc.12717
– ident: ref_18
– volume: 143
  start-page: 37
  year: 2010
  ident: ref_29
  article-title: Are pharmacists the ultimate barrier to pharmacy practice change?
  publication-title: Can. Pharm. J. (Ott)
  doi: 10.3821/1913-701X-143.1.37
– volume: 5
  start-page: 475
  year: 1992
  ident: ref_21
  article-title: Clustering rules: A comparison of partitioning and hierarchical clustering algorithms
  publication-title: J. Math. Model. Algor.
  doi: 10.1007/s10852-005-9022-1
– volume: 52
  start-page: 258
  year: 2007
  ident: ref_23
  article-title: Cluster-wise assessment of cluster stability
  publication-title: Comp. Stat. Data An.
  doi: 10.1016/j.csda.2006.11.025
– volume: 149
  start-page: 293
  year: 2016
  ident: ref_8
  article-title: Uptake of the MedsCheck annual medication review service in Ontario community pharmacies between 2007 and 2013
  publication-title: Can. Pharm. J. (Ott)
  doi: 10.1177/1715163516662670
– volume: 12
  start-page: 384
  year: 2016
  ident: ref_9
  article-title: Clinical medication review in Australia: A systematic review
  publication-title: Res. Soc. Admin. Phar.
  doi: 10.1016/j.sapharm.2015.06.007
– ident: ref_25
– ident: ref_10
  doi: 10.3390/pharmacy7040140
– volume: 99
  start-page: 1154
  year: 2008
  ident: ref_24
  article-title: Dissolution point and isolation robustness: Robustness criteria for general cluster analysis methods
  publication-title: J. Multivar. Anal.
  doi: 10.1016/j.jmva.2007.07.002
– volume: 71
  start-page: 1
  year: 2001
  ident: ref_26
  article-title: Extrinsic rewards and intrinsic motivation in education: Reconsidered once again
  publication-title: Rev. Ed. Res.
  doi: 10.3102/00346543071001001
– ident: ref_14
  doi: 10.1109/ICIMT.2009.27
– ident: ref_11
  doi: 10.1186/s12916-019-1370-1
– volume: 300
  start-page: 1181
  year: 2008
  ident: ref_12
  article-title: Internet-based learning in the health professions: A meta-analysis
  publication-title: JAMA
  doi: 10.1001/jama.300.10.1181
– volume: 3
  start-page: 1
  year: 1974
  ident: ref_22
  article-title: A dendrite method for cluster analysis
  publication-title: Comm. Statist. Theory Methods
  doi: 10.1080/03610927408827101
– volume: 8
  start-page: 109
  year: 2013
  ident: ref_5
  article-title: Factors influencing pharmacists’ adoption of prescribing: Qualitative application of the diffusion of innovations theory
  publication-title: Implement. Sci.
  doi: 10.1186/1748-5908-8-109
– ident: ref_20
– volume: 56
  start-page: 513
  year: 2016
  ident: ref_6
  article-title: The impact of medication reviews by community pharmacists
  publication-title: J. Am. Pharm. Assoc.
  doi: 10.1016/j.japh.2016.05.002
SSID ssj0000913855
Score 2.1430264
Snippet A computer-based education platform was developed using a theory-based approach to help Canadian pharmacy professionals adopt their full scope of practice....
SourceID doaj
unpaywall
pubmedcentral
proquest
gale
pubmed
crossref
SourceType Open Website
Open Access Repository
Aggregation Database
Index Database
Enrichment Source
StartPage 26
SubjectTerms CAI
Cluster analysis
Computer assisted instruction
computer-based education
Computers
continuing professional development
Demographics
Educational aspects
Learning
Methods
Online education
Online instruction
Pharmaceutical education
Pharmacists
Pharmacy
pharmacy practice
Professional development
R&D
Research & development
Technology application
Variance analysis
SummonAdditionalLinks – databaseName: Directory of Open Access Journals - DOAJ (NTUSG)
  dbid: DOA
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1La9wwEBYll_ZS-u62aVGhhBbixtbTPiYlIRRafEggN6GX28KiXZpdwv77zPi13pSSSy8-WJItj-Ypz3wi5CNiyoWG8cwVBc8EwyQA14TMMjB3UQqdN7ih__2HOr8U367k1eSoL8wJ6-CBO8IdcWcFSBVXIAkQyumSN7aIToHyVRXTHrVvXlaTYKrVwVXBSyk7LB8Ocf3RskOC3oBGzlsohYkZatH6_9bJE6N0N2Hy4Tot7ebGzucTa3T2hDzu3Uh63E3_KXkQ0zNyUPdvP6QX27Kq60N6QOstQvXmObHdr16wWrTeFg5QmwI9TT_7dBi6SNTS4dSH7ATMHTQP-SC0ntsVjqRwGR6_oXVfdPWCXJ6dXnw9z_qzFjIvhFxljstYqYa5WNhG2dgEBepH8zL3nosAUYivcucrL3iIwQksLeEerL0ILAYr-UuylxYpviZUsShkbGSlvBLwrFJUXlmWN74UCJYzI18G0hvfA5HjeRhzAwEJrpW5s1Yz8mkcsOwwOP7d9QTXcuyG4NntDWAp07OUuY-lZmQfOcGgiMPEPAicN8eKM3DdNMuheeAQ0wv8tUEgPFlorWEKH8ZmHIlJbCku1m0fpcCBUkCCVx1DjRPFUiomlJgRvcNqO1-y25J-_2rhwDU4bTqH934emfI-Mr35H2R6Sx4x3HzA-n6xT_ZWf9bxHXhoK_e-FcZbSOI4RQ
  priority: 102
  providerName: Directory of Open Access Journals
– databaseName: Unpaywall
  dbid: UNPAY
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1ba9swFBYlfdhedr-k64YGo2xQx7YkSzYMRjpaymDFDw10D8PIktyVBSe0Tkf263eOb7mMMbYXP0SSLdmfzvmknPOJkDeoKWcLxr08DLknGAYB5IX1NAN35yKhggI39D-fydOJ-HQRXeyQ910uDIZVwlL8qjbS4Lukh-oxfuyHPpP-3BYfbtt9pDCKmQJ2jwZ4V0bAxAdkd3KWjr_geXJdy0bNh8PK3p83WtBLsMlBLaaw5ohqvf7frfKaW9oOmbyzKOd6-UNPp2v-6OQ--dqNpAlD-T5aVPnI_NwSefzfoT4g91qiSscNsh6SHVc-IgdpO7pDer5K3Lo5pAc0XWlgLx8T3fyZDH6RpqvUBKpLS4_Lyzbghs5Kqml3roR3BA4ViruIE5pOdYUtKVy62y9p2qZ1PSGTk-Pzj6dee5qDZ4SIKi_nkUtkwXIX6kJqV1gJBk7xODCGCwvrHJMEuUmM4NbZXGDyCjfAJ4RlzuqIPyWDcla654RK5kTkCvjmRgq4VywSIzULChMLlOMZklH3aTPTSp3jiRvTDJY8iIVsCwtD8rZvMG9UPv5c9Qix0ldDee76h9n1ZdbO9oznWoAr4BLMt5C4u1bo0OUSGINMmDJDso9Iy9CIQMcMTGmTjSVnQA4VC6C4Q2DWmpSbDKX2olApBV143RdjSwyTK91sUdeREiiahFfwrAFs31FM1mJCiiFRG1DeGMlmSXn1rRYcV0ALVQDPfdeD_m-vae8f6r4gdxnuYqBQgNgng-p64V4C1avyV-2M_gXsS1A9
  priority: 102
  providerName: Unpaywall
Title Assessing Performance and Engagement on a Computer-Based Education Platform for Pharmacy Practice
URI https://www.ncbi.nlm.nih.gov/pubmed/32102464
https://www.proquest.com/docview/2367517776
https://www.proquest.com/docview/2366640661
https://pubmed.ncbi.nlm.nih.gov/PMC7151706
https://www.mdpi.com/2226-4787/8/1/26/pdf?version=1582795662
https://doaj.org/article/3ba421936376469783fa1eb64136927c
UnpaywallVersion publishedVersion
Volume 8
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVAFT
  databaseName: Open Access Digital Library
  customDbUrl:
  eissn: 2226-4787
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0000913855
  issn: 2226-4787
  databaseCode: KQ8
  dateStart: 20130101
  isFulltext: true
  titleUrlDefault: http://grweb.coalliance.org/oadl/oadl.html
  providerName: Colorado Alliance of Research Libraries
– providerCode: PRVAON
  databaseName: DOAJ Directory of Open Access Journals
  customDbUrl:
  eissn: 2226-4787
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0000913855
  issn: 2226-4787
  databaseCode: DOA
  dateStart: 20130101
  isFulltext: true
  titleUrlDefault: https://www.doaj.org/
  providerName: Directory of Open Access Journals
– providerCode: PRVFQY
  databaseName: GFMER Free Medical Journals
  customDbUrl:
  eissn: 2226-4787
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0000913855
  issn: 2226-4787
  databaseCode: GX1
  dateStart: 0
  isFulltext: true
  titleUrlDefault: http://www.gfmer.ch/Medical_journals/Free_medical.php
  providerName: Geneva Foundation for Medical Education and Research
– providerCode: PRVHPJ
  databaseName: ROAD: Directory of Open Access Scholarly Resources
  customDbUrl:
  eissn: 2226-4787
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0000913855
  issn: 2226-4787
  databaseCode: M~E
  dateStart: 20130101
  isFulltext: true
  titleUrlDefault: https://road.issn.org
  providerName: ISSN International Centre
– providerCode: PRVAQN
  databaseName: PubMed Central
  customDbUrl:
  eissn: 2226-4787
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0000913855
  issn: 2226-4787
  databaseCode: RPM
  dateStart: 20150101
  isFulltext: true
  titleUrlDefault: https://www.ncbi.nlm.nih.gov/pmc/
  providerName: National Library of Medicine
– providerCode: PRVPQU
  databaseName: ProQuest Central
  customDbUrl: http://www.proquest.com/pqcentral?accountid=15518
  eissn: 2226-4787
  dateEnd: 99991231
  omitProxy: true
  ssIdentifier: ssj0000913855
  issn: 2226-4787
  databaseCode: BENPR
  dateStart: 20130301
  isFulltext: true
  titleUrlDefault: https://www.proquest.com/central
  providerName: ProQuest
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwhV3da9swEBdd-rC9jH3PXVc0GGWDerUlWYofxkhGShksmNFA92RkSe4GwU7bhJH_fne27CQd214MtiTbkk53p9Pd7wh5i5hytmQ8LOKYh4KhE0BR2lAzEHcuESoq0aD_dSrPZ-LLZXK5R6ZdLAy6VXY8sWHUtjZoIz9FpLEkVkrJT4vrELNG4elql0JD-9QK9mMDMXaP7DNExhqQ_fFkmn3rrS6IgjlMkhbjh8N-_3TRIkSvgVNHDcTClnhqUPz_5NVbwuquI-X9VbXQ6196Pt-SUmePyEOvXtJRSw-PyZ6rnpDjzH_9hF5swq1uT-gxzTbI1eunRLdHwCDNaLYJKKC6snRSXXk3GVpXVNMuG0Q4BjEIxZ2fCM3meoktKVy6169p5oOxnpHZ2eTi83noczCERohkGRY8caksWeFiXUrtSiuBLSk-jIzhwsLuxKRRYVIjuHW2EBhywg1oAcIyZ3XCn5NBVVfuJaGSOZG4MkmlkQLeNRSpkZpFpRkKBNEJyIdu6HPjAcoxT8Y8h40KzlV-Z64C8q5vsGixOf5edYxz2VdDUO3mQX1zlfs1mvNCC2DgXALTFRJtYqWOXSFBzsuUKROQQ6SEHJc-_JiBhWjykeQMVDrFIijuKCT3jOA235BtQN70xdgSndsqV6-aOlKCYiVhCF60BNX_KIZYMSFFQNQOqe30ZLek-vmjgQlXoMypCL77vifK_w3Twb-78Io8YGhuwIh-cUgGy5uVew062bI48gvtqLFpwN1smo2-_wYgJDqx
linkProvider ProQuest
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3db9MwELem7WG8IL4pDDASTCAtLLUdp3mY0AqdOrZVEeqkvQXHdgZSlZS11ZR_jr-Nu8RJ2yHgaS99qO182Of7nS93vyPkDXLKmYxxL-12uScYBgGkmfEUA7izgQj9DB36ZyM5PBdfLoKLDfKryYXBsMpGJ1aK2hQafeT7yDQWdMMwlB-nPz2sGoVfV5sSGsqVVjAHFcWYS-w4seU1HOFmB8efYb3fMnY0GH8aeq7KgKeFCOZeygMbyYyltqsyqWxmJGy8kPd8rbkwYH_ryE91pAU31qQCkyq4BpwThlmjsGoEQMCW4CKCw99WfzCKv7ZeHmTd7AVBzSnEeeTvT2tG6hKQwa8oHVbgsKoa8Cc2rIDjzcDN7UU-VeW1mkxWUPHoHrnrzFl6WMvffbJh8wdkN3Z336PjZXrXbI_u0njJlF0-JKr-5AzoSeNlAgNVuaGD_NKF5dAip4o21Se8PsAuNDdxKTSeqDmOpPDTXL6ksUv-ekTOb2U1HpPNvMjtU0IlsyKwWRBJLQVcqyciLRXzM90TSNrTIR-aqU-0I0THuhyTBA5GuFbJjbXqkHftgGnNBfL3rn1cy7YbknhXfxRXl4nTCQlPlQDA4BKUvJDog8tU16YS7AoZsVB3yA5KQoKqBh5Mw8bXyaHkDEzIkPnQ3EhI4hTPLFlukw553TbjSAymy22xqPpICYachCl4UgtU-6CY0sWEFB0Srona2pust-Q_vle05CEYj6EP933fCuX_punZv1_hFdkejs9Ok9Pj0clzcoehqwPZBMQO2ZxfLewLsAfn6Uu36Sj5dtv7_DcS9XX4
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV3db9MwELemTQJeEN8UBhgJJpAWmtqO0zxMaGWtNgZVhDZpb5ljOwOpSsraasq_yF_FXeKk7RDwtJc-1HY-7PP9Lue73xHyBjnlTMa4l_Z63BMMgwDSzHiKAdzZQIR-hg79r2N5eCo-nwVnG-RXkwuDYZWNTqwUtSk0-si7yDQW9MIwlN3MhUXEB6OP058eVpDCk9amnIZyZRbMXkU35pI8jm15BZ9zs72jA1j7t4yNhiefDj1XccDTQgRzL-WBjWTGUttTmVQ2MxI2Ycj7vtZcGLDFdeSnOtKCG2tSgQkWXAPmCcOsUVhBAuBgCw-_QElsDYbj-Fvr8UEGzn4Q1PxCnEd-d1qzU5eAEn5F77ACjVUFgT9xYgUorwdx3l7kU1VeqclkBSFH98hdZ9rS_VoW75MNmz8gO7G7-y49WaZ6zXbpDo2XrNnlQ6Lq42dAUhovkxmoyg0d5hcuRIcWOVW0qUThDQCCobmJUaHxRM1xJIWf5vIljV0i2CNyeiOr8Zhs5kVunxIqmRWBzYJIaingWn0RaamYn-m-QAKfDvnQTH2iHTk61uiYJPCRhGuVXFurDnnXDpjWvCB_7zrAtWy7IaF39UdxeZE4_ZDwVAkADy5B4QuJ_rhM9WwqwcaQEQt1h2yjJCSoduDBNCgBnexLzsCcDJkPzY2EJE4JzZLllumQ120zjsTAutwWi6qPlGDUSZiCJ7VAtQ-K6V1MSNEh4Zqorb3Jekv-43tFUR6CIRn6cN_3rVD-b5qe_fsVXpFbsN-TL0fj4-fkDkOvBxILiG2yOb9c2BdgGs7Tl27PUXJ-09v8N08Aeic
linkToUnpaywall http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1ba9swFBYlfdhedr-k64YGo2xQx7YkSzYMRjpaymDFDw10D8PIktyVBSe0Tkf263eOb7mMMbYXP0SSLdmfzvmknPOJkDeoKWcLxr08DLknGAYB5IX1NAN35yKhggI39D-fydOJ-HQRXeyQ910uDIZVwlL8qjbS4Lukh-oxfuyHPpP-3BYfbtt9pDCKmQJ2jwZ4V0bAxAdkd3KWjr_geXJdy0bNh8PK3p83WtBLsMlBLaaw5ohqvf7frfKaW9oOmbyzKOd6-UNPp2v-6OQ--dqNpAlD-T5aVPnI_NwSefzfoT4g91qiSscNsh6SHVc-IgdpO7pDer5K3Lo5pAc0XWlgLx8T3fyZDH6RpqvUBKpLS4_Lyzbghs5Kqml3roR3BA4ViruIE5pOdYUtKVy62y9p2qZ1PSGTk-Pzj6dee5qDZ4SIKi_nkUtkwXIX6kJqV1gJBk7xODCGCwvrHJMEuUmM4NbZXGDyCjfAJ4RlzuqIPyWDcla654RK5kTkCvjmRgq4VywSIzULChMLlOMZklH3aTPTSp3jiRvTDJY8iIVsCwtD8rZvMG9UPv5c9Qix0ldDee76h9n1ZdbO9oznWoAr4BLMt5C4u1bo0OUSGINMmDJDso9Iy9CIQMcMTGmTjSVnQA4VC6C4Q2DWmpSbDKX2olApBV143RdjSwyTK91sUdeREiiahFfwrAFs31FM1mJCiiFRG1DeGMlmSXn1rRYcV0ALVQDPfdeD_m-vae8f6r4gdxnuYqBQgNgng-p64V4C1avyV-2M_gXsS1A9
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Assessing+Performance+and+Engagement+on+a+Computer-Based+Education+Platform+for+Pharmacy+Practice&rft.jtitle=Pharmacy&rft.au=Grindrod%2C+Kelly&rft.au=Morris%2C+Katherine&rft.au=Killeen%2C+Rosemary&rft.date=2020-02-24&rft.pub=MDPI+AG&rft.issn=2226-4787&rft.eissn=2226-4787&rft.volume=8&rft.issue=1&rft_id=info:doi/10.3390%2Fpharmacy8010026&rft.externalDocID=A632976720
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2226-4787&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2226-4787&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2226-4787&client=summon