An exploratory analysis of major dropdowns in Student Evaluation of Teaching ratings in higher education

We present an exploratory study of Student Evaluation of Teaching (SET) surveys that focused on analyzing the major dropdowns that sometimes occur in SET scores of those university teachers who teach the same subject for at least two consecutive years. Specifically, the purpose of this study was to...

Full description

Saved in:
Bibliographic Details
Published inMultidisciplinary journal of educational research Vol. 13; no. 1; pp. 91 - 113
Main Authors Leguey, Santiago, Cid-Cid, Ana I., Guede Cid, Rocío, Prieto, Jaime
Format Journal Article
LanguageEnglish
Published Barcelona Hipatia Press 01.02.2023
Subjects
Online AccessGet full text
ISSN2014-2862
2014-2862
DOI10.17583/remie.10419

Cover

Abstract We present an exploratory study of Student Evaluation of Teaching (SET) surveys that focused on analyzing the major dropdowns that sometimes occur in SET scores of those university teachers who teach the same subject for at least two consecutive years. Specifically, the purpose of this study was to identify those SET survey items associated with major dropdowns in teacher evaluations. The sample comprised SET surveys ratings from one Spanish University over five years, for a total of 2,284 different teacher-subject pairs under analysis. The 5% percentile of the differences between the teacher and subject SET ratings in two consecutive years was used as the cut-off point to identify major dropdowns. Frequency tables were used for analysis. The results highlighted SET survey items related to teaching methodology as those most associated with major dropdowns in teachers’ ratings. In particular, the item concerning teachers’ compliance with class schedules showed the highest frequency of occurrence. Beyond the specific scores obtained or the specific items in which major dropdowns may take place, in this study we discuss the importance of incorporating major dropdowns analysis to SET surveys reports in the future.
AbstractList We present an exploratory study of Student Evaluation of Teaching (SET) surveys that focused on analyzing the major dropdowns that sometimes occur in SET scores of those university teachers who teach the same subject for at least two consecutive years. Specifically, the purpose of this study was to identify those SET survey items associated with major dropdowns in teacher evaluations. The sample comprised SET surveys ratings from one Spanish University over five years, for a total of 2,284 different teacher-subject pairs under analysis. The 5% percentile of the differences between the teacher and subject SET ratings in two consecutive years was used as the cut-off point to identify major dropdowns. Frequency tables were used for analysis. The results highlighted SET survey items related to teaching methodology as those most associated with major dropdowns in teachers’ ratings. In particular, the item concerning teachers’ compliance with class schedules showed the highest frequency of occurrence. Beyond the specific scores obtained or the specific items in which major dropdowns may take place, in this study we discuss the importance of incorporating major dropdowns analysis to SET surveys reports in the future. Presentamos un estudio exploratorio de las valoraciones docentes del profesorado enfocado al análisis de los grandes descensos que en ocasiones se producen en las puntuaciones que obtienen los profesores universitarios que imparten una misma asignatura en al menos dos cursos consecutivos. Específicamente, el propósito fue identificar aquellos ítems de las encuestas de valoración docente asociados a los grandes descensos de puntuación. Compusieron la muestra las encuestas de valoración docente de una universidad española durante 5 años, con 2.284 pares de profesor-asignatura diferentes. Se empleó el percentil 5% de las diferencias entre las puntuaciones de las encuestas de un profesor y asignatura en dos años consecutivos como punto de corte para identificar los descensos más pronunciados. Se emplearon tablas de frecuencias para el análisis. Los resultados destacaron los ítems relacionados con la metodología docente como los más asociados a los grandes descensos de puntuación. El ítem relativo al cumplimiento de los horarios de clase presentó la mayor frecuencia de ocurrencia Más allá de las puntuaciones específicas obtenidas o de los ítems específicos en los que pueden ocurrir los mayores descensos, discutimos la importancia de incorporar su análisis a los informes de las encuestas de valoración docente del profesorado universitario.
We present an exploratory study of Student Evaluation of Teaching (SET) surveys that focused on analyzing the major dropdowns that sometimes occur in SET scores of those university teachers who teach the same subject for at least two consecutive years. Specifically, the purpose of this study was to identify those SET survey items associated with major dropdowns in teacher evaluations. The sample comprised SET surveys ratings from one Spanish University over five years, for a total of 2,284 different teacher-subject pairs under analysis. The 5% percentile of the differences between the teacher and subject SET ratings in two consecutive years was used as the cut-off point to identify major dropdowns. Frequency tables were used for analysis. The results highlighted SET survey items related to teaching methodology as those most associated with major dropdowns in teachers’ ratings. In particular, the item concerning teachers’ compliance with class schedules showed the highest frequency of occurrence. Beyond the specific scores obtained or the specific items in which major dropdowns may take place, in this study we discuss the importance of incorporating major dropdowns analysis to SET surveys reports in the future.
Author Guede Cid, Rocío
Prieto, Jaime
Leguey, Santiago
Cid-Cid, Ana I.
Author_xml – sequence: 1
  givenname: Santiago
  surname: Leguey
  fullname: Leguey, Santiago
– sequence: 2
  givenname: Ana I.
  surname: Cid-Cid
  fullname: Cid-Cid, Ana I.
– sequence: 3
  givenname: Rocío
  surname: Guede Cid
  fullname: Guede Cid, Rocío
– sequence: 4
  givenname: Jaime
  surname: Prieto
  fullname: Prieto, Jaime
BookMark eNpNkV9LwzAUxYNMcM69-QECvtqZpG2Sgi9jzD8wEHQ-hzRN15QuqUmr7ttbOxXvy71cfudcuOccTKyzGoBLjBaYpTy-8Xpv9AKjBGcnYEoQTiLCKZn8m8_APIQaDcUQSXk2BdXSQv3ZNs7LzvkDlFY2h2ACdCXcy9p5WHjXFu7DBmgsfOn6QtsOrt9l08vOOPsNbrVUlbE7OJgMbSQrs6u0h7ro1chdgNNSNkHPf_oMvN6tt6uHaPN0_7habiJFCM0inpWYYJpSwiXluqRM5YyQjCmGmFRMoZxqwlmsMlwgnKO0wDjBeZwwlRKC4hm4PfoWRjZWd6L1Zi_9QThpxO-ut8YbV0uhg1g-b4d_4JQnJIsH-dVR3nr31uvQidr1fnhKEDGJKaaYDdgMXB8p5V0IXpd_VzASYxpiTEOMacRfkuF_sA
ContentType Journal Article
Copyright Copyright © 2023. This work is licensed under http://creativecommons.org/licenses/by/4.0 (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
LICENCIA DE USO: Los documentos a texto completo incluidos en Dialnet son de acceso libre y propiedad de sus autores y/o editores. Por tanto, cualquier acto de reproducción, distribución, comunicación pública y/o transformación total o parcial requiere el consentimiento expreso y escrito de aquéllos. Cualquier enlace al texto completo de estos documentos deberá hacerse a través de la URL oficial de éstos en Dialnet. Más información: https://dialnet.unirioja.es/info/derechosOAI | INTELLECTUAL PROPERTY RIGHTS STATEMENT: Full text documents hosted by Dialnet are protected by copyright and/or related rights. This digital object is accessible without charge, but its use is subject to the licensing conditions set by its authors or editors. Unless expressly stated otherwise in the licensing conditions, you are free to linking, browsing, printing and making a copy for your own personal purposes. All other acts of reproduction and communication to the public are subject to the licensing conditions expressed by editors and authors and require consent from them. Any link to this document should be made using its official URL in Dialnet. More info: https://dialnet.unirioja.es/info/derechosOAI
Copyright_xml – notice: Copyright © 2023. This work is licensed under http://creativecommons.org/licenses/by/4.0 (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
– notice: LICENCIA DE USO: Los documentos a texto completo incluidos en Dialnet son de acceso libre y propiedad de sus autores y/o editores. Por tanto, cualquier acto de reproducción, distribución, comunicación pública y/o transformación total o parcial requiere el consentimiento expreso y escrito de aquéllos. Cualquier enlace al texto completo de estos documentos deberá hacerse a través de la URL oficial de éstos en Dialnet. Más información: https://dialnet.unirioja.es/info/derechosOAI | INTELLECTUAL PROPERTY RIGHTS STATEMENT: Full text documents hosted by Dialnet are protected by copyright and/or related rights. This digital object is accessible without charge, but its use is subject to the licensing conditions set by its authors or editors. Unless expressly stated otherwise in the licensing conditions, you are free to linking, browsing, printing and making a copy for your own personal purposes. All other acts of reproduction and communication to the public are subject to the licensing conditions expressed by editors and authors and require consent from them. Any link to this document should be made using its official URL in Dialnet. More info: https://dialnet.unirioja.es/info/derechosOAI
DBID AAYXX
CITATION
0-V
3V.
7XB
88B
8FK
ABUWG
AFKRA
ALSLI
AZQEC
BENPR
CCPQU
CJNVE
CLZPN
DWQXO
GNUQQ
M0P
PHGZM
PHGZT
PIMPY
PKEHL
PQEDU
PQEST
PQQKQ
PQUKI
Q9U
AGMXS
FKZ
DOI 10.17583/remie.10419
DatabaseName CrossRef
ProQuest Social Sciences Premium Collection【Remote access available】
ProQuest Central (Corporate)
ProQuest Central (purchase pre-March 2016)
Education Database (Alumni Edition)
ProQuest Central (Alumni) (purchase pre-March 2016)
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
Social Science Premium Collection
ProQuest Central Essentials
ProQuest Central
ProQuest One Community College
Education Collection
Latin America & Iberia Database
ProQuest Central
ProQuest Central Student
Education Database
ProQuest Central Premium
ProQuest One Academic (New)
ProQuest Publicly Available Content
ProQuest One Academic Middle East (New)
ProQuest One Education
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Academic
ProQuest One Academic UKI Edition
ProQuest Central Basic
Dialnet (Open Access Full Text)
Dialnet
DatabaseTitle CrossRef
Publicly Available Content Database
ProQuest One Education
Social Science Premium Collection
Education Collection
ProQuest Central Student
ProQuest One Academic Middle East (New)
ProQuest Central Basic
ProQuest Education Journals
ProQuest Central Essentials
ProQuest One Academic Eastern Edition
ProQuest Central (Alumni Edition)
ProQuest One Community College
ProQuest Central
Latin America & Iberian Database
ProQuest Social Sciences Premium Collection
ProQuest One Academic UKI Edition
ProQuest Central Korea
ProQuest Central (New)
ProQuest One Academic
ProQuest Education Journals (Alumni Edition)
ProQuest One Academic (New)
ProQuest Central (Alumni)
DatabaseTitleList
Publicly Available Content Database
CrossRef
Database_xml – sequence: 1
  dbid: BENPR
  name: ProQuest Central - New (Subscription)
  url: http://www.proquest.com/pqcentral?accountid=15518
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Education
EISSN 2014-2862
EndPage 113
ExternalDocumentID oai_dialnet_unirioja_es_ART0001584293
10_17583_remie_10419
GroupedDBID -W8
.GO
0-V
5VS
AAHSB
AAYXX
ABUWG
ADBBV
AFKRA
ALMA_UNASSIGNED_HOLDINGS
ALSLI
ARALO
AZQEC
BCNDV
BENPR
BPHCQ
CITATION
CJNVE
CLZPN
DWQXO
FAEIB
GNUQQ
HEY
KQ8
M0P
M~E
OK1
PIMPY
PQQKQ
PROAC
3V.
7XB
8FK
CCPQU
PHGZM
PHGZT
PKEHL
PQEDU
PQEST
PQUKI
Q9U
ABSRN
AGMXS
FKZ
GROUPED_DOAJ
IPNFZ
RIG
ID FETCH-LOGICAL-c2269-89f12165628a68ef67cb72297c707ac7c0b6e2873c91d01b05d1141b347c52203
IEDL.DBID BENPR
ISSN 2014-2862
IngestDate Sun May 12 18:41:27 EDT 2024
Mon Aug 04 15:40:20 EDT 2025
Tue Jul 01 02:24:11 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 1
Language English
License http://creativecommons.org/licenses/by/4.0
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c2269-89f12165628a68ef67cb72297c707ac7c0b6e2873c91d01b05d1141b347c52203
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
OpenAccessLink https://www.proquest.com/docview/3236161729?pq-origsite=%requestingapplication%&accountid=15518
PQID 3236161729
PQPubID 1216360
PageCount 23
ParticipantIDs dialnet_primary_oai_dialnet_unirioja_es_ART0001584293
proquest_journals_3236161729
crossref_primary_10_17583_remie_10419
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2023-02-01
PublicationDateYYYYMMDD 2023-02-01
PublicationDate_xml – month: 02
  year: 2023
  text: 2023-02-01
  day: 01
PublicationDecade 2020
PublicationPlace Barcelona
PublicationPlace_xml – name: Barcelona
PublicationTitle Multidisciplinary journal of educational research
PublicationYear 2023
Publisher Hipatia Press
Publisher_xml – name: Hipatia Press
SSID ssj0000702589
Score 2.2131565
Snippet We present an exploratory study of Student Evaluation of Teaching (SET) surveys that focused on analyzing the major dropdowns that sometimes occur in SET...
SourceID dialnet
proquest
crossref
SourceType Open Website
Aggregation Database
Index Database
StartPage 91
SubjectTerms calidad de la docencia
educación superior
evaluación del profesorado
higher education
práctica docente
Student Evaluation
Student Evaluation of Teacher Performance
student evaluation of teaching
teacher evaluation
Teacher Surveys
Teachers
Teaching
Teaching Methods
teaching practice
teaching quality
valoraciones docentes del profesorado
Title An exploratory analysis of major dropdowns in Student Evaluation of Teaching ratings in higher education
URI https://www.proquest.com/docview/3236161729
https://dialnet.unirioja.es/servlet/oaiart?codigo=8834523
Volume 13
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3fS8MwEA5zQ_BF_InTKXnQx7I0bZr2QWTKxhAcohvsraRpqh2snd32_5tL0ykIvraBwuV6911y930I3Xo6b7u-FA5JM-r4ofR1HEx0sSLDNAuigBMGs8Mvk2A885_nbN5Ck2YWBtoqm5hoAnVaSjgj73vAEgLpNnpYfTmgGgW3q42EhrDSCum9oRjbQx0dkhlpo87jcPL6tjt10Q5OWRjZDniNlb1-pZa5gqtOINv5lZv2YXCjUJs_QdpkntEROrSQEQ_qPT5GLVWcgNqy7cw4RZ-DAivTS2euzLGwRCO4zPBSLMoKp1W5SuEcGecFfq_pLPFwR_QNC6e2rRKDSxQfZuWnaQLBqvnUGZqNhtOnsWMVFBypYVXkhFHmUuDXoaEIQpUFXCac0ohLTriQXJIkULpm8mTkpsRNCEt1feQmns-lBmbEO0ftoizUBcJUuIIllEdcJzTisYRQAYqjimlIE_puF901totXNVFGDAUG2Dg2No6NjbuIWcPulgHDdfNsW-RVXi5ErNaxRvRm1DvUOdProl6zDbH9zdbxj1Nc_v_6Ch2ATnzdbt1D7U21VdcaTWySG-si3wVzyuU
linkProvider ProQuest
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LT9wwEB7RRahcqra0Ylva-lCOEY7zcHJAFbSLlgKrii4SN9dxHFgkkm12UcWf47cx43WWSkjcuCZWIo3H8_I33wB8jdBvh7HRAS8rEcSZidEOFpismKys0jyVPKHe4ZNROjyLf54n5ytw1_XCEKyys4nOUJeNoRr5TkQsIeRu82_TvwFNjaLb1W6EhvajFcpdRzHmGzuO7O0_TOFmu4c_cL-3hTgYjL8PAz9lIDAYeuRBllehIA4akek0s1UqTSGFyKWRXGojDS9Si3lFZPKw5GHBkxJziLCIYmkweOERfvcFrMZUQOnB6v5g9Ot0WeXBAyWSLPeIe4zNo53WXk8sXa0Suc9_vnCNGkVqO3_kFJynO3gNr3yIyvYWOvUGVmz9lqY7eyTIBlzu1cw67J67omfaE5uwpmLX-qppWdk205Lq1mxSs98L-kw2WBKL08Kxh3EyUsH6wq28dKATZrtfvYOzZ5Hle-jVTW03gQkd6qQQMpfoQHmUFFxomnBqEwyhsjjsw3YnOzVdEHMoSmhIxsrJWDkZ9yHxgl0uI0bt7tlNPWknzZVWdqYwg3Ct5Rn66KgPW902KH-sZ-pBCT88_foLvByOT47V8eHo6COs04z6BdR7C3rz9sZ-wkhmXnz26sLgz3Nr6D1KwwTZ
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=An+exploratory+analysis+of+major+dropdowns+in+Student+Evaluation+of+Teaching+ratings+in+higher+education&rft.jtitle=Multidisciplinary+journal+of+educational+research&rft.au=Leguey%2C+Santiago&rft.au=Cid-Cid%2C+Ana+I.&rft.au=Guede+Cid%2C+Roc%C3%ADo&rft.au=Prieto%2C+Jaime&rft.date=2023-02-01&rft.issn=2014-2862&rft.eissn=2014-2862&rft.volume=13&rft.issue=1&rft_id=info:doi/10.17583%2Fremie.10419&rft.externalDBID=n%2Fa&rft.externalDocID=10_17583_remie_10419
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2014-2862&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2014-2862&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2014-2862&client=summon