vovrВысшее образование в России (Vysshee obrazovanie v Rossii = Higher Education in Russia)Vysshee Obrazovanie v Rossii = Higher Education in Russia0869-36172072-0459Moscow Polytechnic University10.31992/0869-3617-2023-32-8-9-130-146vovr-4549Research ArticleСтатьиОценка студентами преподавания в университетах: больше вреда или пользы?Student Evaluation of Teaching: More Harm than Good?https://orcid.org/0000-0001-9341-0436АбрамоваМ. О.AbramovaM. O.

канд. филос. наук, директор Центра социологии образования Института образования634050, г. Томск, проспект Ленина, 36

Сand. Sci. (Philosophy), Director of the Center for the Sociology of Education of the Institute of Education

36 Lenin ave., Tomsk, 634050

abra@yandex.ruhttps://orcid.org/0000-0001-7026-7059ФилькинаА. В.FilkinaA. V.

канд. соц. наук, научный сотрудник центра социологииИнститута образования

634050, г. Томск, проспект Ленина, 36

Cand. Sci. (Soc.), Research Fellow at the Center for Sociology of Higher Education of the Institute of Education

36 Lenin ave., Tomsk, 634050,

alexandra.filkina.tsu@gmail.comНациональный исследовательский Томский государственный университетРоссияNational Research Tomsk State UniversityRussian Federation202313092023328-9130146Copyright © Абрамова М.О., Филькина А.В., 20232023Абрамова М.О., Филькина А.В.Abramova M.O., Filkina A.V.Данная работа распространяется под лицензией Creative Commons Attribution 4.0.This work is licensed under a Creative Commons Attribution 4.0 License.https://vovr.elpub.ru/jour/article/view/4549

Студенческая оценка преподавателей и курсов посредством опросов – имеющий более чем сорокалетнюю историю инструмент обратной связи в североамериканских, австралийских и европейских университетах. Его использование в российских университетах не столь распространено, хотя более широкое применение может ре шить проблему ощущения студентами своей непричастности к управлению образовательным процессом и улучшить качество курсов и преподавания. Массовизации данной практики препятствуют в том числе определённые опасения со стороны преподавателей и студентов. В данной статье авторы анализируют основные опасения и ожидания студентов и преподавателей от студенческих оценок курсов, выделенные по итогам десяти фокусгрупп, проведённых в пяти российских университетах. Полученные наблюдения авторы помещают в контекст современных методологических дискуссий, посвящённых студенческим оценкам курсов и преподавателей с тем, чтобы разобраться, насколько обоснованы опасения преподавателей в отношении валидности данного инструмента обратной связи и целей его использования в вузе. Основной вывод, который делают авторы: использование в университетах студенческих оценок преподавателя эффективно в качестве инструмента обратной связи и формирования культуры диалога в образовательном процессе и достаточно спорно в качестве источника данных для принятия административных решений.

Student evaluation of teaching (SET) has more than forty years of history as a tool of feedback in North American, Australian and European universities. In Russian universities it is not widespread, although increasing its implementation could solve the problem of Russian students feeling that they are not involved in the management of the educational process and improve the quality of courses and teaching. The barriers to the implementation of SET in the Russian higher education system, among other things, are concerns and prejudices of teachers and students, who see SET more as a problem than an effective tool. In this article, authors analyze the most common faculty concerns about student evaluations of teaching, obtained from ten focus groups in five Russian universities. Authors put collected opinions in the context of the recent methodological discussions about the validity of Student Evaluations of Teaching. The main idea is that SET is an effective tool of getting feedback in higher education and involvement of students and teachers in a dialogue and cooperation in the educational process, but highly questionable as a data source for administrative decisions.

студенческая оценка преподаванияуниверситетыоцениваниекачество образованияуниверситетское управлениеstudent evaluation of teachinghigher educationassessmentquality of educationuniversity managementИсследование выполнено при поддержке Программы развития Томского государственного университета (Приоритет-2030).The research has been supported by the Development Program of Tomsk State University (Priority 2030).ReferencesУниверситетская национальная инициатива качества образования: анализ ситуации в контексте новых задач развития системы: Аналитический доклад / Е.А. Суханова, Е.А. Терентьев, К.А. Баранников и др.; под ред. Е.А. Сухановой, Е.А. Терентьева. Томск: Издательство Томского государственного университета, 2023. 32 с. ISBN: 978-5-90757272-0. URL: http://docs.io.tsu.ru/wordpress/wpcontent/uploads/UNIKO_2023.pdf (дата обращения 07.06.2023).Sukhanova, E.A., Terent’ev, E.A., Barannikov, K.A., Frumin, I.D., Abramova, M.O. et al. (2023). Universitetskaya natsional’naya iniciativa kachestva obrazovaniya: analiz situatsii v kontekste novykh zadach razvitiya sistemy: Analiticheskij doklad [University National Education Quality Initiative: Situation Analysis in the Context of New System Development Challenges: Analytical Report]. Tomsk: Tomsk State University Publ., 32p. Available at: http://docs.io.tsu.ru/wordpress/wp-content/uploads/UNIKO_2023.pdf (accessed 07.06.2023). (In Russ.).Stroebe W. Student Evaluations of Teaching Encourages Poor Teaching and Contributes to Grade Inflation: A Theoretical and Empirical Analysis // Basic and Applied Social Psychology. 2020. Vol. 42. No. 4. P. 276–294. DOI: 10.1080/01973533.2020.1756817Stroebe, W. (2020). Student Evaluations of Teaching Encourages Poor Teaching and Contributes to Grade Inflation: A Theoretical and Empirical Analysis. Basic and Applied Social Psychology. Vol. 42, no. 4, pp. 276-294, doi: 10.1080/01973533.2020.1756817Zaitseva E., Santhanam E., Tucker B. Analysing Student Feedback in Higher Education. Routledge Press, 2021. 238 p. DOI: 10.4324/9781003138785Zaitseva, E., Santhanam, E., Tucker, B. (2021). Analysing Student Feedback in Higher Education. Routledge Press. 238 p., doi: 10.4324/9781003138785Marsh H.W. SEEQ: a Reliable, Valid, and Useful Instrument for Collecting Student’s Evaluations of University Teaching // British Journal of Educational Psychology. 1982. Vol. 52. No. 1. P. 77–95. DOI: 10.1111/j.2044-8279.1982.tb02505.xMarsh, H.W. (1982). SEEQ: A Reliable, Valid, and Useful Instrument for Collecting Student’s Evaluations of University Teaching. British Journal of Educational Psychology. Vol. 52, no. 1, pp. 77-95, doi: 10.1111/j.2044-8279.1982.tb02505.xMarsh H.W. Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases, and Utility // Journal of Educational Psychology. 1984. Vol. 76. No. 5. P. 707–754. DOI: 10.1037/0022-0663.76.5.707Marsh, H.W. (1984). Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases, and Utility. Journal of Educational Psychology. Vol. 76, no. 5, pp. 707-754, doi: 10.1037/0022-0663.76.5.707Груздев И.А., Ефимов Д.Б. Студенческая оценка преподавания как инструмент управления качеством образования в условиях дистанционного и смешанного обучения Томск: Изд-во Томского гос. ун-та, 2021. 24 c. ISBN: 978-5-907442-283. URL: https://publications.hse.ru/pubs/share/ direct/527981342.pdf?ysclid=ljvl3b2blv105198418 (дата обращения 07.06.2023).Gruzdev, I.A., Efimov, D.B. (2021). Studencheskaya ocenka prepodavaniya kak instrument upravleniya kachestvom obrazovaniya v usloviyah distancionnogo i smeshannogo obucheniya [Student Evaluation of Teaching as a Tool for Managing the Quality of Education in Distance and Blended Learning]. Tomsk: Tomsk State University Publ., 24 p. Available at: https://publications.hse.ru/pubs/share/direct/527981342.pdf?ysclid=ljvl3b2blv105198418 (accessed 07.06.2023). (In Russ.).Spooren P. Vandermoere F. , Vanderstraeten R., Pepermans K. Exploring High Impact Scholarship in Research on Student’s Evaluation of Teaching (SET) // Educational Research Review. 2017. Vol. 22. P. 129–141. DOI: 10.1016/j.edurev.2017.09.001Spooren, P., Vandermoere, F. , Vanderstraeten, R., Pepermans, K. (2017). Exploring High Impact Scholarship in Research on Student’s Evaluation of Teaching (SET). Educational Research Review. Vol. 22, pp. 129-141, doi: 10.1016/j.edurev.2017.09.001Гребнев Л.С. Обучение: что оценивать студенту? // Высшее образование в России. 2022. Т. 31. № 2. С. 68–81. DOI: 10.31992/0869-36172022-31-2-68–81Grebnev, L.S. (2022). Learning: What Should a Student Assess? Vysshee obrazovanie v Rossii = Higher Education in Russia. Vol. 31, no. 2, pp. 68-81, doi: 10.31992/0869-3617-2022-31-2-68– 81 (In Russ., abstract in Eng.).Прошкин Б.Г., Кленикова Н.В. Опыт оценки преподавателей студентами на экономическом факультете Кемеровского государственного университета // Вестник Кемеровского государственного университета. 2013. Т. 53. № 1. С. 269–275. EDN: QZNIRF.Proshkin, B.G., Klenikova, N.V. (2013). The Experience of Students Assessing Teachers at the Economical Faculty of Kemerovo State University. Vestnik Kemerovskogo gosudarstvennogo universiteta = Bulletin of Kemerovo State University. Vol. 53, no. 1, pp. 269-275. Available at: https://www.elibrary.ru/download/elibrary_20176076_74488046.pdf (accessed: 07.06.2023). (In Russ., abstract in Eng.).Меркулова О.П. Проблемы оценивания учебного процесса студентами // Высшее образование в России. 2012. № 2. С. 18–24. URL: https://elibrary.ru/item.asp?id=17357722 (дата обращения: 02.01.2022).Merkulova, O.P. (2012). Evaluation of Educational Process by Students. Vysshee obrazovanie v Rossii = Higher Education in Russia. No. 2, pp. 18-24. Available at: https://elibrary.ru/item.asp?id=17357722 (accessed: 02.01.2022). (In Russ., abstract in Eng.)Marsh H.W. Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and Usefulness // The Scholarship of Teaching and Learning in Higher Education: An Evidence-Based Perspective: ed. by R.P. Perry, J.C. Smart. Springer Netherlands, 2007. P. 319–383. DOI: 10.1007/1-4020-5742-3_9Marsh, H.W. (2007). Students’ Evaluations of University Teaching: Dimensionality, Reliability, Validity, Potential Biases and Usefulness. In: R.P. Perry, J.C. Smart (eds). The Scholarship of Teaching and Learning in Higher Education: An Evidence-Based Perspective. Springer Netherlands, pp. 319-383, doi: 10.1007/1-4020-5742-3_9Hornstein H.A. Student Evaluations of Teaching are an Inadequate Assessment Tool for Evaluating Faculty Performance // Cogent Education. 2017. Vol. 4. No. 1. P. 1–8. DOI: 10.1080/2331186x.2017.1304016Hornstein, H.A. (2017). Student Evaluations of Teaching Are an Inadequate Assessment Tool for Evaluating Faculty Performance. Cogent Education. Vol. 4, no. 1, pp. 1-8, doi: 10.1080/2331186x.2017.1304016Boring A., Ottoboni K., Stark P.B. Student Evaluations of Teaching (Mostly) Do Not Measure Teaching Effectiveness // Science Open Research. 2016. January 9. P. 1–11. DOI: 10.14293/s2199-1006.1.sor-edu.aetbzc.v1Boring, A., Ottoboni, K., Stark, P.B. (2016). Student Evaluations of Teaching (Mostly) Do not Measure Teaching Effectiveness. Science Open Research. January 9, pp. 1-11, doi: 10.14293/s2199-1006.1.sor-edu.aetbzc.v1Cohen P.A. Student Ratings of Instruction and Student Achievement: A Meta-Analysis of Multisection Validity Studies // Review of Educational Research. 1981. Vol. 51. No. 3. P. 281–309. DOI: 10.3102/00346543051003281Cohen, P.A. (1981). Student Ratings of Instruction and Student Achievement: A Meta-Analysis of Multisection Validity Studies. Review of Educational Research. Vol. 51, no. 3, pp. 281-309, doi: 10.3102/00346543051003281Feldman K.A. The Association Between Student Ratings of Specific Instructional Dimensions and Student Achievement: Refining and Extending the Synthesis of Data From Multisection Validity Studies // Research in Higher Education. 1989. Vol. 30. No. 6. P. 583–645. DOI: 10.1007/bf00992392Feldman, K.A. (1989). The Association Between Student Ratings of Specific Instructional Dimensions and Student Achievement: Refining and Extending the Synthesis of Data From Multisection Validity Studies. Research in Higher Education. Vol. 30, no. 6, pp. 583-645, doi: 10.1007/bf00992392Nargundkar S., Shrikhande M. An Empirical Investigation of Student Evaluations of Instruction — The Relative Importance of Factors // Decision Sciences Journal of Innovative Education. 2012. Vol. 10. No. 1. P. 117–135. DOI: 10.1111/j.1540-4609.2011.00328.xNargundkar, S., Shrikhande, M. (2012). An Empirical Investigation of Student Evaluations of Instruction – The Relative Importance of Factors. Decision Sciences Journal of Innovative Education. Vol. 10, no. 1, pp. 117-135, doi: 10.1111/j.1540-4609.2011.00328.xUttl B., White C.A., Gonzalez D.W. MetaAnalysis of Faculty’s Teaching Effectiveness: Student Evaluation of Teaching Ratings and Student Learning Are Not Related // Studies in Educational Evaluation. 2017. Vol. 54. P. 22–42. DOI: 10.1016/j.stueduc.2016.08.007Uttl, B., White, C.A., Gonzalez, D.W. (2017). Meta-analysis of faculty’s teaching effectiveness: Student evaluation of teaching ratings and student learning are not related. Studies in Educational Evaluation. Vol. 54, pp. 22-42, doi: 10.1016/j.stueduc.2016.08.007Heffernan T. Sexism, Racism, Prejudice, and Bias: A Literature Review and Synthesis of Research Surrounding Student Evaluations of Courses and Teaching // Assessment & Evaluation in Higher Education. 2022. Vol. 47. No. 1. P. 144-154. DOI: 10.1080/02602938.2021.1888075Heffernan, T. (2022). Sexism, Racism, Prejudice, and Bias: A Literature Review and Synthesis of Research Surrounding Student Evaluations of Courses and Teaching. Assessment & Evaluation in Higher Education. Vol. 47, no. 1, pp. 144-154, doi: 10.1080/02602938.2021.1888075Wang G., Williamson A. Course Evaluation Scores: Valid Measures for Teaching Effectiveness or Rewards for Lenient Grading? // Teaching in Higher Education. 2020. Vol. 27. P. 1–22. DOI: 10.1080/13562517.2020.1722992Wang, G., Williamson, A. (2020). Course Evaluation Scores: Valid Measures for Teaching Effectiveness or Rewards for Lenient Grading? Teaching in Higher Education. Vol. 27, pp. 1-22, doi: 10.1080/13562517.2020.1722992Berezvai Z., Lukáts G.D., Molontay R. Can Professors Buy Better Evaluation with Lenient Grading? The Effect of Grade Inflation on Student Evaluation of Teaching // Assessment & Evaluation in Higher Education. 2021. Vol. 46. No. 5. P. 793–808. DOI: 10.1080/02602938.2020.1821866Berezvai, Z., Lukáts, G.D., Molontay, R. (2021). Can Professors Buy Better Evaluation with Lenient Grading? The Effect of Grade Inflation on Student Evaluation of Teaching. Assessment & Evaluation in Higher Education. Vol. 46, no. 5, pp. 793-808, doi: 10.1080/02602938.2020.1821866Stark P., Freishtat R. An Evaluation of Course Evaluations // ScienceOpen Research. 2014. P. 1–7. DOI: 10.14293/s2199-1006.1.sor-edu.aofrqa.v1Stark, P., Freishtat, R. (2014). An Evaluation of Course Evaluations. ScienceOpen Research. Pp. 1-7, doi: 10.14293/s2199-1006.1.sor-edu.aofrqa.v1Esarey J., Valdes N. Unbiased, Reliable, and Valid Student Evaluations Can Still Be Unfair // Assessment & Evaluation in Higher Education. 2020. Vol. 45. No. 8. P. 1106–1120. DOI: 10.1080/02602938.2020.1724875Esarey, J., Valdes, N. (2020). Unbiased, Reliable, and Valid Student Evaluations Can Still be Unfair. Assessment & Evaluation in Higher Education. Vol. 45, no. 8, pp. 1106-1120, doi: 10.1080/02602938.2020.1724875Flodén J. The Impact of Student Feedback on Teaching in Higher Education // Assessment & Evaluation in Higher Education. 2017. Vol. 42. No. 7. P. 1054–1068. DOI: 10.1080/02602938.2016.1224997Flodén, J. (2017). The Impact of Student Feedback on Teaching in Higher Education. Assessment & Evaluation in Higher Education. Vol. 42, no. 7, pp. 1054-1068, doi: 10.1080/02602938.2016.1224997Chen Y., Hoshower L.B. Student Evaluation of Teaching Effectiveness: An Assessment of Student Perception and Motivation // Assessment & Evaluation in Higher Education. 2003. Vol. 28. No. 1. P. 71–88. DOI: 10.1080/02602930301683Chen, Y., Hoshower, L.B. (2003). Student Evaluation of Teaching Effectiveness: An Assessment of Student Perception and Motivation. Assessment & evaluation in higher education. Vol. 28, no. 1, pp. 71-88, doi: 10.1080/02602930301683McClain L., Gulbis A., Hays D. Honesty on Student Evaluations of Teaching: Effectiveness, Purpose, and Timing Matter! // Assessment & Evaluation in Higher Education. 2018. Vol. 43. No. 3. P. 369-385. DOI: 10.1080/02602938.2017.1350828McClain, L., Gulbis, A., Hays, D. (2018). Honesty on Student Evaluations of Teaching: Effectiveness, Purpose, and Timing Matter! Assessment & Evaluation in Higher Education. Vol. 43, no. 3, pp. 369-385, doi: 10.1080/02602938.2017.1350828Jones J., Gaffney-Rhys R., Jones E. Handle with Care! An Exploration of the Potential Risks Associated with the Publication and Summative Usage of Student Evaluation of Teaching (SET) Results // Journal of Further and Higher Education. 2014. Vol. 38. No. 1. P. 37–56. DOI: 10.1080/0309877X.2012.699514Jones, J., Gaffney-Rhys, R., Jones, E. (2014). Handle with Care! An Exploration of the Potential Risks Associated with the Publication and Summative Usage of Student Evaluation of Teaching (SET) Results. Journal of Further and Higher Education. Vol. 38, no. 1, pp. 37-56, doi: 10.1080/0309877X.2012.699514Tucker B. Student Evaluation Surveys: Anonymous Comments that Offend or are Unprofessional // Higher Education. 2014. Vol. 68. P. 347–358. DOI: 10.1007/s10734-014-9716-2Tucker, B. (2014). Student Evaluation Surveys: Anonymous Comments that Offend or are Unprofessional. Higher Education. Vol. 68, pp. 347-358, doi: 10.1007/s10734-014-9716-2Ulker N. How Can Student Evaluations Lead to Improvement of Teaching Quality? A Cross-National Analysis // Research in Post-Compulsory Education. 2021. Vol. 26. No. 1. P. 19–37. DOI: 10.1080/13596748.2021.1873406Ulker, N. (2021). How Can Student Evaluations Lead to Improvement of Teaching Quality? A Cross-National Analysis. Research in Post-Compulsory Education. Vol. 26, no. 1, pp. 19-37, doi: 10.1080/13596748.2021.1873406Carless D., Boud D. The Development of Student Feedback Literacy: Enabling Uptake of Feedback // Assessment & Evaluation in Higher Education. 2018. Vol. 43. No. 8. P. 1315–1325. DOI: 10.1080/02602938.2018.1463354Carless, D., Boud, D. (2018). The Development of Student Feedback Literacy: Enabling Uptake of Feedback. Assessment & Evaluation in Higher Education. Vol. 43, no. 8, pp. 1315-1325, doi: 10.1080/02602938.2018.1463354

The authors declare that there are no conflicts of interest present.