Establishing the Institute of Independent Evaluation of Higher Education in the Russian Federation

   The paper presents the results of the search, systematization and analysis of independent higher education evaluation systems that have been developed in the country in the recent decade. The research has been carried out using standardised evaluation mechanisms that adhere to the criteria of mass scale, openness, and stability. The analysis of the independent evaluation of higher education’s present situation revealed certain inconsistencies between the legislative and regulatory framework and real practice. It should be emphasised that, while different processes have now been developed for this type of evaluation, they still require enhancement. The assessment mechanisms themselves need to undergo an external, independent evaluation to ensure their reliability, integrity, and trustworthy evidence. It has been indicated that independent evaluation procedures have jointly developed into a system: the institution of independent evaluation. This system is characterised by integrity, orderliness, and definite linkages. One may consider the aggregating technology of the aforementioned evalu-
ations to be the synergistic outcome of the system’s establishment. In order to achieve a synergistic effect on the evaluation of all higher education institutions and educational programmes in the country, the authors suggest a method for aggregating the outcomes of the described evaluation procedures. The obtained research outcomes prove their applicability to the internal and external evaluation of a higher education institution’s performance and to the strategic planning of the development of both the institution and the higher education system.

1. Harvey, L., Green, D. (1993). Defining Quality. Assessment and Evaluation in Higher Education. Vol. 18, no. 1, pp. 9-34, doi: 10.1080/0260293930180102

2. Van Vught, F.A., Westerheijden, D.F. (1994). Towards a general model of quality assessment in higher education. Higher Education. No. 28(3), pp. 355-371, doi: 10.1007/BF01383722

3. Arzhanova, I.V., Baryshnikova, M.Ju., Zhurakovskij, V.M., Zavarykina, L.V., Lazutina, I.V., et al. (2013). Model methodology for multidimensional ranking of Russian universities. Vestnik mezhdunarodnyh organizacij: obrazovanie, nauka, novaja jekonomika = International Organisations Research Journal. Vol. 8, no. 1, pp. 8-30. EDN: PXFLOL (accessed 23. 07. 2024). (In Russ., abstract in Eng.).

4. Hosier, M., Hoolash, K.A. (2019). The effect of methodological variations on university rankings and associated decision-making and policy. Studies in Higher Education. Vol. 44, no. 1, pp. 201-214, doi: 10.1080/03075079.2017.1356282

5. Jung, C.S., Toutkoushian, R., Teicher, U. (2011). University Rankings: Theoretical Basis, Methodology, and Impacts on Global Higher Education. New York: Springer. 218 p., doi: 10.1007/978-94-007-1116-7

6. Peters, M.A. (2019). Global university rankings: Metrics, performance, governance. Educational Philosophy and Theory. Vol. 51, no. 1, pp. 5-13, doi: 10.1080/00131857.2017.1381472

7. Rubin, Ju.B., Soboleva, Je.Ju. (2021). Independence of higher education quality assessment: criteria, principles, realities. Vysshee obrazovanie v Rossii = Higher Education in Russia. No. 3, pp. 26-42, doi: 10.31992/0869-3617-2021-30-3-26-42 (In Russ., abstract in Eng.).

8. Navodnov, V.G., Motova, G.N. (2015). The practice of accreditation in the system of higher education in Russia. Vysshee obrazovanie v Rossii = Higher Education in Russia. No. 5, pp. 12-20. Available at: https://www.elibrary.ru/download/elibrary_23726822_63876626.pdf (accessed 23. 07. 2024). (In Russ., abstract in Eng.).

9. Motova, G., Navodnov, V. (2020). Twenty years of accreditation in Russian higher education: lessons learnt. Higher Education Evaluation and Development. Vol. 14, no. 1, doi: 10.1108/HEED-05-2019-0023

10. Melikjan, A.V. (2021). Statistical analysis of the dynamics of performance indicators of Russian universities. Voprosy statistiki = Questions of Statistics. Vol. 28, no. 1, pp. 38-49, doi: 10.34023/2313-6383-2021-28-1-38-49 (In Russ., abstract in Eng.).

11. Pavlova, N.G. (2021). Rating assessment of the activities of higher education organizations in Russia. Vestnik nauki i obrazovanija = Bulletin of Science and Education. No. 13-3 (116), pp. 4-7, EDN: CNNSOX (In Russ., abstract in Eng.).

12. Standards and Guidelines for Quality Assurance in the European Higher Education Area (ESG). Available at: https://www.enqa.eu/wp-content/uploads/2015/11/ESG_2015.pdf (accessed: 25. 07. 2024).

13. Sivinski, V. (2017). Academic rankings and prospects for their development. Voprosy obrazovanija = Educational Studies Moscow. No. 1, pp. 158-166, doi: 10.17323/1814-9545-2017-1-158-166 (In Russ., abstract in Eng.).

14. Hauptman, Komotar M. (2020). Discourses on quality and quality assurance in higher education from the perspective of global university rankings. Quality Assurance in Education. Vol. 28, no. 1, pp. 78-88, doi: 10.1108/QAE-05-2019-0055

15. Angelis, L., Bassiliades, N., Manolopoulos, Y. (2019). On the necessity of multiple university rankings. Journal of Scientometrics and Information Management. Vol. 13, no. 1, pp. 11-36, doi: 10.1080/09737766.2018.1550043

16. Marconi, G., Ritzen, J. (2015). Determinants of international university rankings scores. Applied Economics. Vol. 47, no. 57, pp. 6211-6227, doi: 10.1080/00036846.2015.1068921

17. Balackij, E.V. (2012). Russian practice of evaluating the effectiveness of university programs. Obshhestvo i jekonomika = Society and Economy. No. 11, pp. 68-84. Available at: https://www.elibrary.ru/download/elibrary_18237371_82628915.pdf (accessed 23. 07. 2024). (In Russ., abstract in Eng.).

18. Majer, N.S. (2018). Monitoring the effectiveness of universities: results and prospects. Universum: psihologija i obrazovanie = Universum: Psychology and Education. No. 4(46). Available at: https://7universum.com/ru/psy/archive/item/5712 (accessed: 25. 07. 2024) (In Russ., abstract in Eng.).

19. Prokhorov, S.G., Svirina, A.A., Chekhonadskikh, A.I. (2016). Performance monitoring: a reduction tool or a search for growth points? Vysshee obrazovanie v Rossii = Higher Education in Russia. No. 1(197), pp. 63-68, doi: 10.17323/1814-9545-2019-3-130-151 (In Russ., abstract in Eng.).

20. Bolotov, V., Motova, G., Navodnov, V. (2019). The Monitoring of Monitoring: What’s Wrong with the Ministry’s New Approach to Supervision of Effectiveness of Higher Education Institutions’ Performance? Universitetskoe upravlenie: praktika i analiz = University Management: Practice and Analysis. No. 23(3), pp. 5-13, doi: 10.15826/umpa.2019.03.015

21. Gajnutdinov, M.M., Odintsova, M.P. (2022). Independent accreditation in higher education: landscape and design. Universitetskoe upravlenie: praktika i analiz = University Management: Practice and Analysis. Vol. 26, no. 1, pp. 102-116, doi: 10.15826/umpa.2022.01.008 (In Russ., abstract in Eng.).

22. Matveeva, O.A. (2019). Development of voluntary accreditation of educational programs in Russia. Vysshee obrazovanie v Rossii = Higher Education in Russia. No. 7, pp. 19-28, doi: 0.31992/0869-3617-2019-28-7-19-28 (In Russ., abstract in Eng.).

23. Guba, K.S. (2019). Higher Education Quality Assessment : A Review of International Experience. Universitetskoe upravlenie: praktika i analiz = University Management: Practice and Analysis. No. 23(3), pp. 94-107, doi: 10.15826/umpa.2019.03.022 (In Russ., abstract in Eng.).

24. Kameneva, E.A., Prikhod’ko, L.V. (2018). Higher Education Quality Assessment System: Analysis of World and Russian Practice. Menedzhment i biznes administrirovanie = Management and Business Administration. No. 4, pp. 112-124. Available at: https://www.mba-journal.ru/archive/2018/4/ (accessed 23. 07. 2024). (In Russ., abstract in Eng.).

25. Motova, G.N., Navodnov, V.G., Kuklin, V.Zh., Savel’ev, B.A. (1998). Accreditation Systems Abroad. Moscow: Rossiyskiy novyy universitet, 180 p. EDN: RUEDZP (In Russ.).

26. Motova, G.N. (2013). Who will get the flute? Akkreditacija v obrazovanii = Accreditation in Education. No. 6 (66). pp. 14-19. Available at: https://www.elibrary.ru/download/elibrary_20859863_36372353.pdf (accessed 23. 08. 2024). (In Russ., abstract in Eng.).

27. Motova, G.N. (2020). Guards or guides? New requirements for accreditation agencies to ensure the quality of education. Vysshee obrazovanie v Rossii = Higher Education in Russia. Vol. 29, no. 6, pp. 9-21, doi: 10.31992/0869-3617-2020-6-9-21 (In Russ., abstract in Eng.).

28. Minina, E. (2017). Quality revolution’ in post-Soviet education in Russia: From control to assurance? Journal of Education Policy. No. 32(2), pp. 176-197, doi: 10.1080/02680939.2016.1250165

29. Motova, G.N., Navodnov, V.G., Ryzhakova, O.E. (2019). Methodology “MetALig” and its application for a comparative analysis of international rankings and the results of the Russian Monitoring of the effectiveness of universities. Voprosy obrazovanija = Educational Studies Moscow. No. 3, pp. 130-151, doi: 10.17323/1814-9545-2019-3-130-151 (In Russ., abstract in Eng.).

30. Petrovskiy, A.B. (2009). Decision Theory. Moscow: Publishing Centre “Akademija”, 400 p. ISBN 978-5-7695-5093-5. Available at: https://h.fractr.xyz/file/2169970/ (accessed 23. 07. 2024). (In Russ.).

31. Bolotov, V.A., Motova, G.N., Navodnov, V.G. (2021). Global Aggregate Ranking of Universities: Russian Track. Vysshee obrazovanie v Rossii = Higher Education in Russia. No. 3, pp. 9-25, doi: 10.31992/0869-3617-2021-30-3-9-25 (In Russ., abstract in Eng.).

32. Bolotov, V.A. Motova, G.N., Navodnov, V.G., Ryzhakova, O.E. (2020). How to construct a national aggregate rating? Vysshee obrazovanie v Rossii = Higher Education in Russia. Vol. 29, no. 1, pp. 9-24, doi: 10.31992/0869-3617-2020-29-1--9-24 (In Russ., abstract in Eng.).

33. Schwarz, S., Westerheijden, D.F. (2004). Accreditation in the Framework of Evaluation Activities: A Comparative Study in the European Higher Education Area. Accreditation and Evaluation in the European Higher Education Area. pp. 1-41, doi: 10.1007/978-1-4020-2797-0_1