Linguo-Pedagogical Design of Open Question Items in the Context of Digitalization
https://doi.org/10.31992/0869-3617-2024-33-1-128-148
Abstract
Interdisciplinary approach to the development and creation of open question items for assessment procedures in accordance with the digital transformation strategy and the new requirements for state accreditation of educational programs of higher education has been presented in the article. It has been revealed the content of the author’s terms including linguo-pedagogical mastery, linguo-pedagogical design, linguistic correctness and methodological literacy of test tasks. On the basis of scientometric analysis carried out due to the scientific electronic library elibrary it has been determined the chronological activity and subject correlation of publications of native researchers on testing students. Based on the results of a survey of teachers from 11 regional universities the main difficulties in the preparation of testing and assessment materials are summarized. Examples of test items in disciplines taught at a multidisciplinary polytechnic university are analyzed. Typical errors in the wording of questions, reference answers and evaluation criteria have been identified by the methods of erratological analysis and the reasons for their appearance have been summarized. To model the linguo-pedagogical design of test tasks the concept of an epistemic situation is used, its four components are described: ontological (subject-content definition of objects and elements of control), methodological (selection of types and types of tasks depending on the level of measured outcomes of learning), communicative-pragmatic (ensuring the comprehensibility of the text of the test task) and technological (technical implementation of the automated check of free response). Methods of test tasks modification with the help of modern digital services are proposed. As a result of the study, the authors formulate recommendations for the implementation of the linguo-pedagogical design of open question items with a focus on their implementation in the digital environment.
About the Authors
A. V. Alikina
Perm National Research Polytechnic University
Russian Federation
Russian Federation
Elena V. Alikina – Dr. Sci. (Pedagogics), Head of the Department of Foreign Languages, Linguistics and Translation
Komsomolsky proezd, 29, Perm, 614990
D. V. Maltsev
Perm National Research Polytechnic University
Russian Federation
Russian Federation
Dmitry V. Maltsev – Cand. Sci. (Engineering), Associate Professor
Komsomolsky proezd, 29, Perm, 614990
References
1. Bannyh, G.A., Kostina, S.N. (2022). Conceptualization of the Concept of Digital Maturity of the University in the Context of Digital Transformation of Higher Education. Vestnik Majkopskogo gosudarstvennogo tekhnologicheskogo universiteta = Bulletin of the Maikop State Technological University. Vol. 14, no. 1, pp.110-120, doi: 10.47370/2078-1024-2022-14-1-110-120 (In Russ., abstract in Eng.).
2. Mal’cev, D.V., Lazukova, E.A., Repeckij, D.S. (2022). Conscious Choice of Profession as the Dominant Motive of Studying at the University. Perspektivy nauki i obrazovaniya = Prospects of Science and Education. No. 6 (60), pp. 10-28, doi: 10.32744/pse.2022.6.1 (In Russ., abstract in Eng.).
3. Bajkina, E.A. (2022). Organizational and Pedagogical Conditions for Designing the System of Evaluative Means in the Competence Based Educational Programs of the University. Izvestiya Volgogradskogo gosudarstvennogo pedagogicheskogo universiteta = Proceedings of the Volgograd State Pedagogical University. No. 1 (164), pp. 45-51. Available at: https://www.elibrary.ru/download/elibrary_48117687_43531319.pdf (accessed 08.11.2023). (In Russ., abstract in Eng.).
4. Darda, I.V., Zernov, V.A. (2020) [Prospects of State Accreditation of Universities in the Context of the “Regulatory Guillotine”]. Vysshee obrazovanie segodnya = Higher Education Today. No. 6, pp. 2-7. DOI: 10.25586/RNU.HET.20.06.P.02 (In Russ.).
5. Varlamova, T.A., Gohberg, L.M., Ozerova, O.K. (2023). Education in Numbers: 2023 : A Short Statistical Collection; National research. un-t “Higher School of Economics”. Moscow: ISIEZ VSHE. 132 p. Available at: https://www.hse.ru/primarydata/ovz2023 (accessed 08.11.2023). (In Russ.).
6. Isaeva, T.E. (2014). Evaluation Competence of a University Teacher: Content and Purposes. Vysshee obrazovanie v Rossii = Higher Education in Russia. No. 10, pp. 106-112. Available at: https://www.elibrary.ru/download/elibrary_22536479_63008706.pdf (accessed 08.11.2023). (In Russ., abstract in Eng.).
7. Atabekova, A.A. (2003). Linguistic Design of a Web-Site: Semiotic Aspects of Information’s Representation (in Russian and English). Vestnik Rossijskogo universiteta druzhby narodov. Seriya: Lingvistika = Bulletin of the Peoples’ Friendship University of Russia. Series: Linguistics. No. 4, pp. 90-98. Available at: https://www.elibrary.ru/download/elibrary_10008145_48076913.pdf (accessed 08.11.2023). (In Russ., abstract in Eng.).
8. Chernobaj, E.V., Efimova, E.A., Koreshnikova, YU.N., Davlatova, M.A. (2022). Pedagogicheskij dizajn: rossijskaya i zarubezhnaya issledovatel’skaya povestka [Pedagogical Design: A Russian and Foreign Research Novel]. Moscow: HSE, 44 p. https://ioe.hse.ru/pubs/share/direct/593673038.pdf (accessed 08.11.2023). (In Russ.).
9. Shingareva-Slavina, E.A. (2016). Linguistic Correctness in the Age of Total Computer Tolerance and a Scientist’s Role in This Conflict Solution. Izvestiya Rossijskogo gosudarstvennogo pedagogicheskogo universiteta im. A.I. Gercena = Proceedings of the A.I. Herzen Russian State Pedagogical University. No. 182, pp. 18-27. Available at: https://elibrary.ru/download/elibrary_30274109_45191628.pdf (accessed 08.11.2023). (In Russ., abstract in Eng.).
10. Lebedeva, T.N., Shefer, O.R., Belousova, N.A. (2023). Razvitie metodicheskoj gramotnosti budushchih uchitelej v usloviyah tranzitivnoj real’nosti tekhnoparka universal’nyh pedagogicheskih kompetencij i informacionnyh innovacij [Development of Methodological Literacy of Future Teachers in the Conditions of the Transitive Reality of the Technopark of Universal Pedagogical Competencies and Information Innovations]. Chelyabinsk: A. Miller Library Publishing House, 22 p. (In Russ.).
11. Bezukladnikov, K.E., Vahrusheva, O.V. (2023). Competence-oriented Tasks as a Way of Self-Organization Formation While Teaching a Foreign Language in a Military University. YAzyk i kul’tura = Language and Culture. No. 62, pp. 162-182, doi: 10.17223/19996195/62/9 (In Russ., abstract in Eng.).
12. Petrushina, N.N., Uvarova, M.N. (2009). [The Use of Internet Testing as a Form of Quality Control of Students’ Training]. Aktual’nye problemy gumanitarnyh i estestvennyh nauk = Actual Problems of Humanities and Natural Sciences. No. 7-2, pp. 153-155. Available at: https://www.elibrary.ru/download/elibrary_25145002_10647866.pdf (accessed 08.11.2023). (In Russ.).
13. Nagovicyn, R.S., Rassolova, E.A., Senator, S.Yu., Torbina, I.I. (2016). Web Portal Design to Prepare Students for GTO Tests. Teoriya i praktika fizicheskoj kul’tury = Theory and Practice of Physical Culture. No. 1, pp. 39-42. Available at: https://www.elibrary.ru/download/elibrary_12892250_90529458.pdf (accessed 08.11.2023). (In Russ., abstract in Eng.).
14. Mineeva, O.A., Daricheva, M.V. (2016) The Organization of Testing in the MOODLE System in Teaching Foreign Languages. Nauchno-pedagogicheskoe obozrenie = Scientific and Pedagogical Review. No. 3 (13), pp. 81-86. Available at: https://www.elibrary.ru/download/elibrary_27328515_20622079.pdf (accessed 08.11.2023). (In Russ., abstract in Eng.).
15. Komarov, G.A., Konanyhina, A.K. (2016). The Science of Medical Errors as a Foundation Construction System Evaluation of Quality Health Care. Vestnik Kyrgyzskoj gosudarstvennoj medicinskoj akademii imeni I.K. Ahunbaeva = Bulletin of the Kyrgyz State Medical Academy named after I.K. Akhunbayev. No. 5, pp. 33-37. Available at: https://www.elibrary.ru/download/elibrary_28184727_24130837.pdf (accessed 08.11.2023). (In Russ., abstract in Eng.).
16. Razumovskaya, V.A. (2016). Translation Axiology and Erratology: Cultural Information and Symmetry: Journal of Siberian Federal University. Humanities and Social Sciences. Vol. 9, no. 3, pp. 579-587, doi: 10.17516/1997-1370-2016-9-3-579-587
17. Kotyurova, M.P. (2016). [Epistemic Situation as a Semantic Unit of a Scientific Text in Stylistic and Rhetorical Aspects (Towards the Development of the Concept)]. Stylistyka = Stylistics. – Vol. 25, pp. 485-497. Available at: https://www.elibrary.ru/item.asp?id=41170911 (accessed 08.11.2023). (In Russ.).
18. Tsai, K.H., Wang, T.I., Hsieh, T.C. et al. (2010). Dynamic Computerized Testlet-Based Test Generation System by Discrete PSO with Partial Course Ontology. Expert Systems with Applications. Vol. 37, no. 1, pp. 774-786, doi: 10.1016/j.eswa.2009.05.090
19. Krylova, O.N. (2010). Razvitie znanievoj tradicii v sovremennom soderzhanii otechestvennogo shkol’nogo obrazovaniya [The Development of the Knowledge Tradition in the Modern Content of Domestic School Education]. Saint-Petersburg: Lem, 355 p. ISBN: 978-5-98709-223-1. (In Russ.).
20. Holodnaya, M.A., Gel’fman, E.G. (2016). Razvivayushchie uchebnye teksty kak sredstvo intellektual’nogo vospitaniya uchashchihsya [Developing Educational Texts as a Means of Intellectual Education of Students]. Moscow: Institute of Psychology of the Russian Academy of Sciences. 200 p. ISBN: 978-5-9270-0320-4. (In Russ.).
21. Muhametzyanova, F.G., Hajrutdinov, R.R. (2021). About B. Bloom’s Taxonomy and Competence Tests. Global’naya ekonomika i obrazovanie = Global Economy and Education. Vol. 1, no. 3, pp. 54-61. Available at: https://elibrary.ru/download/elibrary_46423704_45116097.pdf (accessed 08.11.2023). (In Russ., abstract in Eng.).
22. Laposhina, A.N., Lebedeva, M.YU. (2021) Textometr: an Online Tool for Automated Complexity Level Assessment of Texts for Russian Language Learners. Rusistika = Russian studies. Vol. 19, no. 3, pp. 331-345, doi: 10.22363/2618-8163-2021-19-3-331-345 (In Russ., abstract in Eng.).
23. Nechaeva, N.V., Hel’mle, K.S., Kairova, E.M. (2021). Easyand Plain Language Translation as an Intralingualtype of Translation & Training the Intralingualtranslators. Vestnik Volgogradskogo gosudarstvennogo universiteta. Seriya 2, Yazykoznanie = Bulletin of Volgograd State University. Series 2, Yazykoznanie. Vol. 20, no. 3, pp. 99-108, doi: 10.15688/jvolsu2.2021.3.9 (in Russ., abstract in Eng.)
24. Lotman, Yu.M. (2000). Semiosfera [Semiosphere]. Saint-Petersburg: Art-St. Petersburg, 704 p. ISBN: 5-210-01488-6. (In Russ.).
25. Kotyurova, M.P. (2022). Interpretation of Quality of Model Scientific Text. Vestnik Tyumenskogo gosudarstvennogo universiteta. Gumanitarnye issledovaniya. Humanitates = Bulletin of the Tyumen State University. Humanitarian studies. Humanitatis. Vol. 8, no. 1 (29), pp. 6-18, doi: 10.21684/2411-197X-2022-8-1-6-18 (In Russ., abstract in Eng.).
26. Shelestyuk, E.V. (2009) [Methodology for Identifying Quantitative Indicators of the Truth, Informativeness and Information Density of Texts]. Sistema yazyka: sinhroniya i diahroniya: Mezhvuzovskij sbornik nauchnyh statej = Language System: Synchrony and Diachrony: Inter-university Collection of Scientific Articles. Ufa: RIC BASHGU. Pp. 151-156. (In Russ., abstract in Eng.).
27. Das, B., Majumder, M., Phadikar, S. et al. (2021). Automatic Question Generation and Answer Assessment: A Survey. RPTEL. Vol. 16, no. 5, doi: 10.1186/s41039-021-00151-1
28. Kozhevnikov, V.A., Sabinin, O.Yu. (2018). System of Automatic Verification of Answers to Open Questions in Russian. Nauchno-tekhnicheskie vedomosti Sankt-Peterburgskogo gosudarstvennogo politekhnicheskogo universiteta. Informatika. Telekommunikacii. Upravlenie = Scientific and Technical bulletin of St. Petersburg State Polytechnic University. Computer science. Telecommunications. Management. Vol. 11, no. 3, pp. 57-72, doi: 10.18721/JCSTCS.11306 (In Russ., abstract in Eng.).
Review
Views:
413
Email this article 