DOI: 10.17587/prin.16.435-446

On the Model of Peer Review of Scientific and Technical Articles and its Use in Categorizing the Editions Publishing them

V. A. Vasenin¹, Head of Chair, vasenin@msu.ru, M. A. Krivchikov¹, Senior Researcher, maxim.krivchikov@gmail.com, S. D. Makhortov², Head of Chair, msdexp@yandex.ru, D. A. Shachnev¹, Researcher, mitya57@gmail.com,
¹ Lomonosov Moscow State University, Moscow, 119192, Russian Federation,
² Voronezh State University, Voronezh, 394006, Russian Federation

Corresponding author: Dmitry A. Shachnev, Researcher, Lomonosov Moscow State University, Moscow, 119192, Russian Federation, E-mail: mitya57@gmail.com

The paper examines the results of studies aimed at developing and testing a model for reviewing scientific and technical publications with the aim of using it to solve the problem of ranking scientific journals. The indicators that can be used for ranking include not only traditional bibliometric indicators of a journal, statistical data about it (for example, the number of issues and articles per year), but also information about the members of the editorial board, reviewers, the process and results of reviewing. Based on the experience of working with both individual journals and a large interactive information system analyzing such journals, the authors propose a model for collecting and storing information about reviewing, as well as a method for taking this and other data into account when categorizing journals and, as a result, increasing the efficiency of their editorial boards. The described model can be useful for the editorial boards of journals themselves, since it allows for the automation of various complex processes, such as the selection of reviewers and correspondence between reviewers, authors and the editorial board.

Keywords: scientific journals, peer review, expert search, journal ranking, impact factors, CRIS systems, subject area, research areas

pp. 435—446

For citation:
Vasenin V. A., Krivchikov M. A., Makhortov S. D., Shachnev D. A. On the Model of Peer Review of Scientific and Technical Articles and its Use in Categorizing the Editions Publishing them, Programmnaya Ingeneria, 2025, vol. 16, no. 9, pp. 435—446. DOI: 10.17587/prin.16.435-446 (in Russian).

References:

1. Moskaleva O. V., Akoev M. A. Forecast of the Development of Russian Scientific Journals: The Publishers, Nauka i nauchnaya informatsiya, 2020, vol. 3, no. 2—3, pp. 131—154. DOI: 10.24108/2658-3143-2020-3-2-3-131-154 (in Russian).
2. Bornmann L., Mutz R. Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references, Journal of the Association for Information Science and Technology, 2015, vol. 66, no. 11, pp. 2215—2222. DOI: 10.1002/asi.23329.
3. Dyachenko E. L. Internationalization of academic journals: Is there still a gap between social and natural sciences? Scientometrics, 2014, vol. 101, pp. 241—255. DOI: 10.1007/s11192-014-1357-9.
4. Mokhnacheva Yu. V. Lists of Journals and Ratings of Russian Publications: Inconsistencies and Possible Ways to Eliminate Them, Upravlenie naukoy: teoriya i praktika, 2024, vol. 6, no. 2, pp. 147—167. DOI: 10.19181/smtp.2024.6.2.11.
5. Grinev A. V. Problems of Scientometrics and its Suitability for Management Scientific Activity in Modern Russia, Upravlencheskie nauki, 2024, vol. 14, no. 1, pp. 117—132. DOI: 10.26794/2404-022X-2024-14-1-117-132.
6. Vasenin V. A., Afonin S. A., Golomazov D. D. et al. Intellectual System for Thematic Investigation of Scientometric Data ("ISTINA"), Moscow, Lomonosov Moscow State University publishing, 2014, 262 p. (in Russian).
7. Melnikov O. N. Peer-review as a factor in improving the quality of scientific information, Nauchnaya periodika: problemy i resheniya, 2011, vol. 2, no. 2, pp. 20—23 (in Russian).
8. Romanova S. A. Basic Criteria of the Review of Articles into the Scientific Journal, Akademicheskaya mysl, 2019, no. 1, pp. 139—144 (in Russian).
9. Gayavieva M. S., Elizarov A. M., Lipachyov E. K. Digital infrastructure of electronic scientific journal: automation of editorial and publishing process and system of services, Elektronnyye biblioteki, 2016, vol. 19, no. 5, pp. 408—465 (in Russian).
10. Borisov N. V., Zakharkina V. V., Mbogo I. A. et al. Building a Publishing Toolkit for Multimedia Sciece Journals, Elektronnyye biblioteki, 2020, vol. 23, no. 3, pp. 292—314. DOI: 10.26907/1562­5419-2020-23-3-292-314 (in Russian).
11. Glushanovskiy A. V. Creating and Evolution Centralized Scientific Journals Remote Access System for Information Support of Russian Scientific Research, Nauka i nauchnaya informatsiya, 2022, vol. 5, no. 2, pp. 61—75. DOI: 10.24108/2658-3143-2022-5-2-2 (in Russian).
12. Van Rooyen S., Black N., Godlee F. Development of the Review Quality Instrument (RQI) for Assessing Peer Reviews of Manuscripts, Journal of Clinical Epidemiology, 1999, vol. 52, no. 7, pp. 625—629. DOI: 10.1016/s0895-4356(99)00047-5.
13. Landkroon A. P., Euser A. M., Veeken H. et al. Quality assessment of reviewers' reports using a simple instrument, Obstet Gynecol, 2006, vol. 108, no. 4, pp. 979—985. DOI: 10.1097/01.AOG.0000231675.74957.48.
14. Superchi C., Gonzalez J. A., Sola I. et al. I. Tools used to assess the quality of peer review reports: a methodological systematic review, BMC Medical Research Methodology, 2019, vol. 19, article 48. DOI: 10.1186/s12874-019-0688-x.
15. Shachnev D. A. Methods for Thematic Analysis and Ranking in Information Analysis Systems Based on Relational DBMS, Programmnaya Ingeneria, 2024, vol. 15, no. 3, pp. 125—133. DOI: 10.17587/prin.15.125-133 (in Russian).
16. Vasenin V. A., Zenzinov A. A., Lunev K. V. The Usage of CRIS-systems for the Contest Procedures Automation in Terms of the ISTINA Information System, Programmnaya Ingeneria, 2016, vol. 7, no. 10, pp. 472—480. DOI: 10.17587/prin.7.472-480 (in Russian).
17. Shachnev D. A. Searching for Activity Results and Experts in a Given Subject Area, Taking Results Significance into Account, Programmnaya Ingeneria, 2021, vol. 12, no. 5, pp. 260—266. DOI: 10.17587/prin.12.260-266 (in Russian).