METHODOLOGY OF EVALUATING THE EFFICIENCY OF INFORMATION SUPPORT FOR DECISION-MAKING IN THE MANAGEMENT OF COMPLEX DYNAMIC OBJECTS

Abstract. Objectives The process of managing complex dynamic objects and systems is inevitably connected with the problem of the effectiveness of providing qualitative support information for making managerial decisions. The creation and application of an information system (IS) makes it results in a need to evaluate its effectiveness. Methods The article presents a methodology for evaluating the effectiveness of information systems in solving problems related to the management of complex dynamic objects. The content of the functional information system quality criteria is specified. Results  Efficiency and quality indicators of an information system oriented towardsthe analysis of data related to information processing problems are substantiated. It is suggested that the necessary and sufficient condition for evaluating the effectiveness of an information system is the dimensionality of its indicator. A comparative analysis of variants of the solution is presented on the basis of their direct ranking, taking into account the significance of the scalar integral quality indicator. The transition to a vector indicator, whose elements are partially derived from the system’s own quality indicators, each of which can have an independent value for the subsequent level of the hierarchy, is indicated. Conclusion  The need to take into account the partial indicators leads to specific methods for analysing and synthesising systems on the basis of a multi-criteria approach based on the state space concept. The content of the quality criteria for the information systems is specified in the article. A developed methodology for evaluating the effectiveness of information systems in solving problems relating to the management of complex dynamic objects, based on multi-criteria optimisation, is presented. Thedeveloped generalised information system quality indicator is justified. On the basis of the state space concept, it is possible to move away from the generally unsuitable scalar integral quality criterion of information systems to the vector of eigenvalues.

information system efficiency, state space concepts, criteria, indicator, quality, methodology, evaluation, management, system, decision-making

1. Yusupov R.M., Musaev A.A. Osobennosti otsenivaniya effektivnosti informatsionnykh sistem i tekhnologii. Trudy SPIIRAN. 2017; 2(51). [Yusupov R.M., Musaev A.A. Features of the evaluation of the effectiveness of information systems and technologies. Proceedings of SPIIRAN. 2017; 2(51). (In Russ.)]

2. GOST 24.702-85. Edinaya sistema standartov ASU. Effektivnost' AS. Osnovnye polozheniya. M.: Izdvostandartov; 1986. 6 s. [GOST 24.702-85. Unified system of standards for automated control systems. Effectiveness of the AS. Basic provisions. Moscow: Izd-vostandartov; 1986. 6 p. (In Russ.)]

3. GOST 28195-89. Otsenka kachestva programmnykh sredstv: osnovnye polozheniya. M.: Izd-vostandartov; 1989. 38 s. [GOST 28195-89.Evaluation of the quality of software: basic provisions. Moscow: Izd-vostandartov; 1989. 38 p. (In Russ.)]

4. GOST 40.9001-88. Sistemykachestva. Model' sistemy kachestva pri proektirovanii ili razrabotke. M.: Izdvostandartov; 1989. 119 s. [GOST 40.9001-88. Quality systems. Model of the quality system in the design or development. Moscow: Izd-vostandartov; 1989. 119 p. (In Russ.)]

5. Mezhdunarodnyi standart ISO 9001:1994. Sistemy kachestva. Model' obespecheniya kachestva pri proektirovanii, razrabotke, proizvodstve, montazhe i obsluzhivanii. M.: Izd-vostandartov, 1996; 94 s. [International standard ISO 9001: 1994. Quality systems. Model of quality assurance in the design, development, production, installation and maintenance. Moscow: Izd-vostandartov, 1996; 94 s. (In Russ.)]

6. Inmon U., Fridman L. Metodologiya ekspertnoi otsenki proektnykh reshenii dlya sistem s bazami dannykh. M.: Finansy i statistika; 1986. 227 c. [Inmon U., Fridman L. Methodology of expert evaluation of design solutions for systems with databases. Moscow: FinanceandStatistics; 1986. 227 c. (In Russ.)]

7. Ankhimyuk V.L., Oleiko O.F., Mikheev N.N. Teoriya avtomaticheskogo upravleniya. M.: Dizain PRO; 2002. [Ankhimyuk V.L., Oleiko O.F., Mikheev N.N. Theory of automatic control. M.: Dizain PRO; 2002. (In Russ.)]

8. Besekerskii V.A., Popov E.P. Teoriya sistem avtomaticheskogo upravleniya. SPb.: Professiya; 2003. [Besekerskii V.A., Popov E.P. The theory of automatic control systems. SPb.:Professiya; 2003. (In Russ.)]

9. Vendrov A.M. CASE-tekhnologii. Sovremennye metody i sredstva proektirovaniya informatsionnykh sistem. M.: Finansy i statistika; 2003. [Vendrov A.M. CASE-technology. Modern methods and means of designing information systems. Moscow: Finance and Statistics; 2003. (In Russ.)]

10. GavrilinYu.F., Demchenko A.I., Katochkov V.M. Informatsionnye tekhnologii upravleniya: Ucheb. Posobie. Chelyabinsk: Izd-voYuUrGU; 2003. [GavrilinYu.F., Demchenko A.I., Katochkov V.M. Information technology management: tutorial. Chelyabinsk: Publishing house of YuUrGU; 2003. (In Russ.)]

11. Bernson A. Data Warehousing: Architecture and Technology. Los Angeles: McGraw-Hill So; 1997. 512 p.

12. Semenov S.S. Otsenka kachestva i tekhnicheskogo urovnya slozhnykh sistem. Praktika primeneniya metodov ekspertnykh otsenok. M.: Lenand; 2015. 352 s. [Semenov S.S. Assessment of the quality and technical level of complex systems. The practice of applying expert assessment methods. Moscow: Lenand; 2015. 352 p. (In Russ.)]

13. Martin Dzh. Planirovanie razvitiya avtomatizirovannykh sistem. M.: Finansy i statistika; 1984. 196 s. [Martin Dzh. Planning for the development of automated systems. Moscow: Finance and Statistics; 1984. 196 p. (In Russ.)]

14. Chastikov A.P., Gavrilova T.A., Belov D.L. Razrabotka ekspertnykh sistem. Sreda CLIPS. SPb: BKhV-Peterburg; 2003. 396 s. [Chastikov A.P., Gavrilova T.A., Belov D.L. Development of expert systems. CLIPS environment. SPb: BKhV-Peterburg; 2003. 396 p. (In Russ.)]

15. LyugerD.F. Iskusstvennyi intellekt: Strategii i metody resheniya slozhnykh problem. M.: Izdat. dom «Vil'yams»; 2005. [Lyuger D.F. Artificial Intelligence: Strategies and methods for solving complex problems. Moscow: Publishing house «Williams»; 2005. (In Russ.)]

16. Devyatkov V.V. Sistemy iskusstvennogo intellekta: Ucheb. posobiedlyavuzov (Pod red. I.B. Fedorova). M.: Izdvo MGTU; 2001. [Devyatkov V.V. Systems of artificial intelligence: tutorial for high schools (Edited by I.B. Fedorov). Moscow: Izd-vo MSTU; 2001. (In Russ.)]

17. Rassel S., Norvig P. Iskusstvenny iintellekt: sovremennyi podkhod. M.: Izdat. dom «Vil'yams»; 2007. [Rassel S., Norvig P. Artificial intelligence: a modern approach. Moscow: Publishing house «Williams»; 2007. (In Russ.)]

18. Nedbai A.A., Merzlikina N.V. Osnovy kvalimetrii. Versiya 1.0 [Elektronnyiresurs]: elektron. ucheb. posobie. Elektron. dan. (2 Mb). Krasnoyarsk : IPK SFU; 2008. (Kvalimetriya: UMKD № 104-2007 / ruk. tvorch. kollektiva A.A. Nedbai). [Nedbai A.A., Merzlikina N.V. Fundamentals of qualimetry. Version 1.0 [Electronic resource]: electronic tutorial. Electronic Data (2 MB). Krasnoyarsk: IPK SFU; 2008. (Qualification: Educational and Cultural Institute № 104-2007 / head of the creative team A.A. Nedbai). (In Russ.)]

19. Chekmarev A.N. Kvalimetriya i upravleniekachestvom. Ch.1. Kvalimetriya: ucheb. posobie. Samara: Izd-vo Samar. gos. Aerokosm. un-ta; 2010. 172 s. [Chekmarev A.N. Qualimetry and quality management. Part 1. Qualimetry: tutorial. Samara: Izd-vo Samar. gos. Aerokosm. un-ta; 2010. 172 p. (In Russ.)]

20. Greshilov A.A. Matematicheskie metody prinyatiya reshenii: Ucheb. Posobie dly avuzov. M.: Izd-vo MGTU im. Baumana; 2006. 584 s. [Greshilov A.A. Mathematical methods of decision making: tutorial for universities. Moscow: Izd-vo MSTU; 2006. 584 p. (In Russ.)]

21. KotsyubaI.Yu., Chunaev A.V. i dr. Metodyotsenki i izmereniya kharakteristik informatsionnykh sistem. Uchebnoe posobie. SPb: universitet ITMO; 2015. 264 s. [KotsyubaI.Yu., Chunaev A.V. et al. Methods for assessing and measuring the characteristics of information systems. Tutorial. St. Petersburg: ITMO University; 2015. 264 p. (In Russ.)]

22. Aleksandrovskaya L.N., Kruglov V.I., Kuznetsov A.G. i dr. Teoreticheskie osnovy ispytanii i eksperimental'naya otrabotka slozhnykh tekhnicheskikh sistem. Ucheb. posobie. M.: Logos; 2003. 734 s. [Aleksandrovskaya L.N., Kruglov V.I., Kuznetsov A.G. i dr.Theoretical bases of tests and experimental testing of complex technical systems. Tutorial. Moscow: Logos; 2003. 734 p. (In Russ.)]

23. Dudarenko N.A., Nuiya O.S., Serzhantova M.V., Slita O.V., Ushakov A.V. Matematicheskie osnovy teoriisistem: lektsionnyikursi praktikum. Uchebnoe posobie dlya vysshikhuchebnykh z avedenii (Podred. A.V. Ushakova).SPb.: NIU ITMO; 2014. 292 s. [Dudarenko N.A., Nuiya O.S., Serzhantova M.V., Slita O.V., Ushakov A.V. Mathematical foundations of the theory of systems: lecture course and practical work. Textbook for higher educational institutions (Edited by A.V. Ushakov). SPb.: NIU ITMO; 2014. 292 p. (In Russ.)]