Research and development of data compression methods for technical monitoring systems
https://doi.org/10.21822/2073-6185-2023-50-3-156-166
Abstract
Objective. The aim of the study is to develop methods for data compression in relation to monitoring systems.
Method. The studies were carried out mainly experimentally, by processing data generated by the information-measuring system of the Altai State Technical University in the process of meteorological observations, temperature control and control of the consumption of such energy resources as hot and cold water, heat supply. However, when it was proposed to change their structure and presentation form to compact the stored data, the degree of compression was found theoretically.
Result. The results of studies conducted with the participation of the author of the publication in the field of data processing, transmission and storage are presented. Methods for streaming data compression “on the fly” as it arrives, both lossy and lossless, as well as methods based on optimizing the structure of databases designed to store information collected during monitoring, are considered. The main attention is paid to the consideration of data compression created in the process of temperature monitoring, since it is the control and monitoring of temperature processes that is most common in various technical process control systems, heat metering systems both on the consumer side (housing and communal services) and on the side of the heat supply organization.
Conclusion. In the vast majority of cases, lossless compression allows you to compress the information received from the monitoring system by more than 10 times, and lossy compression is much stronger, and without losing the pragmatic value of the stored information.
About the Author
A. G. Yakunin
I.I. Polzunova Altai State Technical University
Russian Federation
Russian Federation
Aleksey G. Yakunin, Dr. Sci. (Eng), Prof., Head of the Department of Informatics, Computer engineering and Information security,
46 Lenin Ave., Barnaul 656038
References
1. Temperature control, control of temperature. https://ruglonass.ru/kontrol-temperaturnogo-rezhima-na-skladakh.php (01.06.2023) (In Russ)
2. All about data, image and video compression. https://www.compression.ru/ (01.06.2023) (In Russ)
3. Solomon D. Data Compression: The Complete Reference: Fourth edition/ David Solomon.- London: Springer, 2007;1093.
4. Hahina A.M.: Modern archiving algorithms. Notes of a scientist 2, 189 -192 (2020). - https://e.lanbook.com/reader/journalArticle/704000 (In Russ)
5. Lihtsinder B.Ya, Bakai Yu.O.: Adaptive measurement data compression in wireless sensor networks. Measurement. Monitoring. Control. Cheking 1, 52-57 (2021). https://e.lanbook.com/reader/journalArticle/603370 (In Russ)
6. Bogachev I.V., Levenets A.V. Chie Yen Un: Geometric approach to data compression of telemetry systems. Informatics and control systems 4, 16-22 (2015).https://e.lanbook.com/reader/journalArticle/346090 (In Russ)
7. Artyushkin A.B. Kuksenko M.A., Pantenkov A.P. Economical coding as a method of increasing the speed of information transmission in telemetry systems. Bulletin of the Russian New University. Series Complex Systems Models, Analysis and Control 2020;1:43-54 https:e.lanbook.com/reader/JournalArticle/782456
8. Bakulina M.P. Efficient coding of run length encoding during facsimile data transmission over the network. Polzunovskiy vestnik 2013;2,257-259 https://e.lanbook.com/reader/journalArticle/405229 (In Russ)
9. Minkin A.S., Nikolaeva O.V., Russkov A.A.: Compression of Hyperspectral Data by Principal Component Method. Computer optics 2021; 235-246 https://e.lanbook.com/reader/journalArticle/595721 (In Russ)
10. Yarmolenko A.S., Skobenko O.V.: Application of the theory of wavelets in the compression and filtering of geoinformation. Notes of the Mining Institute 234, 612-623 (2018). https://e.lanbook.com/reader/journalArticle/71014 (In Russ)
11. Suchkova L.I., Hussein H.M., Yakunin M.A., Yakunin A.G.: Scalable software and hardware solutions for environmental and technical monitoring. Polzunovskiy Almanac 1, 75-82 (2013). https://e.lanbook.com/reader/journalArticle/379151 (In Russ)
12. Hussein H.М., Kuntz R.V., Suchkova L.I., Yakunin A.G.: Design and implementation of weather and technology process monitoring systems. Herald of the Altai State University 1-1(77), 210-214 (2013).
13. Yakunin A.G., Hussein H.M.: Hardware-software and algorithmic provision of multipoint systems for long-term monitoring of dynamic processes. IOP Conf. Series: Journal of Physics 881 012028 (2017). DOI: 90.1088/1742-6596/881/1/012028
14. Hussein H.М., Suchkova L.I., Yakunin A.G.: Ways for improving methods of data storing in monitoring systems. Polzunovskiy Almanac 2, 2012; 48-50
15. Hussein, H. M., Yakunin A.G.: Data Differencing Method To Optimize Data Storing In Weather Monitoring System. Polzunovskiy Herald 2013; 2:65-68 https://journal.altstu.ru/media/f/old2/pv2013_02/pdf/065hussein.pdf
16. Melnikov E.M., Yakunin A.G.: Investigation of the effectiveness of lossless compression methods for temperature monitoring data. Procedings of the XX International scientific and technical conference “Measurement, control, informatization” 32-38 (2019). https://elibrary.ru/item.asp?id=41166261 (In Russ)
17. Hussein H. M., Yakunin A.G.: Simple Curve Smoothing Methods For Weather Monitoring System. Materiali XI Mezinarodni vedecko-practicka conference «Veda a Technologie: krok do budoucnos-ti-2015», Dil 17. Technichke vedy. Praha, 2015; 73-76.
18. Hussein H., Yakunin A., Suchkova L. A Comparison of Data Compression Methods for Solving Problems of Temperature Monitoring. MATEC Web of Conferences, 79 (2016). http://dx.doi.org/10.1051/matecconf/20167901076.
19. Zhen Ch., Ren : Design and Realization of Data Compression in Real-Time Data-base.” IEEE International Conference on Computational Intelligence and Software Engi-neering, China, 11 – 13 Dec 2009: 340-243
20. Ray G.: Data Compression in Databases. Master’s Thesis, Dept. of Computer Science and Automation, Indian Institute of Science, June (1995).
21. Yang H.: On the performance of data compression algorithms based upon string matching. IEEE Transactionson Information Theory. 1998; 44(1):47- 65.
22. Lin M., Chang Y. Yi: A New Architecture of a Two-Stage Lossless Data Compression and Decompression Algorithm. IEEE transactions on VLSI 2009; 17( 9): 1297- 1303.
23. Tamrakar A., Nanda V. A Compression Algorithm for Optimization of Storage Con-sumption of Non Oracle Database 2012; 1(5):39-43.
24. Yakunin A. and Suchkova L. Application of the E – layer model for solving the problems of parametric estimation in measuring devices. MATEC Web of Conferences 155, 01020 (2018) DOI: https://doi.org/10.1051/matecconf/201815501020
25. Suchkova L.I., Yakunin A.G.: Application of E-Regions of the Parameters of the Model Function of the Signal for the Extraordinary Situations Detection. 2018 International Multi-Conference on Industrial Engineering and Modern Technologies (FarEastCon, 3-4 Oct. 2018). IEEE Xplore 1-6 (2019), URL: https://ieeexplore.ieee.org/document/8602766, DOI: 10.1109/FarEastCon.2018.8602766
26. Suslova S.V., Yakunin A.G. A method for extracting a trend of a non-stationary process with adaptation of approximation intervals. Patent of Russia № 2645273. 2018; 5 (In Russ)
Review
For citations:
Yakunin A.G. Research and development of data compression methods for technical monitoring systems. Herald of Dagestan State Technical University. Technical Sciences. 2023;50(3):156-166. (In Russ.) https://doi.org/10.21822/2073-6185-2023-50-3-156-166
Views:
254
Email this article 
