vdgtuВестник Дагестанского государственного технического университета. Технические наукиHerald of Dagestan State Technical University. Technical Sciences2073-61852542-095XDaghestan State Technical University10.21822/2073-6185-2024-51-4-123-129vdgtu-1624Research ArticleИНФОРМАЦИОННЫЕ ТЕХНОЛОГИИ И ТЕЛЕКОММУНИКАЦИИINFORMATION TECHNOLOGY AND TELECOMMUNICATIONSО способах установки координат указателя мыши в случае альтернативных вариантов построения человеко-компьютерного взаимодействияOn methods of setting the coordinates of the mouse pointer in the case of alternative options for constructing human-computer interactionhttps://orcid.org/0000-0003-3708-129XПересунькоП. В.PeresunkoP. V.

Пересунько Павел Викторович, старший преподаватель научно-учебной лаборатории программного обеспечения кафедры «Программная инженерия», Институт космических и информационных технологий

660041, г. Красноярск, пр. Свободный, 79

Pavel V. Peresunko, Senior Lecturer, Scientific and Educational laboratory of software, Department of Software Engineering, Institute of Space and Information Technologies

79 Svobodny Ave., Krasnoyarsk 660041

pvperesunko@yandex.ruСибирский федеральный университетРоссияSiberian Federal UniversityRussian Federation202419012025514123129Copyright © Пересунько П.В., 20252025Пересунько П.В.Peresunko P.V.Данная работа распространяется под лицензией Creative Commons Attribution 4.0.This work is licensed under a Creative Commons Attribution 4.0 License.https://vestnik.dgtu.ru/jour/article/view/1624

Цель. Целью исследования является сравнение и обобщение разных способов бесконтактной установки координат указателя мыши компьютера. Метод. Для создания бесконтактного интерфейса человек-машина используются технологии компьютерного зрения для выделения управляющей точки на кадре видеокамеры, с помощью которых перемешается курсор компьютера на мониторе пользователя. Использованы общелогические методы научного исследования, а именно – обобщение. Проведен анализ рассмотренных систем управления координатами курсора с выделением общих частей для дальнейшего обобщения и описания формул установки координат курсора мыши компьютера. Для анализа были взяты научные работы с абсолютным позиционированием курсора компьютера и работы с контролем сдвига положения курсора относительно его координат на предыдущем кадре. Результат. В результате анализа были указаны сильные и слабые стороны каждого из рассматриваемых подходов. В абсолютном позиционировании требуется меньше времени для установки курсора в нужную позицию. Определено, что контроль сдвига курсора не такой требовательный к точности расчета координат управляющей точки. Приведены формулы, с помощью которых обобщаются способы перемещения курсора компьютера. Вывод. Предложенный подход к расчету новых координат указателя мыши позволяет реализовать в программной системе оба представленных подхода позиционирования курсора компьютера, так как каждый из них имеет преимущества в зависимости от конкретной ситуации.

Objective. The aim of the study is to compare and generalize different methods of contactless setting of computer mouse pointer coordinates. Method. To create a contactless human-machine interface, computer vision technologies are used to select a control point on a video camera frame, with the help of which the computer cursor is moved on the user's monitor. General logical methods of scientific research, namely, generalization, are used. An analysis of the considered cursor coordinate control systems is carried out with the allocation of common parts for further generalization and description of formulas for setting the coordinates of the computer mouse cursor. Scientific works with absolute positioning of the computer cursor and works with control of the cursor position shift relative to its coordinates on the previous frame were taken for analysis. Result. As a result of the analysis, strengths and weaknesses of each of the approaches under consideration were indicated. Absolute positioning requires less time to set the cursor to the desired position. It is determined that cursor shift control is not so demanding on the accuracy of calculating the coordinates of the control point. Formulas are given that generalize the methods of moving the computer cursor. Conclusion. The proposed approach to calculating new coordinates of the mouse pointer allows implementing both presented approaches to positioning the computer cursor in the software system, since each of them has advantages depending on the specific situation.

управление курсором мышивспомогательные технологиивзаимодействие человек-компьютервзаимодействие человек-машинакомпьютерное зрениеmouse cursor controlassistive technologieshuman-computer interactionhuman-machine interactioncomputer visionReferencesПересунько П.В. Обзор методов построения взаимодействия человек - компьютер в задаче управления курсором компьютера // Труды "НПЦАП". Системы и приборы управления. 2022. № 4(62). С. 26–39.Peresunko P.V. Review of techniques for developing human - computer interactions in the challenge of computer cursor control. Products "NPTSAP". Systems and control devices. 2022; 4(62): 26–39. (In Russ).Будко Н.А., Медведев М.Ю., Будко А.Ю. Разработка и исследование метода векторного анализа ЭМГ предплечья для построения человеко-машинных интерфейсов // Известия Южного федерального университета. Технические науки. 2021. № 2. C. 18–31.Budko H.A., Medvedev M.Y.., Budko A.Y. Development and research of a method for vector analysis of forearm EMG for the construction of Human-Machine Interfaces. News of the Southern Federal University. Technical science. 2021;2:18–31 (In Russ).Khan M.M., Sherazi H.I., Quain R. Tongue-Supported Human-Computer Interaction systems: a review. 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, USA, Chicago, 2014, pp. 1410–1415.Khan M.M., Sherazi H.I., Quain R. Tongue-Supported Human-Computer Interaction systems: a review. 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, USA, Chicago, 2014;1410–1415.IntegraMouse Plus – the mouth controlled mouse. IntegraMouse Plus [сайт]. URL: https://www.integramouse.com/en/home/ (дата обращения: 21.06.2024).IntegraMouse Plus – the mouth controlled mouse. IntegraMouse Plus [сайт]. URL: https://www.integramouse.com/en/home/ (access date: 21/06/2024).IntegraMouse Plus – the mouth controlled mouse. IntegraMouse Plus [сайт]. URL: https://www.integramouse.com/en/home/ (дата обращения: 21.06.2024).IntegraMouse Plus – the mouth controlled mouse. IntegraMouse Plus [сайт]. URL: https://www.integramouse.com/en/home/ (access date: 21/06/2024).Rawlani S., Biyani P., Juneja S. Eye Tracking- An Extensive Evaluation of a Contemporary and Ingenious Technology. International Journal of Computer Applications, 2018, vol. 179, no. 54. pp. 5–11.Rawlani S., Biyani P., Juneja S. Eye Tracking- An Extensive Evaluation of a Contemporary and Ingenious Technology. International Journal of Computer Applications, 2018;179(54): 5–11.Zuniga R., Magee J. Camera Mouse: Dwell vs. Computer Vision-Based Intentional Click Activation // Universal Access in Human–Computer Interaction. Designing Novel Interactions. UAHCI 2017. Lecture Notes in Computer Science / Antona, M., Stephanidis, C. (eds). 2017. Vol. 10278. https://doi.org/10.1007/978-3-319-58703-5_34Zuniga R., Magee J. Camera Mouse: Dwell vs. Computer Vision-Based Intentional Click Activation // Universal Access in Human–Computer Interaction. Designing Novel Interactions. UAHCI 2017. Lecture Notes in Computer Science. Antona, M., Stephanidis, C. (eds). 2017;10278. https://doi.org/10.1007/978-3-319-58703-5_34Peresunko P., Pleshkova E., Semizorova A., Kovalev I. MLI. Mouse: a new computer vision-based cursor control software // V International Workshop on Modeling, Information Processing and Computing (MIP: Computing-V-2022) : Conference Proceedings, Krasnoyarsk, 25 January 2022. Krasnoyarsk : CEUR-WS, 2022. Vol. 3091. P. 60–65. DOI: 10.47813/dnit-mip5/2022-3091-60-65.Автор, Pleshkova E., Semizorova A., Kovalev I. MLI. Mouse: a new computer vision-based cursor control software. V International Workshop on Modeling, Information Processing and Computing (MIP: Computing-V-2022) : Conference Proceedings, Krasnoyarsk, 25 January 2022. Krasnoyarsk : CEUR-WS, 2022; 3091: 60–65. DOI: 10.47813/dnit-mip5/2022-3091-60-65.Betke M., Gips J., Fleming P. The camera mouse: visual tracking of body features to provide computer access for people with severe disabilities // IEEE Trans Neural Syst Rehabil Eng. 2002. Vol. 10 (1). P. 1-10. DOI: 10.1109/TNSRE.2002.1021581.Betke M., Gips J., Fleming P. The camera mouse: visual tracking of body features to provide computer access for people with severe disabilities. IEEE Trans Neural Syst Rehabil Eng. 2002; 10 (1): 1-10. DOI: 10.1109/TNSRE.2002.1021581.Varun K.S., Puneeth I., Jacob T. P. Virtual Mouse Implementation using Open CV // 2019 3rd International Conference on Trends in Electronics and Informatics (ICOEI). Tirunelveli. India. 2019. P. 435- 438. DOI: 10.1109/ICOEI.2019.8862764.Varun K.S., Puneeth I., Jacob T. P. Virtual Mouse Implementation using Open CV // 2019 3rd International Conference on Trends in Electronics and Informatics (ICOEI). Tirunelveli. India. 2019; 435- 438. DOI: 10.1109/ICOEI.2019.8862764.Niyazi K., Kumar V., Mahe S., Vyawahare S. Mouse Simulation Using Two Coloured Tapes. International Journal of Information Sciences and Techniques, vol. 2, no. 2, pp. 57–63.Niyazi K., Kumar V., Mahe S., Vyawahare S. Mouse Simulation Using Two Coloured Tapes. International Journal of Information Sciences and Techniques, 2: 2: 57–63.Park Hojoon. A Method for Controlling Mouse Movement using a Real-Time Camera. 2009. URL: https://api.semanticscholar.org/CorpusID:18232695 (дата обращения: 21.06.2024).Park Hojoon. A Method for Controlling Mouse Movement using a Real-Time Camera. 2009. URL: https://api.semanticscholar.org/CorpusID:18232695 (access date: 21.06.2024).Nabati M., Behrad A. 3D Head pose estimation and camera mouse implementation using a monocular video camera. Signal, Image and Video Processing, 2015, vol. 9, pp. 39–44.Nabati M., Behrad A. 3D Head pose estimation and camera mouse implementation using a monocular video camera. Signal, Image and Video Processing, 2015; 9: 39–44.Song Y., Luo Y., Lin J. Detection of Movements of Head and Mouth to Provide Computer Access for Disabled // 2011 International Conference on Technologies and Applications of Artificial Intelligence. Taiwan. 2011. P. 223–226.Song Y., Luo Y., Lin J. Detection of Movements of Head and Mouth to Provide Computer Access for Disabled // 2011 International Conference on Technologies and Applications of Artificial Intelligence. Taiwan. 2011;223–226.Khan F., Halim B., Rahman A. Computer Vision Based Mouse Control Using Object Detection and Marker Motion Tracking. International Journal of Computer Science and Mobile Computing, 2020, vol. 9, iss. 5, pp. 35–45.Khan F., Halim B., Rahman A. Computer Vision Based Mouse Control Using Object Detection and Marker Motion Tracking. International Journal of Computer Science and Mobile Computing, 2020; 9, (5):pp. 35–45.Salvi M., Kegade Sh., Shinde A., Tekwani B. Cursor manipulation with hand recognition using computer vision. IT in Industry, 2021, vol. 9, no. 1, pp. 1455–1456.Salvi M., Kegade Sh., Shinde A., Tekwani B. Cursor manipulation with hand recognition using computer vision. IT in Industry, 2021; 9(1):1455–1456.Fu Y., Huang T. S. hMouse: Head Tracking Driven Virtual Computer Mouse // 2007 IEEE Workshop on Applications of Computer Vision (WACV '07. Austin. TX. USA. 2007. P. 30-30. DOI: 10.1109/WACV.2007.29.Fu Y., Huang T. S. hMouse: Head Tracking Driven Virtual Computer Mouse // 2007 IEEE Workshop on Applications of Computer Vision (WACV '07. Austin. TX. USA. 2007;30-30. DOI: 10.1109/WACV.2007.29.Reyes López, D. Design of an electromyographic mouse / D. Reyes López, C. Cifuentes López // 20th Symposium on Signal Processing, Images and Computer Vision (STSIVA) : сборник научных трудов. – Colombia, Bogota, 2015.Reyes López, D. Design of an electromyographic mouse / D. Reyes López, C. Cifuentes López // 20th Symposium on Signal Processing, Images and Computer Vision (STSIVA) Colombia, Bogota, 2015.Kim, J. Tongue-operated assistive technology with access to common smartphone applications via Bluetooth link / J. Kim, H. Park, M. Ghovanloo // Annual International Conference of the IEEE Engineering in Medicine and Biology Society: сборник научных трудов. – USA, San Diego, 2012.Kim, J. Tongue-operated assistive technology with access to common smartphone applications via Bluetooth link / J. Kim, H. Park, M. Ghovanloo // Annual International Conference of the IEEE Engineering in Medicine and Biology Society. – USA, San Diego, 2012.The Vocal Joystick: Evaluation of voice-based cursor control techniques for assistive technology / S. Harada [и др.] // Disability and Rehabilitation: Assistive Technology. – 2008. – Т. 3, № 1. – C. 22–34.The Vocal Joystick: Evaluation of voice-based cursor control techniques for assistive technology / S. Harada. Disability and Rehabilitation: Assistive Technology. 2008; 3(1): 22–34.

The authors declare that there are no conflicts of interest present.