On methods of setting the coordinates of the mouse pointer in the case of alternative options for constructing human-computer interaction
https://doi.org/10.21822/2073-6185-2024-51-4-123-129
Abstract
Objective. The aim of the study is to compare and generalize different methods of contactless setting of computer mouse pointer coordinates. Method. To create a contactless human-machine interface, computer vision technologies are used to select a control point on a video camera frame, with the help of which the computer cursor is moved on the user's monitor. General logical methods of scientific research, namely, generalization, are used. An analysis of the considered cursor coordinate control systems is carried out with the allocation of common parts for further generalization and description of formulas for setting the coordinates of the computer mouse cursor. Scientific works with absolute positioning of the computer cursor and works with control of the cursor position shift relative to its coordinates on the previous frame were taken for analysis. Result. As a result of the analysis, strengths and weaknesses of each of the approaches under consideration were indicated. Absolute positioning requires less time to set the cursor to the desired position. It is determined that cursor shift control is not so demanding on the accuracy of calculating the coordinates of the control point. Formulas are given that generalize the methods of moving the computer cursor. Conclusion. The proposed approach to calculating new coordinates of the mouse pointer allows implementing both presented approaches to positioning the computer cursor in the software system, since each of them has advantages depending on the specific situation.
About the Author
P. V. Peresunko
Siberian Federal University
Russian Federation
Russian Federation
Pavel V. Peresunko, Senior Lecturer, Scientific and Educational laboratory of software, Department of Software Engineering, Institute of Space and Information Technologies
79 Svobodny Ave., Krasnoyarsk 660041
References
1. Peresunko P.V. Review of techniques for developing human - computer interactions in the challenge of computer cursor control. Products "NPTSAP". Systems and control devices. 2022; 4(62): 26–39. (In Russ).
2. Budko H.A., Medvedev M.Y.., Budko A.Y. Development and research of a method for vector analysis of forearm EMG for the construction of Human-Machine Interfaces. News of the Southern Federal University. Technical science. 2021;2:18–31 (In Russ).
3. Khan M.M., Sherazi H.I., Quain R. Tongue-Supported Human-Computer Interaction systems: a review. 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, USA, Chicago, 2014;1410–1415.
4. IntegraMouse Plus – the mouth controlled mouse. IntegraMouse Plus [сайт]. URL: https://www.integramouse.com/en/home/ (access date: 21/06/2024).
5. IntegraMouse Plus – the mouth controlled mouse. IntegraMouse Plus [сайт]. URL: https://www.integramouse.com/en/home/ (access date: 21/06/2024).
6. Rawlani S., Biyani P., Juneja S. Eye Tracking- An Extensive Evaluation of a Contemporary and Ingenious Technology. International Journal of Computer Applications, 2018;179(54): 5–11.
7. Zuniga R., Magee J. Camera Mouse: Dwell vs. Computer Vision-Based Intentional Click Activation // Universal Access in Human–Computer Interaction. Designing Novel Interactions. UAHCI 2017. Lecture Notes in Computer Science. Antona, M., Stephanidis, C. (eds). 2017;10278. https://doi.org/10.1007/978-3-319-58703-5_34
8. Автор, Pleshkova E., Semizorova A., Kovalev I. MLI. Mouse: a new computer vision-based cursor control software. V International Workshop on Modeling, Information Processing and Computing (MIP: Computing-V-2022) : Conference Proceedings, Krasnoyarsk, 25 January 2022. Krasnoyarsk : CEUR-WS, 2022; 3091: 60–65. DOI: 10.47813/dnit-mip5/2022-3091-60-65.
9. Betke M., Gips J., Fleming P. The camera mouse: visual tracking of body features to provide computer access for people with severe disabilities. IEEE Trans Neural Syst Rehabil Eng. 2002; 10 (1): 1-10. DOI: 10.1109/TNSRE.2002.1021581.
10. Varun K.S., Puneeth I., Jacob T. P. Virtual Mouse Implementation using Open CV // 2019 3rd International Conference on Trends in Electronics and Informatics (ICOEI). Tirunelveli. India. 2019; 435- 438. DOI: 10.1109/ICOEI.2019.8862764.
11. Niyazi K., Kumar V., Mahe S., Vyawahare S. Mouse Simulation Using Two Coloured Tapes. International Journal of Information Sciences and Techniques, 2: 2: 57–63.
12. Park Hojoon. A Method for Controlling Mouse Movement using a Real-Time Camera. 2009. URL: https://api.semanticscholar.org/CorpusID:18232695 (access date: 21.06.2024).
13. Nabati M., Behrad A. 3D Head pose estimation and camera mouse implementation using a monocular video camera. Signal, Image and Video Processing, 2015; 9: 39–44.
14. Song Y., Luo Y., Lin J. Detection of Movements of Head and Mouth to Provide Computer Access for Disabled // 2011 International Conference on Technologies and Applications of Artificial Intelligence. Taiwan. 2011;223–226.
15. Khan F., Halim B., Rahman A. Computer Vision Based Mouse Control Using Object Detection and Marker Motion Tracking. International Journal of Computer Science and Mobile Computing, 2020; 9, (5):pp. 35–45.
16. Salvi M., Kegade Sh., Shinde A., Tekwani B. Cursor manipulation with hand recognition using computer vision. IT in Industry, 2021; 9(1):1455–1456.
17. Fu Y., Huang T. S. hMouse: Head Tracking Driven Virtual Computer Mouse // 2007 IEEE Workshop on Applications of Computer Vision (WACV '07. Austin. TX. USA. 2007;30-30. DOI: 10.1109/WACV.2007.29.
18. Reyes López, D. Design of an electromyographic mouse / D. Reyes López, C. Cifuentes López // 20th Symposium on Signal Processing, Images and Computer Vision (STSIVA) Colombia, Bogota, 2015.
19. Kim, J. Tongue-operated assistive technology with access to common smartphone applications via Bluetooth link / J. Kim, H. Park, M. Ghovanloo // Annual International Conference of the IEEE Engineering in Medicine and Biology Society. – USA, San Diego, 2012.
20. The Vocal Joystick: Evaluation of voice-based cursor control techniques for assistive technology / S. Harada. Disability and Rehabilitation: Assistive Technology. 2008; 3(1): 22–34.
Review
For citations:
Peresunko P.V. On methods of setting the coordinates of the mouse pointer in the case of alternative options for constructing human-computer interaction. Herald of Dagestan State Technical University. Technical Sciences. 2024;51(4):123-129. (In Russ.) https://doi.org/10.21822/2073-6185-2024-51-4-123-129
Views:
68
Email this article 
