AEGSDQ: An Enhancement of Eye Gaze System for Quadriplegia People using a Mouse Pointer

Authors

  • J. Jesy Janet Kumari Department of Computer Science & Engineering, The Oxford College of Engineering, Bangalore, India
  • Aaron Aaron Department of Computer Science & Engineering, The Oxford College of Engineering, Bangalore, India
  • Apoorva N. Department of Computer Science & Engineering, The Oxford College of Engineering, Bangalore, India
  • Arezoo Salman Department of Computer Science & Engineering, The Oxford College of Engineering, Bangalore, India
  • Nabanita Das Department of Computer Science & Engineering, The Oxford College of Engineering, Bangalore, India

Keywords:

Eye-tracking; Ocular motions; Physical impairments; Physical limitations; User-friendly.

Abstract

This paper focuses on providing a simple and convenient interactive mode that relies solely on the user's vision. The proposed system's usage flow has been designed to perfectly mimic human natural habits. We describe the implementation of both iris and cursor movement based on iris position, which can be used to control the cursor on the screen using a webcam and Python. The eye-controlled mouse cursor system showcased in this work is one of the significant advancements toward building a more inclusive and user-friendly digital space for people with physical impairments. We propose an innovative design that enhances the accessibility of computer systems to people with physical challenges. The system incorporates eye-tracking technology to produce a new type of interface that lets the user move and control the mouse cursor on computer screens just by moving their eyes. We aim at designing and implementing a natural, intuitive interface that allows people with disabilities to interact seamlessly with computers. With the aid of non-intrusive eye-tracking devices coupled with tailored software programs, ocular motions can be accurately tracked by the system thus translating them into definite cursor movements on desktops. During this era of digitalization, the accessibility situation remains a major challenge for people with physical disabilities. Exploiting the eye- tracking technology capacities, we introduce an innovative solution to address exactly such a problem by developing an eye-controlled mouse cursor. By further improving and incorporating it with current assistive tools, our goal is to establish a future where technology caters to everyone's needs, irrespective of their physical limitations.

Downloads

Download data is not yet available.

References

Rajderkar, Dhanashree, Shivam Singh, Megha Shelare, Gayatri Akhade, and Shambhavi Mase. "Controlling Computer System using Eye Movement." International Journal of Research and Scientific Innovation (IJRSI) III (2018).

Weill-Tessier, Pierre, and Hans Gellersen. "Touch input and gaze correlation on tablets." In Intelligent Decision Technologies 2017: Proceedings of the 9th KES International Conference on Intelligent Decision Technologies (KES-IDT 2017)–Part II 9, pp. 287-296. Springer International Publishing, 2018.

Chang, Chih-Chung, and Chih-Jen Lin. "LIBSVM: a library for support vector machines." ACM transactions on intelligent systems and technology (TIST) 2, no. 3 (2011): 1-27.

Hansen DW, Qiang J (2010) In the eye of the beholder: a survey of models for eyes and gaze. IEEE Trans Pattern Anal Mach Intell 32(3):478–500.

Hamzah A, Fauzan A, Noraisyah MS (2008) Face localization for facial features extraction using a symmetrical filter and linear Hough transform. Artif Life Robot 12:157–160.

Lin, Yu-Tzu, Ruei-Yan Lin, Yu-Chih Lin, and Greg C. Lee. "Real-time eye-gaze estimation usinga low-resolution webcam." Multimedia tools and applications 65 (2013): 543-568.

Villanueva, Arantxa, and Rafael Cabeza. "Models for gaze tracking systems." EURASIP Journalon Image and Video Processing 2007 (2007): 1-16.

Williams, Oliver, Andrew Blake, and Roberto Cipolla. "Sparse and Semi-supervised Visual Mapping with the S^ 3GP." In 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06), vol. 1, pp. 230-237. IEEE, 2006.

Guestrin, Elias Daniel, and Moshe Eizenman. "General theory of remote gaze estimation using the pupil center and corneal reflections." IEEE Transactions on biomedical engineering 53, no. 6 (2006): 1124-1133.

Hansen, Dan Witzner, and John Paulin Hansen. "Robustifying eye interaction." In 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06), pp. 152-152. IEEE, 2006.

Kanakaprabha, S., P. Arulprakash, S. Praveena, G. Preethi, Thahsin Sakkeer Hussain, and V. Vignesh. "Mouse Cursor Controlled by Eye Movement for Individuals with Disabilities." In 2023 7th International Conference on Intelligent Computing and Control Systems (ICICCS), pp. 1750-1758. IEEE, 2023.

Srikrishna, M., and G. Nirmala. "Realization of Human Eye Pupil Detection System using Canny Edge Detector and Circular Hough Transform Technique." In 2023 2nd International Conference on Applied Artificial Intelligence and Computing (ICAAIC), pp. 861-865. IEEE, 2023.

Lima, M. R., J. J. A. Mendes Júnior, and D. P. Campos. "Recognition of Facial Patterns Using Surface Electromyography—A Preliminary Study." In Brazilian Congress on Biomedical Engineering, pp. 2051- 2057. Cham: Springer International Publishing, 2020.

Nalinipriya, G., T. Aishwarya, V. S. Nandinisree, KNK Amarnaath Alias Sekkappan, S. Gokul Anand, and S. Shiva Shankar. "An Innovative Rapid Cursor Control System Using Eye Movement for a Physically Challenged Person." In Modern Approaches in Machine Learning & Cognitive Science: A Walkthrough, pp. 241-247. Cham: Springer International Publishing, 2022.

Sivasangari, A., D. Deepa, T. Anandhi, Anitha Ponraj, and M. S. Roobini. "Eyeball based cursor movement control." In 2020 International Conference on Communication and Signal Processing (ICCSP), pp. 1116-1119. IEEE, 2020.

Mathew, Sharon, A. Sreeshma, Theresa Anitta Jaison, Varsha Pradeep, and S. Santhi Jabarani. "Eye movement based cursor control and home automation for disabled people." In 2019 International Conference on Communication and Electronics Systems (ICCES), pp. 1422-1426. IEEE, 2019.

Meena, Kshitij, Manish Kumar, and Mohit Jangra. "Controlling mouse motions using eye tracking using computer vision." In 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS), pp. 1001-1005. IEEE, 2020.

Zheng, Chenyang, and Tsuyoshi Usagawa. "A rapid webcam-based eye tracking method for human computer interaction." In 2018 International Conference on Control, Automation and Information Sciences (ICCAIS), pp. 133-136. IEEE, 2018.

Fasel, Ian, Bret Fortenberry, and Javier Movellan. "A generative framework for real time object detection and classification." Computer Vision and Image Understanding 98, no. 1 (2005): 182-210.

Wang, Jian-Gang, Eric Sung, and Ronda Venkateswarlu. "Estimating the eye gaze from one eye." Computer Vision and Image Understanding 98, no. 1 (2005): 83-103.

Peng, Kun, Limin Chen, Su Ruan, and Georgy Kukharev. "A robust agorithm for eye detection on gray intensity face without spectacles." Journal of Computer Science & Technology 5 (2005).

Zhang, Dengsheng, and Guojun Lu. "Evaluation of MPEG-7 shape descriptors against other shape descriptors." Multimedia Systems 9 (2003): 15-30.

Froba, Bernhard, and Christian Kublbeck. "Robust face detection at video frame rate based on edge orientation features." In Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition, pp. 342-347. IEEE, 2002.

Hansen, Dan Witzner, John Paulin Hansen, Mads Nielsen, Anders Sewerin Johansen, and Mikkel B. Stegmann. "Eye typing using Markov and active appearance models." In Sixth IEEE Workshop on Applications of Computer Vision, 2002.(WACV 2002). Proceedings., pp. 132-136. IEEE, 2002.

Betke, Margrit, James Gips, and Peter Fleming. "The camera mouse: visual tracking of body features to provide computer access for people with severe disabilities." IEEE Transactions on neural systems and Rehabilitation Engineering 10, no. 1 (2002): 1-10.

Ohno, Takehiko, Naoki Mukawa, and Atsushi Yoshikawa. "FreeGaze: a gaze tracking system for everyday gaze interaction." In Proceedings of the 2002 symposium on Eye tracking research & applications, pp. 125-132. 2002.

BT, ITU-R. Recommendation. "Parameter values for the HDTV standards for production and international programme exchange." International Telecommunication Union, Recommendation, May (2002).

Viola, Paul, and Michael Jones. "Rapid object detection using a boosted cascade of simple features." In Proceedings of the 2001 IEEE computer society conference on computer vision and patternrecognition. CVPR 2001, vol. 1, pp. I-I. Ieee, 2001.

Feng, Guo Can, and Pong C. Yuen. "Multi-cues eye detection on gray intensity image." Pattern recognition 34, no. 5 (2001): 1033-1046.

Liu, Zhu, and Yao Wang. "Face detection and tracking in video using dynamic programming." In Proceedings 2000 International Conference on Image Processing (Cat. No. 00CH37101), vol. 1, pp. 53- 56. IEEE, 2000.

Published

2024-03-14

How to Cite

Kumari, J. J. J. ., Aaron, A. ., N., A. ., Salman, A. ., & Das, N. . (2024). AEGSDQ: An Enhancement of Eye Gaze System for Quadriplegia People using a Mouse Pointer. Journal of Information Systems Research and Practice, 2(1), 2–12. Retrieved from https://vmis.um.edu.my/index.php/JISRP/article/view/52110