Implementation of Immersive Virtual Hands using Virtual Reality System Controllers

Implementation of Immersive Virtual Hands using Virtual Reality System Controllers
  IJETT-book-cover           
  
© 2023 by IJETT Journal
Volume-71 Issue-6
Year of Publication : 2023
Author : Arman A. Hovhannisyan
DOI : 10.14445/22315381/IJETT-V71I6P236

How to Cite?

Arman A. Hovhannisyan, "Implementation of Immersive Virtual Hands using Virtual Reality System Controllers," International Journal of Engineering Trends and Technology, vol. 71, no. 6, pp. 369-374, 2023. Crossref, https://doi.org/10.14445/22315381/IJETT-V71I6P236

Abstract
Virtual reality is a technology that makes computer-generated objects and environments appear natural. Immersive virtual reality aims to involve the user in the virtual environment at the most, giving the user the feeling that they are actually inside the virtual world. Immersion is the user’s engagement with a virtual reality system that results in being in a flow state. Presence within the context of virtual reality is a phenomenon that allows users to interact naturally with a virtual world through technology. For a virtual environment to be realistic, it must provide a high level of immersion and presence. One way to achieve this is by rendering the user's body in the virtual environment. Particularly, rendering the user's hands makes it possible to simulate user-object interactions naturally as they appear in real life. Despite the high volume of research efforts made towards increasing the feeling of immersion and presence in virtual worlds, the task of providing users with more realism is still actual. This paper proposes a method for simulating hand gestures as they appear in real life, using virtual reality system controllers. As a result, it gives users the feeling of natural movements and actions within the virtual environment. The proposed method commits to increasing immersion and presence in virtual reality environments.

Keywords
Hand gesture, Human-computer interaction, Immersion, Presence, Virtual reality.

References
[1] Wikipedia, Virtual Reality. [Online]. Available: https://en.wikipedia.org/wiki/Virtual_reality
[2] G. Yue, “3D User Interface in Virtual Reality,” in HCII 2021, vol. 1498, pp. 418-423, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[3] M. Slater, and A. Steed, “A Virtual Presence Counter,” IEEE Presence, vol. 9, no. 5, pp. 413-434, 2000.
[CrossRef] [Google Scholar] [Publisher Link]
[4] M.K.D. Coomans, and H.J.P. Timmermans, “Towards a Taxonomy of Virtual Reality user Interfaces,” Proceedings 1997 IEEE Conference on Information Visualization, 1997.
[CrossRef] [Google Scholar] [Publisher Link]
[5] B. Witmer, and M. Singer, “Measuring Presence in Virtual Environments: A Presence Questionnaire,” MIT Presence: Teleoperators and Virtual Environments, vol. 7, no. 3, pp. 225-240, 1998.
[CrossRef] [Google Scholar] [Publisher Link]
[6] V. Schwind et al., “These are not My Hands!”: Effect of Gender on the Perception of Avatar Hands in Virtual Reality,” Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 1577-1582, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[7] L. Lin, and S. Jörg, “Need a Hand?: How Appearance Affects the Virtual Hand Illusion,” Proceedings of the ACM Symposium on Applied Perception, pp. 69-76, 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[8] F. Argelaguet et al., “The Role of Interaction in Virtual Embodiment: Effects of the Virtual haNd Representation,” 2016 IEEE Virtual Reality (VR), 2016.
[CrossRef] [Google Scholar] [Publisher Link]
[9] E. Peña-Pitarch, N.T. Falguera, and J. Yang, “Virtual Human Hand: Model and Kinematics,” Computer Methods in Biomechanics and Biomedical Engineering, vol. 17, no. 5, pp. 568-579, 2014.
[CrossRef] [Google Scholar] [Publisher Link]
[10] H. Wan et al., “Realistic Virtual Hand Modeling with Applications for Virtual Grasping,” VRCAI '04, pp. 81–87, 2004.
[CrossRef] [Google Scholar] [Publisher Link]
[11] E. Sudhakaran Rao, “Automatic Control of Wheel Chair using Hand Gestures in Signal Processing,” SSRG International Journal of VLSI & Signal Processing, vol. 1, no. 1, pp. 13-15, 2014.
[CrossRef] [Publisher Link]
[12] Mingyu Kim et al., “Grasping VR: Presence of Pseudo-Haptic Interface Based Portable Hand Grip System in Immersive Virtual Reality,” International Journal of Human–Computer Interaction, vol. 36, no. 7, pp. 685-698, 2020.
[CrossRef] [Google Scholar] [Publisher Link]
[13] J. Hwang, J. Jung, and G. Kim, “Hand-held Virtual Reality: A Feasibility Study,” VRST '06: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pp. 356-363, 2006.
[CrossRef] [Google Scholar] [Publisher Link]
[14] J. Perret, and E.V. Poorten, “Touching Virtual Reality: A Review of Haptic Gloves,” ACTUATOR 2018: 16th International Conference on New Actuators, 2018.
[Publisher Link]
[15] Jonathan Blake, and Hakan B. Gurocak, “Haptic Glove with MR Brakes for Virtual Reality,” IEEE/ASME Transactions on Mechatronics, vol. 14, no. 5, pp. 606-615, 2009.
[CrossRef] [Google Scholar] [Publisher Link]
[16] V. Popescu, G. Burdea, and M. Bouzit, “Virtual Reality Simulation Modeling for a Haptic Glove,” Proceedings Computer Animation 1999, 1999.
[CrossRef] [Google Scholar] [Publisher Link]
[17] Vu Trieu Minh, Nikita Katushin, and John Pumwa, “Motion Tracking Glove for Augmented Reality and Virtual Reality,” Journal of Behavioral Robotics, vol. 10, no. 1, pp.160-166, 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[18] C. Våpenstad et al., “Perceiving Haptic Feedback in Virtual Reality Simulators,” Surgical Endoscopy, vol. 27, pp. 2391-2397, 2013.
[CrossRef] [Google Scholar] [Publisher Link]
[19] P. Dhivya Bharathy et al., “Hand Gesture Recognition for Physical Impairment Peoples,” SSRG International Journal of Computer Science and Engineering, vol. 4, no. 10, pp. 6-10, 2017.
[CrossRef] [Publisher Link]
[20] UltraLeap, Leap Motion Controller Data Sheet. [Online]. Available: https://www.ultraleap.com/datasheets/Leap_Motion_Controller_Datasheet.pdf
[21] Otso Pietikäinen et al., “VRChem: A Virtual Reality Molecular Builder,” MDPI Applied Sciences, vol. 11, no. 22, 2021.
[CrossRef] [Google Scholar] [Publisher Link]
[22] Mingyu Kim, Changyu Jeon, and Jinmo Kim, “A Study on Immersion and Presence of a Portable Hand Haptic System for Immersive Virtual Reality,” MDPI Sensors, vol. 17, no. 5, p. 1141, 2017.
[CrossRef] [Google Scholar] [Publisher Link]
[23] Ramya Ravibarathi, and Tamilarasu Viswanathan, “Assimilation of Gesture using 9 Axis Acclerometer Sensor,” SSRG International Journal of Electrical and Electronics Engineering, vol. 5, no. 2, pp. 1-4, 2018.
[CrossRef] [Publisher Link]
[24] George ElKoura, and Karan Singh, “Handrix: Animating the Human Hand,” SCA '03, pp. 110-119, 2003.
[Google Scholar] [Publisher Link]
[25] Unity Asset Store Website, VR Hands and FP Arms Pack. [Online]. Available: https://assetstore.unity.com/packages/3d/characters/humanoids/vr-hands-and-fp-arms-pack-77815
[26] Unity Documentation website. [Online]. Available: https://docs.unity3d.com/Manual/shader-introduction.html
[27] R. Jayasree et al., “Gesture Based Assistance System for Aphasia Patient,” SSRG International Journal of Electronics and Communication Engineering, vol. 5, no. 7, pp. 28-33, 2018.
[CrossRef] [Publisher Link]
[28] Wikipedia, Unity (Game Engine). [Online]. Available: https://en.wikipedia.org/wiki/Unity_(game_engine)
[29] Vive website, About the VIVE Controllers. [Online]. Available: https://www.vive.com/us/support/vive/category_howto/about-the-controllers.html
[30] Dhaval Waghulde et al., “Wireless Cursor Control by Gesture Recognition,” SSRG International Journal of Electronics and Communication Engineering, vol. 2, no. 11, pp. 37-41, 2015.
[CrossRef] [Publisher Link]
[31] Hoang Thi Phuong, “Researching Robot Arm Control System Based On Computer Vision Application And Artificial Intelligence Technology,” SSRG International Journal of Computer Science and Engineering, vol. 8, no. 1, pp. 24-29, 2021.
[CrossRef] [Publisher Link]
[32] Lorraine Lin et al., “The Effect of Hand Size and Interaction Modality on the Virtual Hand Illusion,” 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019.
[CrossRef] [Google Scholar] [Publisher Link]
[33] Mandayam A. Srinivasan, and Cagatay Basdogan, “Haptics in Virtual Environments: Taxonomy, Research Status, and Challenges,” Elsevier Computers & Graphics, vol. 21, no. 4, pp. 393-404, 1997.
[CrossRef] [Google Scholar] [Publisher Link]
[34] M. Pouliquen et al., “Virtual Hands and Virtual Reality Multimodal Platform to Design Safer Industrial Systems,” Elsevier Computers in Industry, vol. 58, no. 1, pp. 46–56, 2007.
[CrossRef] [Google Scholar] [Publisher Link]
[35] Wikipedia, HTC Vive. [Online]. Available: https://en.wikipedia.org/wiki/HTC_Vive
[36] Bodleian Libraries, Virtual Reality: How to use VR Headsets. [Online]. Available: https://libguides.bodleian.ox.ac.uk/vr/headsetsvr