Virtual Reality and Augmented Reality in Sign Language Recognition: A Review of Current Approaches

Virtual Reality and Augmented Reality in Sign Language Recognition: A Review of Current Approaches

Virtual Reality, Augmented Reality,Sign Language Recognition, Gesture Recognition, Accessibility

This paper delivers a critical and comprehensive review of the current approaches to Sign Language Recognition (SLR) using Virtual Reality (VR) and Augmented Reality (AR) technologies. The problem lies in traditional SLR methods, which often face limitations such as poor gesture recognition accuracy, lack of contextual understanding, and challenges in scalability. Recent advances in VR and AR technologies, characterized by their immersive and interactive environments, have shown promising potential to address these limitations, offering solutions that leverage state-of-the-art machine learning and computer vision techniques to enhance gesture recognition and contextual comprehension. These issues hinder effective communication and inclusivity for the deaf and hard-of-hearing community. This review critically examines how VR and AR, with their immersive and interactive environments, offer innovative solutions by enabling real-time feedback, dynamic learning experiences, and enhanced gesture recognition systems. Furthermore, the paper evaluates the integration of VR and AR with advanced technologies like machine learning and computer vision, which significantly improve the accuracy and efficiency of SLR. Despite notable progress, challenges such as hardware limitations, cultural diversity, and high costs remain. This study concludes with future directions for developing inclusive, scalable, and culturally sensitive SLR systems through advancements in AI, increased affordability, and interdisciplinary collaboration. The findings emphasize the transformative potential of VR and AR in creating accessible communication tools for lots worldwide

Aris Rakhmadi1, Anton Yudhana2, Sunardi3

https://ijicom.respati.ac.id/index.php/ijicom/article/view/94/60

December 2024

Fajar bagus W

PDF

English

Text