Ai Powered Accessibility For Enabling Effective Communication For Hearing And Speech Impaired In Virtual Platforms

Abstract

Sign Language Is A Visual Mode Of Communication That Uses Hand Gestures And Movements To Convey Meaning, Serving As An Essential Communication Tool For Individuals With Hearing Or Speech Impairments. Despite Its Importance, Many Virtual Platforms Lack The Ability To Recognize And Interpret Sign Language, Creating Significant Barriers To Inclusivity In Digital Communication. As Virtual Meetings Become More Integral To Professional And Personal Communication, The Need For Inclusivity In These Spaces Has Grown. Current Meeting Platforms Often Fail To Accommodate Users Who Rely On Sign Language, Limiting Their Ability To Engage Fully In Discussions. This Project Aims To Address This Gap By Integrating Real-time Sign Language Recognition Into Video Calling Platforms, Ensuring Accessibility For All Participants. The Proposed System Employs The Video Calling Vision Transformer (VCViT) To Accurately Recognize Word-level Hand Gestures. The System Captures Live Video Streams From Participants, Focusing On Hand Gestures, And Translates Them Into Text Or Speech In Real Time. By Utilizing Advanced Video Processing Techniques, Gesture Segmentation, And The VCViT's Ability To Model Spatial Relationships, The System Achieves High Recognition Accuracy, Adapting To Different Signing Styles And Environmental Conditions. This Project Strives To Create Inclusive Virtual Meeting Environments, Allowing Hearing-impaired Individuals To Actively Participate In Discussions. Through AI-driven Solutions, It Ensures Seamless Communication, Fosters Equity, And Enhances Digital Collaboration.

Keywords