The GenAI-powered Global Sign Language Translator leverages Gemini 2.0 Flash AI to convert multilingual text and speech into American Sign Language videos, fostering inclusivity and breaking communication barriers.
The system, built on Google Cloud Platform, features AI translation, video generation, and performance optimization through caching, providing ASL videos in real-time.
Utilizing modern web application technology, the solution supports multilingual input, adjustable playback speeds, and loop functionality for an enhanced user experience.
The architecture includes ASL dataset generation, a responsive frontend, Firebase authentication, Chrome + WebAI interface, and ASL translation workflows.
AI models like Gemini 2.0 Flash aid in natural language understanding, sign language generation, and quality refinement for accurate ASL gloss notation conversion.
The system flow involves cache checks, language detection, gloss conversion, video URL mappings, and storage in Firestore for efficient translation processing and retrieval.
The technical implementation incorporates Cloud Platform, AI models, storage solutions, and processing tools for seamless sign language translation and user-friendly interaction.
Through innovative technologies and thoughtful design, the Global Sign Language Translator aims to bridge communication gaps and promote understanding and inclusion of the deaf community.
Creators of the project are final-year students from Hong Kong Institute of Information Technology, showcasing the project for the GDG Solution Challenge 2025.
The project exemplifies the impactful use of technology for social good, emphasizing the importance of leveraging AI and cloud architecture to create a more connected and inclusive world.