AKOUO ("to hear") aims to enhance communication between the deaf community and hearing individuals by translating spoken English to sign language in real time with the use of animated avatars. This innovative solution seeks to improve inclusivity and streamline communication with the use of sophisticated speech recognition, natural language processing (NLP) and animation technologies.
Objectives:
1.Accurate Speech Recognition: Create a speech recognition system that can accurately translate spoken words into text using advanced Natural Language Processing techniques.
2.Comprehensive Sign Language Translation: Develop a comprehensive database with sign language motions that match known words and phrases and implementing a translation engine that converts transcribed text into precise sign language instructions.
3.Expressive Avatar Animation: Create and animate 3D avatars that can accurately and expressively carry out sign language movements, ensuring that the avatars are both aesthetically pleasing and easy to use.
4.User-Friendly Interface: Provide an easily navigable and intuitive user interface so that people can quickly engage with the system. Give users the ability to customize the appearance and settings of their avatar.