AI-powered sign language app advances inclusion in the UAE
Abu Dhabi University has secured a patent for HearMe, an AI-driven multilingual platform enhancing communication, accessibility and opportunities for people with special educational needs
Sponsored by Abu Dhabi University
Sponsored by
Sponsored by
In a landmark achievement that underscores the UAE’s commitment to inclusive innovation, Abu Dhabi University (ADU) has secured a patent for an AI-powered multilingual sign language translation app called HearMe. Developed by Modafar Ati, associate professor in the College of Engineering at ADU, in collaboration with alumna Reem Al Bostami, the platform represents a meaningful step towards advancing accessibility and empowering people with special educational needs across the country.
The HearMe app aligns closely with the objectives of the UAE National Policy for Empowering People of Determination, which seeks to reduce inequality, enhance digital inclusion and create equitable opportunities in education and employment. By leveraging artificial intelligence, HearMe addresses one of the most persistent challenges faced by individuals with hearing impairments: effective, real-time communication across diverse linguistic and social contexts.
At its core, HearMe is designed to facilitate seamless interaction between individuals who use sign language and those who rely on spoken or written communication. The application enables real-time, bidirectional translation by converting sign language gestures into written text while also transforming typed input into animated sign language. This dual capability allows users to engage fluidly in conversations, whether in classrooms, professional training programmes or workplace environments.
What sets HearMe apart is its multilingual functionality. The platform supports multiple sign language systems, including American Sign Language and French Sign Language, enabling communication across cultural and linguistic boundaries. This feature is particularly significant in a globalised education and employment landscape, where individuals frequently interact across nationalities. By bridging both accessibility and language gaps, HearMe enhances inclusivity on an international scale.
Ati emphasises the importance of translating technological advancement into tangible societal impact. He notes that the development of HearMe was driven by the objective to create a scalable solution that directly addresses real-world challenges faced by individuals with hearing impairments. The patent reflects ADU’s broader commitment to applied research that not only advances academic knowledge but also aligns with national priorities in sustainability, innovation and social inclusion.
The implications of HearMe extend far beyond convenience. In educational settings, the application enables students with hearing impairments to participate more actively in lectures, discussions and collaborative learning activities. This fosters a more inclusive academic environment and opens pathways to higher education that may have previously been inaccessible. Similarly, in professional contexts, HearMe facilitates effective communication in meetings, training sessions and daily workplace interactions, thereby supporting career advancement and equal opportunity.
This innovation is part of ADU’s wider strategy to champion accessibility and inclusion. The university has consistently demonstrated leadership in this area through initiatives such as the Inclusion Advocates of Tomorrow programme, developed in collaboration with organisations including Ma’an, the Zayed Authority for People of Determination and Key2Enable. These efforts reflect ADU’s Vision 2027, which places strong emphasis on embedding inclusion, innovation and community impact within its academic and research ecosystem.
The patenting of HearMe marks a significant milestone for Abu Dhabi University and the UAE’s broader vision of a more inclusive society. By harnessing the power of artificial intelligence to break down communication barriers, the initiative exemplifies how technology can be leveraged to empower individuals and create meaningful social change. As the UAE continues to prioritise accessibility and digital transformation, innovations like HearMe will play a critical role in ensuring that no one is left behind.