In a significant step towards inclusivity in healthcare, researchers from South Korea's Electronics and Telecommunications Research Institute (ETRI) have developed a groundbreaking two-way medical sign language translation kiosk. This technology, created in collaboration with Chungnam National University Hospital, the Korea Association of the Deaf, and EQ4ALL Co., Ltd., aims to diminish the barriers faced by people with hearing impairments during health checkups.
The kiosk, designed specifically for individuals who are hard of hearing, features an interactive avatar that communicates in sign language, enabling users to comprehend and respond to health checkup questionnaires displayed on the screen. This innovative solution is set to transform the healthcare experience for many, ensuring that essential medical services are more accessible and user-friendly.
The need for such technology has become particularly evident in the aftermath of the COVID-19 pandemic. For individuals with hearing impairments, accessing critical medical information — especially regarding vaccination and infectious diseases — has become increasingly difficult. Many healthcare institutions lack the resources to provide sign language interpreters, and barriers have intensified due to the use of masks, which obstruct lip-reading and facial expressions crucial for effective communication.
ETRI's kiosk addresses these challenges by translating health checkup questionnaires into sign language, allowing users to easily understand medical queries. The interactive component of the kiosk translates the user’s sign language responses into Korean text, directly entering them into the questionnaire. This functionality significantly enhances communication between patients and healthcare providers, allowing for more accurate and detailed health disclosures.
On November 4, researchers conducted a satisfaction survey at Yeouido's Eroom Center, gathering feedback from hearing-impaired participants to refine the kiosk service further. The insights garnered from this survey are poised to lead to improved interactive translation capabilities, ultimately fostering better communication within healthcare settings.
Equipped with advanced technologies such as image recognition, human joint signal analysis, and bidirectional conversion between sign language and Korean, the kiosk can recognize and interpret sign language gestures in real-time. This state-of-the-art device represents a commitment by researchers to improve the lives of individuals with disabilities, equipping them with the tools necessary for self-advocacy within the healthcare system.
The development of this technology is not a first for ETRI, which has previously contributed to healthcare accessibility through various sign language initiatives, including guidelines for COVID-19. As the need for effective communication in healthcare becomes more pressing, research is ongoing to enhance the kiosk's capabilities, ensuring that the technology meets the needs of users in a natural and straightforward manner.
ETRI's assistant vice president, Tae Jin Lee, emphasized the importance of equitable access to vital social information for all, particularly for vulnerable populations. Lee voiced hopes for continuous efforts and interest in compassionate technology development that addresses the unique challenges faced by the hearing impaired.
The project, titled “Two-Way Medical Sign Language Translation Service Technology Development for the Hearing Impaired,” has received support from the Ministry of Science and ICT and various research institutions, including the Korea Electronics Technology Institute and the Korea Advanced Institute of Science & Technology. As the kiosk undergoes further development and validation in clinical settings, plans are in place to transfer this innovative technology to service providers, ultimately broadening its impact across healthcare facilities nationwide.
