NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1433151
Record Type: Journal
Publication Date: 2024
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-2336-2375
EISSN: EISSN-1803-1617
Bidirectional Braille-Speech Communication System for Deafblind Students
Ana Paula Pérez-Aguirre; Iván Arturo Morales-Pérez; Jorge Allan Gómez-Mercado; Rodrigo Alberto Gutiérrez-Martínez; Iván Matehuala-Moran; Rubén Fuentes-Alvarez
Journal on Efficiency and Responsibility in Education and Science, v17 n2 p164-177 2024
Deaf-blindness is a type of dual disability wherein visual and auditory capabilities are significantly impaired. Special communication methods have been developed for the deaf-blind community. Yet, these methods require that both people involved have prior knowledge and training to successfully communicate, limiting deaf-blind people's social interactions, particularly in academic settings. This paper describes the development of a device that enables two-way communication between a severely deaf-blind user and a hearing person with no prior knowledge of Braille and no additional intermediaries. A Convolutional Neural Network (CNN) scheme for speech recognition was designed and implemented along with the development of an algorithm capable of developing both text-to-speech and Finger-Braille-to-text conversion. Lastly, a system integration via 3D modeling and additive manufacturing was carried out to deliver a functional prototype. The resulting device aims to allow deaf-blind students to send and receive information entirely in finger Braille, using buttons and vibrotactile feedback. In contrast, the hearing tutor receives auditory messages and speaks to reply, making the educational experience as familiar as possible for both parties. Users testing the device achieved an average typing accuracy of over 95% and demonstrated an understanding of commands transmitted through the device's components.
Czech University of Life Sciences Prague. Czech University of Life Sciences Prague, Kamýcká 129, Prague 6 - Suchdol 165 00, Czech Republic. e-mail: editor@eriesjournal.com; Web site: https://www.eriesjournal.com/index.php/eries
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Mexico
Grant or Contract Numbers: N/A