TY - GEN
T1 - Handshape Classification in a Reverse Dictionary of Sign Languages for the Deaf
AU - Abutalipov, Alikhan
AU - Janaliyeva, Aigerim
AU - Mukushev, Medet
AU - Cerone, Antonio
AU - Sandygulova, Anara
N1 - Funding Information:
Acknowledgment. This work was supported by the Nazarbayev University Faculty Development Competitive Research Grant Program 2019–2021 “Kazakh Sign Language Automatic Recognition System (K-SLARS)”. Award number is 110119FD4545.
Publisher Copyright:
© 2021, The Author(s).
PY - 2021
Y1 - 2021
N2 - This paper showcases the work that aims at building a user-friendly mobile application of a reverse dictionary to translate sign languages to spoken languages. The concept behind the reverse dictionary is the ability to perform a video-based search by demonstrating a handshape in front of a mobile phone’s camera. The user would be able to use this feature in two ways. Firstly, the user would be able to search for a word by showing a handshape for the application to provide a list of signs that contain that handshape. Secondly, the user could fingerspell the word letter by letter in front of the camera for the application to return the sign that corresponds to that word. The user can then look through the suggested videos and see their written translations. To offer other functionalities, the application also has Search by Category and Search by Word options. Currently, the reverse dictionary supports translations from Russian Sign Language (RSL) to Russian language.
AB - This paper showcases the work that aims at building a user-friendly mobile application of a reverse dictionary to translate sign languages to spoken languages. The concept behind the reverse dictionary is the ability to perform a video-based search by demonstrating a handshape in front of a mobile phone’s camera. The user would be able to use this feature in two ways. Firstly, the user would be able to search for a word by showing a handshape for the application to provide a list of signs that contain that handshape. Secondly, the user could fingerspell the word letter by letter in front of the camera for the application to return the sign that corresponds to that word. The user can then look through the suggested videos and see their written translations. To offer other functionalities, the application also has Search by Category and Search by Word options. Currently, the reverse dictionary supports translations from Russian Sign Language (RSL) to Russian language.
KW - Fingerspelling recognition
KW - Human-computer interaction
KW - iOS application
KW - Reverse dictionary
KW - Russian Sign Language (RSL)
KW - Sign language dictionary
KW - Video-based search interface
UR - https://www.scopus.com/pages/publications/85103590191
UR - https://www.scopus.com/pages/publications/85103590191#tab=citedBy
U2 - 10.1007/978-3-030-70650-0_14
DO - 10.1007/978-3-030-70650-0_14
M3 - Conference contribution
AN - SCOPUS:85103590191
SN - 9783030706494
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 217
EP - 226
BT - From Data to Models and Back - 9th International Symposium, DataMod 2020, Revised Selected Papers
A2 - Bowles, Juliana
A2 - Broccia, Giovanna
A2 - Nanni, Mirco
PB - Springer Science and Business Media Deutschland GmbH
T2 - 9th International Symposium on From Data Models and Back, DataMod 2020
Y2 - 20 October 2020 through 20 October 2020
ER -