Handshape Classification in a Reverse Dictionary of Sign Languages for the Deaf

Alikhan Abutalipov, Aigerim Janaliyeva, Medet Mukushev, Antonio Cerone, Anara Sandygulova

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

This paper showcases the work that aims at building a user-friendly mobile application of a reverse dictionary to translate sign languages to spoken languages. The concept behind the reverse dictionary is the ability to perform a video-based search by demonstrating a handshape in front of a mobile phone’s camera. The user would be able to use this feature in two ways. Firstly, the user would be able to search for a word by showing a handshape for the application to provide a list of signs that contain that handshape. Secondly, the user could fingerspell the word letter by letter in front of the camera for the application to return the sign that corresponds to that word. The user can then look through the suggested videos and see their written translations. To offer other functionalities, the application also has Search by Category and Search by Word options. Currently, the reverse dictionary supports translations from Russian Sign Language (RSL) to Russian language.

Original languageEnglish
Title of host publicationFrom Data to Models and Back - 9th International Symposium, DataMod 2020, Revised Selected Papers
EditorsJuliana Bowles, Giovanna Broccia, Mirco Nanni
PublisherSpringer Science and Business Media Deutschland GmbH
Pages217-226
Number of pages10
ISBN (Print)9783030706494
DOIs
Publication statusPublished - 2021
Event9th International Symposium on From Data Models and Back, DataMod 2020 - Virtual, Online
Duration: Oct 20 2020Oct 20 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12611 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference9th International Symposium on From Data Models and Back, DataMod 2020
CityVirtual, Online
Period10/20/2010/20/20

Keywords

  • Fingerspelling recognition
  • Human-computer interaction
  • iOS application
  • Reverse dictionary
  • Russian Sign Language (RSL)
  • Sign language dictionary
  • Video-based search interface

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Handshape Classification in a Reverse Dictionary of Sign Languages for the Deaf'. Together they form a unique fingerprint.

Cite this