Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Apr 2:36:107021.
doi: 10.1016/j.dib.2021.107021. eCollection 2021 Jun.

Dataset of Pakistan Sign Language and Automatic Recognition of Hand Configuration of Urdu Alphabet through Machine Learning

Ali Imran  1 , Abdul Razzaq  1 , Irfan Ahmad Baig  2 , Aamir Hussain  1 , Sharaiz Shahid  1 , Tausif-Ur Rehman  1
Affiliations

Dataset of Pakistan Sign Language and Automatic Recognition of Hand Configuration of Urdu Alphabet through Machine Learning

Ali Imran et al. Data Brief. .

Abstract

Social correspondence is one of the most significant columns that the public dependent on. Notably, language is the best way to communicate and associate with one another both verbally and nonverbally. There is a persistent communication gap among deaf and non-deaf communities because non-deaf people have less understanding of sign languages. Every region/country has its sign language. In Pakistan, the sign language of Urdu is a visual gesture language that is being used for communication among deaf peoples. However, the dataset of Pakistan Sign Language (PSL) is not available publicly. The dataset of PSL has been generated by acquiring images of different hand configurations through a webcam. In this work, 40 images of each hand configuration with multiple orientations have been captured. In addition, we developed, an interactive android mobile application based on machine learning that minimized the communication barrier between the deaf and non-deaf communities by using the PSL dataset. The android application recognizes the Urdu alphabet from input hand configuration.

Keywords: Deaf people communication; Hand configuration; Machine learning; Mobile app; Pakistan sign language.

PubMed Disclaimer

Conflict of interest statement

The authors have no conflicts of interest to declare

Figures

Fig. 1
Fig. 1
System phases.
Fig. 2
Fig. 2
PSL data generation.
Fig. 3
Fig. 3
An example of segmentation the original and segmented image respectively.
Fig. 4
Fig. 4
Positive support vectors for ‘ل’ alphabet.
Fig. 5
Fig. 5
Results of a sign recognition output.
Fig. 6
Fig. 6
Workflow of android application.
Fig. 7
Fig. 7
Android application GUI with output.
See this image and copyright information in PMC

References

    1. Abdo M., Hamdy A., Salem S., Saad E.M. Arabic alphabet and numbers sign language recognition. Int. J. Adv. Comput. Sci. Appl. 2015;6:209–214.
    1. Khan R.Z., Ibraheem N.A. Hand gesture recognition: a literature review. Int. J. Artif. Intell. Appl. 2012;3:161.
    1. Saqib S., Kazmi S.A.R. Repository of static and dynamic signs. Int. J. Adv. Comput. Sci. Appl. 2017;8:101–105.
    1. Burges C.J. A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Discov. 1998;2(2):121–167.
    1. Jiménez P.G., Bascón S.M., Moreno H.G., Arroyo S.L., Ferreras F.L. Traffic sign shape classification and localization based on the normalized FFT of the signature of blobs and 2D homographies. Signal Process. 2008;88(12):2943–2955.

LinkOut - more resources