img
img
Real-Time Turkish Sign Language Recognition Using Cascade Voting Approach with Handcrafted Features    
Yazarlar (3)
Abdulkadir Karacı
Kastamonu Üniversitesi, Türkiye
Doç. Dr. Kemal AKYOL Doç. Dr. Kemal AKYOL
Kastamonu Üniversitesi, Türkiye
Mehmet Uğur Türüt
Devamını Göster
Özet
In this study, a machine learning-based system, which recognises the Turkish sign language person-independent in realtime, was developed. A leap motion sensor was used to obtain raw data from individuals. Then, handcraft features were extracted by using Euclidean distance on the raw data. Handcraft features include finger-to-finger, finger-to-palm, finger-to-wrist bone, palm-to-palm and wrist-to-wrist distances. LR, k-NN, RF, DNN, ANN single classifiers were trained using the handcraft features. Cascade voting approach was applied with two-step voting. The first voting was applied for each classifier’s final prediction. Then, the second voting, which voted the prediction of all classifiers at the final decision stage, was applied to improve the performance of the proposed system. The proposed system was tested in realtime by an individual whose hand data were not involved in the training dataset. According to the results, the proposed system presents 100% value of accuracy in the classification of one hand letters. Besides, the recognition accuracy ratio of the system is 100% on the two hands letters, except “J” and “H” letters. The recognition accuracy rates were 80% and 90%, respectively for “J” and “H” letters. Overall, the cascade voting approach presented a high average classification performance with 98.97% value of accuracy. The proposed system enables Turkish sign language recognition with high accuracy rates in real time.
Anahtar Kelimeler
Makale Türü Özgün Makale
Makale Alt Türü ESCI dergilerinde yayınlanan tam makale
Dergi Adı Applied Computer Systems
Dergi ISSN 2255-8691 Wos Dergi
Dergi Tarandığı Indeksler Web of Science - Emerging Sources Citation Index
Makale Dili İngilizce
Basım Tarihi 01-2021
Cilt No 26
Sayı 1
Sayfalar 12 / 21
Doi Numarası 10.2478/acss-2021-0002
Makale Linki 10.2478/acss-2021-0002