Real-Time Turkish Sign Language Recognition Using Cascade Voting Approach with Handcrafted Features
Yazarlar (3)
Doç. Dr. Abdulkadir Karacı Kastamonu Üniversitesi, Türkiye
Prof. Dr. Kemal AKYOL Kastamonu Üniversitesi, Türkiye
Mehmet Uğur Türüt
| Makale Türü |
Özgün Makale
(ESCI dergilerinde yayınlanan tam makale)
|
||
| Dergi Adı | Applied Computer Systems | ||
| Dergi ISSN | 2255-8691 Wos Dergi | ||
| Dergi Tarandığı Indeksler | ESCI | ||
| Makale Dili | İngilizce | Basım Tarihi | 01-2021 |
| Kabul Tarihi | – | Yayınlanma Tarihi | 01-05-2021 |
| Cilt / Sayı / Sayfa | 26 / 1 / 12–21 | DOI | 10.2478/acss-2021-0002 |
| Makale Linki | 10.2478/acss-2021-0002 | ||
| UAK Araştırma Alanları |
Görüntü İşleme
|
||
| Özet |
| In this study, a machine learning-based system, which recognises the Turkish sign language person-independent in realtime, was developed. A leap motion sensor was used to obtain raw data from individuals. Then, handcraft features were extracted by using Euclidean distance on the raw data. Handcraft features include finger-to-finger, finger-to-palm, finger-to-wrist bone, palm-to-palm and wrist-to-wrist distances. LR, k-NN, RF, DNN, ANN single classifiers were trained using the handcraft features. Cascade voting approach was applied with two-step voting. The first voting was applied for each classifier’s final prediction. Then, the second voting, which voted the prediction of all classifiers at the final decision stage, was applied to improve the performance of the proposed system. The proposed system was tested in realtime by an individual whose hand data were not involved in the training dataset. According to the results, the proposed system presents 100% value of accuracy in the classification of one hand letters. Besides, the recognition accuracy ratio of the system is 100% on the two hands letters, except “J” and “H” letters. The recognition accuracy rates were 80% and 90%, respectively for “J” and “H” letters. Overall, the cascade voting approach presented a high average classification performance with 98.97% value of accuracy. The proposed system enables Turkish sign language recognition with high accuracy rates in real time. |
| Anahtar Kelimeler |
BM Sürdürülebilir Kalkınma Amaçları
| Atıf Sayıları | |
| Google Scholar | 9 |