TY - JOUR
T1 - Enhanced Bald Eagle Search Optimizer with Transfer Learning-based Sign Language Recognition for Hearing-impaired Persons
AU - Asiri, Mashael M.
AU - Motwakel, Abdelwahed
AU - Drar, Suhanda
N1 - Publisher Copyright:
© 2023, King Salman Center for Disability Research. All Rights Reserved.
PY - 2023/9/15
Y1 - 2023/9/15
N2 - Sign language recognition and classification for hearing-impaired people is a vital application of computer vision (CV) and machine learning (ML) approaches. It contains developing structures that take sign language gestures carried out by individuals and transform them into textual or auditory output for transmission aspects. It is critical to realize that establishing a robust and correct sign language recognition and classification method is a difficult task because of several challenges like differences in signing styles, occlusions, lighting conditions, and individual variances in hand movements and shapes. Thus, it needs a group of CV approaches, ML systems, and a varied and representative database for training and testing. In this study, we propose an Enhanced Bald Eagle Search Optimizer with Transfer Learning Sign Language Recognition (EBESO-TLSLR) technique for hearing-impaired persons. The presented EBESO-TLSLR technique aims to offer effective communication among hearing-impaired persons and normal persons using deep learning models. In the EBESO-TLSLR technique, the SqueezeNet model is used for feature map generation.For recognition of sign language classes, the long short-term memory (LSTM) method can be used. Finally, the EBESO approach is exploited for the optimal hyperparameter election of the LSTM method. The simulation results of the EBESO-TLSLR method are validated on the sign language dataset. The simulation outcomes illustrate the superior results of the EBESO-TLSLR technique in terms of different measures.
AB - Sign language recognition and classification for hearing-impaired people is a vital application of computer vision (CV) and machine learning (ML) approaches. It contains developing structures that take sign language gestures carried out by individuals and transform them into textual or auditory output for transmission aspects. It is critical to realize that establishing a robust and correct sign language recognition and classification method is a difficult task because of several challenges like differences in signing styles, occlusions, lighting conditions, and individual variances in hand movements and shapes. Thus, it needs a group of CV approaches, ML systems, and a varied and representative database for training and testing. In this study, we propose an Enhanced Bald Eagle Search Optimizer with Transfer Learning Sign Language Recognition (EBESO-TLSLR) technique for hearing-impaired persons. The presented EBESO-TLSLR technique aims to offer effective communication among hearing-impaired persons and normal persons using deep learning models. In the EBESO-TLSLR technique, the SqueezeNet model is used for feature map generation.For recognition of sign language classes, the long short-term memory (LSTM) method can be used. Finally, the EBESO approach is exploited for the optimal hyperparameter election of the LSTM method. The simulation results of the EBESO-TLSLR method are validated on the sign language dataset. The simulation outcomes illustrate the superior results of the EBESO-TLSLR technique in terms of different measures.
KW - bald eagle search optimizer
KW - deep learning
KW - hearing-impaired people
KW - sign language recognition
KW - transfer learning
UR - http://www.scopus.com/inward/record.url?scp=105006623219&partnerID=8YFLogxK
U2 - 10.57197/JDR-2023-0039
DO - 10.57197/JDR-2023-0039
M3 - Article
AN - SCOPUS:105006623219
SN - 2676-2633
VL - 2
SP - 86
EP - 93
JO - Journal of Disability Research
JF - Journal of Disability Research
IS - 3
ER -