Utilizing Neutrosophic Logic in a Hybrid CNN-GRU Framework for Driver Drowsiness Level Detection with Dynamic Spatio-Temporal Analysis Based on Eye Aspect Ratio

  • Abdel Haleem Abdel-Aty
  • , Ahmed A.H. Abdellatif
  • , Kottakkaran Sooppy Nisar
  • , Shankar Rao Munjam
  • , Rasha M.Abd El-Aziz
  • , Ahmed I. Taloba

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Driver drowsiness has been identified as a major cause of roadway accidents globally. Efficiently determining the extent of drowsiness can greatly enhance preventive measures. This study proposes a novel approach, combining convolutional neural networks (CNN) and Gated Recurrent Units (GRU) to dynamically evaluate both the presence of drowsiness and its severity based on the Eye Aspect Ratio (EAR). By bridging spatial features extracted by CNNs with temporal sequences through GRU, our model offers a robust and real-time assessment of drowsiness levels, paving the way for enhanced safety measures in vehicular systems. Incorporating Neutrosophic Logic enables a more robust representation of uncertainty and ambiguity in the data and enhances the accuracy of driver drowsiness level detection within the Hybrid CNN-GRU framework. The model’s hybrid CNN-GRU structure combines CNN layers to extract spatial information from Human eye Images and GRU units to represent temporal correlations between frames. In-car cameras and sensors must be integrated to implement the suggested system in real-time and enable continuous driver behavior monitoring. The system alerts early warnings and takes action when drowsiness is detected, lowering the likelihood of accidents caused by weary drivers. The CNN-GRU hybrid architecture accurately detects fatigue during real-time driving. Performance metrics, including accuracy, recall, and F1-score, are provided for comparative research utilizing baseline models. Model behavior may be understood by visualizing tiredness detection and carefully examining false positives and negatives. The proposed CNN-GRU framework outperforms traditional methods such as SVM, KNN, and BPNN by achieving a significantly higher accuracy of 99.5%. It increases the recognition of driver tiredness by proposing a trustworthy and adaptable hybrid CNN-GRU deep learning system. This project is implemented in Python; it offers a practical and versatile solution for real-time driver drowsiness level detection. The proposed technology has the potential to dramatically increase traffic safety by sending out early warnings and taking steps to lessen the risks related to driver fatigue.

Original languageEnglish
Pages (from-to)144-161
Number of pages18
JournalInternational Journal of Neutrosophic Science
Volume22
Issue number2
DOIs
StatePublished - 2023

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 3 - Good Health and Well-being
    SDG 3 Good Health and Well-being
  2. SDG 11 - Sustainable Cities and Communities
    SDG 11 Sustainable Cities and Communities

Keywords

  • Driver drowsiness
  • Eye Aspect Ratio
  • Gated Recurrent Unit
  • Machine learning, Neural Networks
  • Neutrosophic Logic
  • Spatio-temporal analysis

Fingerprint

Dive into the research topics of 'Utilizing Neutrosophic Logic in a Hybrid CNN-GRU Framework for Driver Drowsiness Level Detection with Dynamic Spatio-Temporal Analysis Based on Eye Aspect Ratio'. Together they form a unique fingerprint.

Cite this