Driver Alertness Monitoring

Using Fusion of Facial

Features and Bio-Signals

1
 Introduction
o Drivers reduced vigilance level- increases accidents
o Previous researches – using sensors to detect fatigue levels
are not driver adaptable

o New system analyze information related to fatigue through

two methods : eye movement monitoring and bio signal
processing

2
 System Overview
o Monitoring system – Android Smart Phones and different
sensors

o Webcam captures drivers image

o Biomedical sensor captures drivers PPG signals

o PPG(Photoplethysmogram) – Heart rate variability can

be calculated to detect drowsiness level

o Smartphone received signals via wireless sensors

3
System Flow chart

4
 System Architecture
 Contain mainly 4 modules

o Bio medical sensor

o Video sensor

o Smart phone programming in Android Platform

o Information Fusion

5
 Biomedical sensor module
o The driver PPG signal is obtained using a pulse oximeter

o PPG sensor contain LED and PIN photodiode

6
 Video sensor module
o Video Sensor Module – Contains a web cam to capture
driver images

o Infrared method LED’s on the left and right near to

camera helps to capture clear images at night
o The webcam resolution is set to 320 × 240

7
Video and Biomedical
Sensor Installment

8
 Smartphone programming
module
o The whole system programmed in Android Smartphone

o Face features detection approach carried out by Active

shape model

o Parameters updated using procrustes algorithm

o 100 bytes buffer is used to store incoming PPG signals

9
Formulas used :

10
o Another method in analyzing biomedical signals is to
calculate power spectral density (PSD)
Using Welch method

11
Information Fusion Module
o Information Fusion Module – Parameters that reflect
characteristics of driver alertness levels are image and bio
signals
o Dynamic Bayesian networks are applied for fatigue
analysis
o Parameters for fatigue Analysis

Image Bio signal

BF HV
BR RM
PC FD
AC PD

12
Bayesian network

is the child node

13
 Experiments and test
discussions
o Experiments are carried out by 10 volunteers
(male/female)
o Aged between 24 to 40
o Volunteers filled survey form before experiments
o Conduct experiments in 3 different times
o Test lasted for 40 to 50 minutes
o Probabilities estimated on fusion of parameters

14
o The fusion of all four parameters,
95% true detection rate , 10% false detection rate
15
 Conclusion

o A fatigue monitoring system based on information

fusion is designed and implemented in Android Smart
phone
o It detects the driver fatigue immediately and alert the
driver at the right time
o Bayesian Network provides an effective way to deal
with uncertainty and complexity
o Altogether the system helps to increase the vigilance of
drivers and there by ensure the traffic safety and
security

16
 Reference
o Boon-Giin Lee and Wan – Young Chung “Driver
Alertness Monitoring Using Fusion Of Facial Features
and Bio – Signals”,IEEE Sensors July 2012
o “Driver Fatigue Detection Using Sensor Network”
www.ijest.info/IJEST-NCICT-020-190.pdf
o “Real time Drowsiness Detection for an Intelligent
Vehicle” Marco Javier Flores, José María Armingol and
Arturo de la Escalera, Member, IEEE
o “Monitoring Head/Eye Motion for Driver Alertness
with One Camera”
www.cs.ucf.edu/~vision/projects/DriverAlertness/1315_s
mith.pdf
17