Driving Fatigue Prediction with Pre-Event

Electroencephalography (EEG) via a Recurrent Fuzzy

Neural Network

Yu-Ting Liu1,2, Shang-Lin Wu1,2, Kuang-Pen Chou3, Yang-Yin Jie Lu6, Guangquan Zhang6,
Member, IEEE Lin2,5, Member, IEEE Wen-Chieh Lin4, Chin-Teng
1
Institute of Electrical Control 5
Electronic Systems Research Lin1,2,6*, Fellow, IEEE
6
Engineering Division Faculty of Engineering and
2 Information Technology
Brain Research Center National Chung-Shan Institute of
3 University of Technology Sydney
Institute of Computer Science and Science and Technology (NCSIST)
Engineering Taoyuan, Taiwan Sydney, Australia
4 *Email: ctlin@mail.nctu.edu.tw
Department of Computer Science
National Chiao-Tung University
Hsinchu, Taiwan

Abstract—We propose an electroencephalography (EEG)
prediction system based on a recurrent fuzzy neural network
(RFNN) architecture to assess drivers’ fatigue degrees during a
virtual-reality (VR) dynamic driving environment. Prediction of
fatigue degrees is a crucial and arduous biomedical issue for
driving safety, which has attracted growing attention of the
research community in the recent past. Meanwhile, combined
with the benefits of measuring EEG signals facilitates, many
EEG-based brain-computer interfaces (BCIs) have been
developed for use in real-time mental assessment. In the
literature, EEG signals are severely blended with stochastic
noise; therefore, the performance of BCIs is constrained by low
resolution in recognition tasks. For this rationale, independent
component analysis (ICA) is usually used to find a source
mapping from original data that has been blended with unrelated
artificial noise. However, the mechanism of ICA cannot be used
in real-time BCI design. To overcome this bottleneck, the
proposed system in this paper utilizes a recurrent self-evolving
fuzzy neural work (RSEFNN) to increase memory capability for
adaptive noise cancellation when assessing drivers’ mental states
during a car driving task. The experimental results without the
use of ICA procedure indicate that the proposed RSEFNN model
remains superior performance compared with the state-of-the-
arts models.
Keywords—Electroencephalography (EEG), recurrent fuzzy
neural network (RFNN), brain-computer interface (BCI), driving
safety, fatigue prediction
I. INTRODUCTION
In parallel with the development of related industrial
techniques, many assistive devices and artificial auxiliary
systems for use under various circumstances have been
designed to improve human life. In contrast to various other
types of systems [1], brain-computer interface (BCI) systems
are effective because they can assess cognitive states of human
beings [1], [2] in time. Such a monitoring system usually
requires a comprehensive procedure with three main phases: 1)
continuously recording driver consciousness, 2) using a highly
accurate algorithm for predicting potential impacts on driving
performance, and 3) delivering timely bio-feedback to assess
driving safety. An effective monitoring system should include
these steps/functions within its architecture. As one of the most
important measurement technologies for brain dynamics,
electroencephalography (EEG) has gradually attracted
substantial amounts of attention. A significant advantage of
EEG over other extraction methodologies is that it provides
convenient real-time measurements. Therefore, EEG-based
BCIs are commonly used in real-world applications [1].
However, there are still arduous challenges to effectively
using EEG-based BCIs in real applications, which comes from
the fact that the EEG signals are non-stationary in nature [1],
[3]–[5]. Because brain activities are a dynamic and complex
procedure, EEG processing has proven to be quite complicated.
Many authors have addressed this problem using different
approaches [6], [7], and the independent component analysis
(ICA) has been considered to be an effective EEG signal
processing technique. This analysis can generate a source
mapping matrix using original data that were blended with
unrelated artificial noise. However, the mechanism of ICA
cannot be used in real-time BCI design. This drawback greatly
degrades the utility of BCIs for real-world applications.
This study aims to develop a EEG prediction system to
assess drivers’ fatigue degrees during a virtual-reality (VR)
based driving task. In the literature related to driving tasks [8],
EEG spectra have been widely exploited and are commonly
used to identify different cognitive states. The magnitude of the
alpha band of the EEG power in the occipital cortex was found
to be one of the significant features accompanying the onset of
drowsiness. Based on these fundamental findings in cognitive
neuroscience, we decided to further explore and analyze the
occipital region in this study.

978-1-5090-0626-7/16/$31.00 2016
c IEEE 2488

Fig. 1. Virtual-reality-based highway lane-departure
ˤ
environment. (a) Schematic diagram of a 360 VR scene prjected by six
projectors. (b) A participant during the lane-departure task. (c) Side view of
the driver in a VR scene.
In our previous studyġ [7], we utilized a VR-based scenario
to simulate different driving environments for participants and
to predict the levels of fatigue driving via a fuzzy neural
network with pre-event EEG signals. However, the authors
ignored the correlation and continuity of cognitive states in
driving tasks. Specifically, the levels of fatigue should be a
continuous sequence in the temporal domain, and researchers
should simultaneously integrate long-term information when
developing a real-time BCI system. The BCI system proposed
in this paper employs a recurrent self-evolving fuzzy neural
network (RSEFNN) with local feedback [9] to evaluate
cognitive states. The recurrent structure used in the RSEFNN is
simpler than other existing RFNNs [9], [10], and this simple
structure makes the RSEFNN better suited for use in real-time
BCI applications.
In this study, we developed a real-time system for fatigue
prediction using an on-line learning algorithm with a pre-event
single trial for assessing driver’s mental states during a car
driving task. To solve the real-time issue existing in the ICA
algorithm, the proposed system utilized the RSEFNN to
increase memory capability for adaptive noise cancellation
when assessing drivers’ mental states during a car driving task.
Finally, the experimental results indicated that the proposed
RSEFNN model outperforms other systems in terms of
prediction error.
Fig. 2. VR simulation driving scenario: (a) a schematic diagram of a 360° VR scene projected by six projectors, (b) a projector platform, (c) the side view of the
driver in a VR scene.
2016 IEEE International Conference on Fuzzy Systems (FUZZ)
II. EXPERIMENTAL DESIGN
A. Highway Driving Paradigm
The experimental environment in this study was
constructed through a VR scenario, which is shown in Fig. 1.
All scenes in this study simulate participants driving on a four-
lane divided highway at a constant speed of 100 km/hr at night.
The experimental setups allowed the researchers to investigate
the fatigue states of participants during long-term driving on a
highway in a realistic simulation. To evaluate brain dynamics
in the driving task, we further adopted an event-related lane-
departure driving paradigm based on the VR platform, as
depicted in Fig. 2. During the VR driving paradigm,
participants were instructed to drive within the developed
environment and to maintain the virtual vehicle in the center of
the cruising lane. Lane perturbation events would be randomly
introduced to cause the virtual vehicle to drift from the center
of the cruising lane. The cognitive states and fatigue levels of
experimental
the participants were monitored throughout the experiment via
a surveillance camera and the vehicle trajectory.
B. Participants and EEG Recording
Ten right-handed, healthy young adults participated in the
behavioral experiment (average age ± standard deviation; 24.2
± 3.7 years old). Before each phase of the experiment, the
subjects answered a questionnaire regarding their sleep patterns
to guarantee that they were not sleep deprived or taking any
medication that might influence their cognitive states. To
properly evaluate their driving performance, the participants
attended a pre-test session to verify that none of the
participants were afflicted with simulator sickness. The
Institutional Review Board of the Veterans General Hospital,
Taipei, Taiwan, approved the study.
The EEG signals were recorded from 30 sintered Ag/AgCl
EEG active electrode sites, which were all referred to linked
mastoids. All the EEG electrodes referred to the right ear lobe
were placed in accordance with a modified International 10–20
system of electrode placement. During the driving task, lane
deviation (LD) and response time (RT) of each subject were
also recorded simultaneously. The RT denotes the time period
between the onset of the deviation and the onset of the
response and is used as an objective measure of the drowsiness
(DS) level during each lane departure event [7]. To ensure that
each subject had a consistent DS level during the entire period,
DS levels of each subject are normalized to the range [0, 1].
The normalized DS levels are presented as temporal sequences
and are utilized as the desired output of the proposed system in
this study.
2489

Fig. 3. Procedure of the generalized prediction system for drowsiness
levels.
C. EEG Analysis
The general scheme of the EEG analysis is illustrated in
Fig. 3. The acquired EEG data were processed and analyzed
through EEGLAB (http://www.sccn.ucsd.edu/eeglab/, an open-
source EEG toolbox of MATLAB) [11] during the
preprocessing stage, and raw EEG signals were subjected to a
1-50Hz band-pass infinite impulse response (IIR) filter; the
activity was down-sampled to 250 Hz from the 500 Hz of the
recording sample rate during the hardware phase.
In this paper, the EEG data recorded 5 s before the
deviation onset served as an indication of the driver’s
physiological state, and the RT, which ranged from the
deviation onset to the response onset, was defined as the
participant’s state of awareness. When the participants
remained alert in the baseline period, their RTs to the random
drifts were short, thus resulting in a small deviation from the
center of the lane. In contrast, if the participants were in a
fatigue state, the RTs and lane deviations were large. For the
proposed system, we utilized the features of the EEG data
before the lane departure to predict the DS levels of the
participants.
D. Independent Component Analysis and Source Clusters
EEG signals collected from electrode sites on the scalp
contain different activation volumes from multiple cerebral
cortexes that simultaneously occur within a large brain volume.
It is difficult to identify the underlying activation sources and
magnitudes in the cognitive task by the mixed EEG signals
from distinct differences. Moreover, measurements of
physiology signals usually include various artificial
contaminations, e.g., muscle artifacts, oversize eye movement
and electrical interference from equipment, which is called the
blind source separation (BSS) problem in EEG-related studies.
Independent component analysis (ICA) [6] is an effective EEG
signal processing technique and can be used to find a source
mapping from original data that has been blended with
unrelated artificial noise. The EEG signals after ICA
processing were then segmented into a set of epochs of varying
lengths from 5 s before each deviation event to the occurrence
of the following deviation event. The epoched data were
separated from artifacts using an ICA algorithm implemented
in the EEGLAB toolbox for the purpose of selecting real
activation components.
One issue within many ICA-based algorithms is that the
results from different runs of the algorithm are stochastic and
are highly dependent on certain factors, e.g., the initial
2490 2016 IEEE International Conference on Fuzzy Systems (FUZZ)
conditions of the learning mechanism and the statistical
reliability of the estimated ICs. The algorithmic reliability of
the ICs used in this study must be further analyzed for the
subsequent EEG recognition task. In [12], Himberg et al.
developed an interactive visualized software package,
ICASSO, for analyzing the reliability of ICA decomposition.
The basic principle is to repeat an ICA algorithm many times
and observe the distribution of the estimated components in the
clustering space. If an IC is reliable, each run of the algorithm
should generate one point in the clustering space that is very
close to the actual component. To quantify the cluster quality,
an index ‫ܫ‬௤ is introduced to reflect the compactness and
isolation of a cluster, which is defined by
1 1
I q (C m ) = 2 ¦ σ ij − ¦ ¦ σ ij (1)
Cm i , j∈C m C m C −m i∈C m j∈C − m
where ‫ܥ‬௠ is the set of indices that belong to the th cluster
and ‫ିܥ‬௠ is the set that does not belong to the cluster. In this
study, the number of repeated randomizations is 25, and the
number of allocated clusters is 30, which is the initial number
of ICs after the ICA procedure. If ‫ܫ‬௤ of each estimated cluster
is larger than 0.9, the corresponding IC was regarded as the
actual components for further analysis.
After the ICA processing is performed in the proposed
system, the ICs in the occipital were selected as the interest
cerebral cortex for the driving task to be further back-projected
to original channels O1, O2 and Oz according to the modified
International 10–20 system of electrode placement. This
mechanism provided superior EEG data, including fewer
artifacts, in this study. On the other hand, for the real-time BCI
system, the ICA processing will be omitted due to its need to
be performed off-line; however, the ICA analysis still provides
sufficient information to reserve valid channels, e.g., the
channels related to the occipital lobe are reserved in this study.
In this paper, we present the results with/without ICA
processing in section IV; the results without the use of the ICA
procedure in the real-time BCI design remain consistent with
the results from using ICA preprocessing.
E. Power Spectra Analysis and Feature Extraction
In this study, event-related spectral perturbation (ERSP)
analysis was exploited to analyze the neural responses to
fatigue fluctuations during a driving task. Physiological
features were extracted by transforming the time-series EEG
signals into the frequency domain using a fast Fourier
transform (FFT) to show the spectral dynamics of brain
activities. Based on the findings in the previous studies [8],
[13], each epoch in the back-projected base channels (O1, O2
and Oz) was separately transformed into the time-frequency
representation via ERSP routine [11]. For each channel of
interest of the cerebral cortex, the mean delta- (: 1-3 Hz), theta-
(: 4-7 Hz), alpha- (: 8-12 Hz), and beta- (: 13-20 Hz) band
powers were used for power spectra analysis and feature
extraction.
III. RSEFNN
We exploited a RSEFNN [9] with local feedbacks as a
recognizer for driving fatigue in this paper. The recurrent

Fig. 4. Recurrent Self-Evolving Fuzzy Neural Network (RSEFNN).
structure in the RSEFNN originates from locally feeding the
firing strength of a fuzzy rule back to itself, which avoids
utilizing extra outer registers for memorizing past states. In
contrast to traditional RNNs, the computational complexity of
the RSEFNN is low because of the simplified recurrent
structure. The locally recurrent structure in the RSEFNN is
concise, but its performance is admirable in comparison with
those of other fully recurrent FNNs [9], [10]. The RSEFNN
consists of two learning phases, structure learning and
parameter learning. All fuzzy rules generated in the RSEFNN
are using self-evolving structure learning algorithm, and
gradient descent (GD) algorithm is used for tuning all free
parameters; therefore, those manners in the RSEFNN are
suitable for addressing real-time application.
The RSEFNN is composed of six layers, and each layer
contains many nodes of nonlinear operation as neurons. The
structure of RSEFNN model is as drawn in Fig. 4. The
mathematical functions of each layer in a RSEFNN are
detailed explanation below. In the following description, ‫ݑ‬ሺ௟ሻ
denotes the output of a node in the ݈௧௛ layer.
Layer 1(Input layer) - The inputs are crisp values and
denoted as ܺറ ൌ ሺ‫ݔ‬ଵ ǥ ‫ݔ‬௡ ሻ. No computation is done in layer 1.
Each node in this layer, which corresponds to one input
variable, only transmits input values to the next layer directly.
ui(1) = xi (2)
Layer 2 (Fuzzification layer) - Layer 2 is also called
membership function layer. Each node in this layer performs
Gaussian membership function that corresponds to one
linguistic label of the input variable in layer 1.The calculated
membership value in layer 2 is
[u i(1) − mij ] 2
u ij( 2) = exp(− ) (3)
σ ij2
where ݉௜௝ and ߪ௜௝ଶ are the mean and variance of the Gaussian
membership function, respectively, of the ݆௧௛ term of the ݅௧௛
input variable ‫ݔ‬௜ .
2016 IEEE International Conference on Fuzzy Systems (FUZZ)
Layer 3 (Spatial firing layer) - Each node in this layer 3
corresponds to one fuzzy rule and functions as a spatial rule
node. Nodes in layer 3 receive single-dimensional
membership degrees based on the associated rule from the
nodes of a set in layer 2.
Here, the fuzzy AND operator is adopted to perform the
precondition part of fuzzy rules, using an algebraic product
operation to obtain a spatial firing strength ‫ ܨ‬௝ . As a result, the
spatial firing strength of each rule node can be denoted by
u (j3) = F j = ∏ (u
j
(2)
ij ) (4)
ሺଶሻ
where the ς௝ ‫ݑ‬௜௝ of a rule node represents the spatial firing
strength of its corresponding rule.
Layer 4 (Temporal firing layer) - Each node in layer 4 is
represented as a recurrent fuzzy rule node that forms an
internal feedback loop. The time step is denoted by t. The
௝
output of a recurrent node is a temporal firing strength ߶௤ ሺ‫ݐ‬ሻ,
which consists of both the spatial firing strength and the
௝
temporal firing strength ߶௤ ሺ‫ ݐ‬െ ͳሻ . The temporal firing
௝
strength ߶௤ ሺ‫ݐ‬ሻ is a linear combination of the spatial firing
strength ‫ ܨ‬௝ ሺ‫ݐ‬ሻ and the previous temporal strength ߶௤ ሺ‫ ݐ‬െ ͳሻ.
௝
The combination equation is
u (j4 ) = φ qj (t ) = λ qj F j (t ) + (1 − λ qj )φ qj (t − 1) (5)
௝
where Ͳ ൑ ߣ௤ ൑ ͳ is a recurrent parameter that determines
the ratio of contribution between current and past states. The
recurrent parameters are initialized with random values
uniformly generated from the interval ሾͲǡͳሿ and then updated
by learning algorithm.
Layer 5 (Consequent layer) - Nodes in layer 5 are called the
consequent nodes. The weight of the link from a node in layer
௝
4 to one in layer 5 is ܽ௜௤ . Each recurrent rule node in layer 4
has a corresponding consequent node in layer 5. The
consequent node function performs a linear combination of
input variables ܺറ ൌ ሺ‫ݔ‬ଵ ǥ ‫ݔ‬௡ ሻ . The output of layer 5 is
computed as follows.
n
u (j5) = f qj (t ) = ¦a
i =1
j
iq xi (t ) (6)
Layer 6 (Output layer) - The output node in layer 6, which
acts as a fuzzy defuzzification, integrates all of the actions
recommended in layers 5 and recurrent nodes in layer 4. The
weighted average defuzzification method is used in this layer.
2491
 TABLE I where R is the total number of fuzzy rules and y is the output
RELIABILITY BEFORE AND AFTER INDEPENDENT COMPONENT REJECTION of the model of RSEFNN.
Reliabilityሺ‫ܫ‬௤ ሻ Reliabilityሺ‫ܫ‬௤ ሻ No. of Reserved
Subj. IV. EXPERIMENTAL RESULT
Before IC Rejection After IC Rejection ICs

S1 0.9017 0.9578 17 We collected EEG data from 10 healthy participants, who

had been informed and trained before the VR-based driving
S2 0.9553 0.9732 26 experiment. Here, we present the results with/without ICA
processing, and the performance results indicate that the results
S3 0.8907 0.9447 20
from omitting the ICA procedure is consistent with the results
S4 0.8792 0.9601 13 using ICA preprocessing.
S5 0.8798 0.9680 16 A. Validation of ICA reliability
S6 0.9497 0.9655 26
A visualization software package, ICASSO [12], was used
to analyze the reliability of the ICA decomposition. First, we
S7 0.9272 0.9627 24 select the number of clusters L as 30, and the number of
repeated randomizations is 25. To explicitly demonstrate the
S8 0.9395 0.9598 26
validation of the stability, we utilize subject 1 as an example in
S9 0.9095 0.9614 22 this section. The visualized interrelation of IC clusters for
subject 1 is depicted in Fig. 5. Clusters are indicated by red
S10 0.9028 0.9652 17 convex hulls, and the diameter of each cluster represents the
strength of reliability index ‫ܫ‬௤ . Fig. 6 illustrates the stability of
Avg. 0.9135 0.9618 20.7
each cluster for subject 1, and we only reserved the
STD. 0.0265 0.0072 4.5 components with ‫ܫ‬௤ greater than 0.9 as actual components for
` further analysis. The reliability test before and after the IC
Single-run-estimate rejection of each participant is listed in Table I. The average
"Best Estimate" (centrotype)
1 value of ‫ܫ‬௤ before IC rejection is 0.9135±0.0265, and the value
0.80<s ≤ 0.90
ij 0.9
Averge intra-cluster similarity after IC rejection is 0.9618±0.0072. The average ICs that are
0.90<s ≤ 1.00 0.8
(cluster compactness) reserved in the proposed system after the IC reliability test is
ij 0
20.7, that is, we remove approximately 10 ICs in this noise
8 17 removal procedure. Then, the estimated source signals for the
centers of clusters after poor IC rejection are further back-
4 11 projected to the original channels. The ICA procedure and
18
12 stability test for robust ICs can produce reliable EEG signals
9 and thus indicate the activated brain areas for the recognition
22
2 23 task.
10 19
B. Evaluation Results with and without ICA Preprocessing
14 29 20 6 The generalized procedure of the proposed cross-subject
13 16 1
2
24 5 3
21 1 5
30 26 6
4
7 28 7
3 8
9
27 15 13
10
25 11
17
Fig. 5. The similarity graph of the estimates for Subject 1. Clusters are 12
Label

15
indicated by res convex hulls. Red lines connect estimates for which the 14
similarity is larger than a threshold; the darker the line, the stronger the 18
similarity. The total number of clusters is set to L=30, for which Labels 1-30 22
19
correspond to individual clusters.
20
27
21
23
R R § n · 25

¦φ j j j
q (t )( f q (t ) + a 0 q ) ¦φ j ¨
q (t )¨ ¦a j
iq xi
¸
¸
26
16
j =1 j =1 © i =0 ¹ 28
y = u (j6) = R
= R
(7) 24
29

¦j =1
φ qj (t ) ¦
j =1
φ qj (t ) 30
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Fig. 6. The stability quality index ‫ܫ‬௤ in rank order for ICA estimated
clusters for Subject 1.

2492 2016 IEEE International Conference on Fuzzy Systems (FUZZ)


Fig. 7. Test RMSE for generalized cross-subject prediction system with
ICA preprocessing.
`
drowsiness prediction system is revealed in this section. For
each comparative model, one subject was randomly selected
as the testing set, and the nine remaining subjects were used as
the training set. Because the EEG data were regarded as a
temporal sequence, the EEG trials in the training set were
integrated in the presence of different permutations of
subjects. For instance, supposing that we have collected 10
subjects (subject 1 to subject 10) via the EEG device, if we
utilized subject 1, denoted as S1, for test, the remaining
subjects, which can be rearranged as nine different data sets
([S2 S3 … S10], [S3 S6 …S9], etc.), are used to train the
general system. To test each subject in each model, a ten-
round validation was adopted to verify the effectiveness of the
model.
Fig. 7 shows the results obtained using the comparative
models for the generalized cross-subject prediction system with
Fig. 8. Test RMSE for generalized cross-subject prediction system without
ICA preprocessing.
ICA preprocessing, including the SVR [14], SONFIN [15],
TRFN [16], and RSEFNN. The RMSE of an estimator
measures the difference between the estimated and actual DS
levels (RT) [17]. The RMSEs of the SVR, SONFIN, TRFN,
and RSEFNN, indicating training and test performance, are
0.1231±0.0195, 0.0760±0.0294, 0.0813±0.0303, and
0.0757±0.0274 and 0.1283±0.0468, 0.1187±0.0405,
0.1149±0.0389, and 0.1052±0.0349, respectively. Therefore,
the generalized cross-subject prediction system using the
RSEFNN model produces a superior result in comparison with
the other models.
For the real-time BCI design in this study, the ICA
processing will be omitted because it must be performed off-
line; however, the ICA analysis provides sufficient information
to reserve valid channels; e.g., O1, O2 and Oz are reserved in
this study. Fig. 8 present the results of a comparison of the
models, including the SVR, SONFIN, TRFN, and RSEFNN,

Subject 3
Response Time(s)

1
Measured Output TRFN
Normalized

RSEFNN SVR
0.5 SONFIN

0
50 100 150 200 250 300 350 400
Trial(s)
Subject 6
Response Time(s)

1
Measured Output TRFN
Normalized

RSEFNN SVR
0.5 SONFIN

0
50 100 150 200 250
Trial(s)
Subject 8
Response Time(s)

1
Measured Output TRFN
Normalized

RSEFNN SVR
0.5 SONFIN

0
50 100 150 200 250 300 350 400
Trial(s)

Fig. 9. Evaluation curves of generalized cross-subject models (RSEFNN, SONFIN, TRFN and SVR) without ICA preprocessing for Subject 3, Subject 6 and
Subject 8. The real measured response time is denoted as Measured Output with the black line. The red dot line, green, cyan-blue and purple dashed lines
express the prediction results of RSEFNN, SONFIN, TRFN and SVR, respectively.

2016 IEEE International Conference on Fuzzy Systems (FUZZ) 2493

for a generalized cross-subject prediction system without ICA
preprocessing. The RMSEs of the SVR, SONFIN, TRFN, and
RSEFNN models, indicating training and test performance, are
0.1210±0.0156, 0.0793±0.0243, 0.0801±0.0267, and
0.0840±0.0285 and 0.1417±0.0476, 0.1345±0.0404,
0.1286±0.0396, and 0.1197±0.0372 respectively. The
estimated RTs for subject 3, subject 6 and subject 8 for the four
prediction models are depicted in Fig. 9. In Fig. 9, the
RESFNN model produces a superior approximation for the
estimated RTs both in high- and low-DS areas. The results
indicate that the performance when omitting the IC
preprocessing is fairly consistent with the results using ICA
preprocessing. Therefore, although it does not use the ICA
procedure, the RSEFNN model demonstrates a remarkable
performance compared to the other comparative models (SVR,
SONFIN and TRFN).
V. CONCLUSION
The characteristics of brain dynamics of human beings are
basically time variant and mercurial; therefore, the magnitude
of the EEG signal in the driving task usually exhibits extreme
fluctuations. To improve the quality of EEG signals for real
applications, we developed a real-time BCI system for fatigue
prediction using an on-line learning algorithm with pre-event
EEG for assessing driver’s mental states during a car driving
task. This study utilizes a RSEFNN to increase memory
capability for adaptive noise cancellation. Based on the
experimental results, it is apparent that our system
demonstrates remarkable performance when used for fatigue
prediction during a car driving task.
ACKNOWLEDGMENT
This work was supported in part by the Aiming for the Top
University Plan of National Chiao Tung University, sponsored
by the Ministry of Education, Taiwan, under Grant Number
105W963; in part by the VGHUST Joint Research Program,
Tsou's Foundation, Taiwan, under Contract VGHUST105-G7-
10-3 ; in part by MOST104-2221-E-009-191; and in part by the
Cognition and Neuroergonomics Collaborative Technology
Alliance Annual Program Plan, sponsored by the Army
Research Laboratory under Cooperative Agreement Number
W911NF-10-2-0022.
The authors would also like to thank Prof. Jyh-Yeong,
Chang and all members at Brain Research Center, National
Chiao Tung University, Taiwan.
REFERENCES
[1] A. Nijholt and D. Tan, “Brain-computer interfacing for
intelligent systems,” IEEE Intell. Syst., vol. 23, pp. 72–79,
2008.
[2] Vaughan, Heetderks, Trejo, Rymer, Weinrich, Moore,
Kübler, Dobkin, N. Birbaumer, Donchin, and Wolpaw,
“Brain-computer interface technology: a review of the
Second International Meeting,” IEEE Trans. Neural Syst.
Rehabil. Eng., vol. 11, pp. 94–109, 2003.
2494 2016 IEEE International Conference on Fuzzy Systems (FUZZ)
[3] F. Lotte, M. Congedo, A. Lécuyer, F. Lamarche, and B.
Arnaldi, “A review of classification algorithms for EEG-
based brain-computer interfaces,” J. Neural Eng., vol. 4,
no. 2, pp. 1–13, 2007.
[4] F. Popescu, B. Blankertz, and K. R. Müller,
“Computational challenges for noninvasive brain
computer interfaces,” IEEE Intell. Syst., vol. 23, pp. 78–
79, 2008.
[5] E. Vaadia and N. Birbaumer, “Grand challenges of brain
computer interfaces in the years to come,” Front.
Neurosci., vol. 3, pp. 151–154, 2009.
[6] S. Makeig, A. J. Bell., T. P. Jung, and T. J. Sejnowski,
“Independent Component Analysis of
Electroencephalographic Data,” Adv. Neural Inf. Process.
Syst., vol. 8, pp. 145–151, 1996.
[7] C. H. Chuang, L. W. Ko, T. P. Jung, and C. T. Lin,
“Kinesthesia in a sustained-attention driving task,”
Neuroimage, vol. 91, no. 1, pp. 187–202, 2014.
[8] R. S. Huang, T. P. Jung, A. Delorme, and S. Makeig,
“Tonic and phasic electroencephalographic dynamics
during continuous compensatory tracking,” Neuroimage,
vol. 39, no. 4, pp. 1896–1909, 2008.
[9] C. F. Juang, Y. Y. Lin, and C. C. Tu, “A recurrent self-
evolving fuzzy neural network with local feedbacks and
its application to dynamic system processing,” Fuzzy Sets
Syst., vol. 161, no. 19, pp. 2552–2568, 2010.
[10] C. J. Lin and C. C. Chin, “Prediciton and identification
using wavelet-based recurrent fuzzy neural networks,”
IEEE Trans. Syst. Man Cybern. Part B-Cybern., vol. 34,
pp. 2144–2154, 2004.
[11] A. Delorme and S. Makeig, “EEGLAB: An open source
toolbox for analysis of single-trial EEG dynamics
including independent component analysis,” J. Neurosci.
Methods, vol. 134, no. 1, pp. 9–21, 2004.
[12] J. Himberg, A. Hyvärinen, and F. Esposito, “Validating
the independent components of neuroimaging time series
via clustering and visualization,” Neuroimage, vol. 22, pp.
1214–1222, 2004.
[13] M. Azarnoosh, A. Motie Nasrabadi, M. R. Mohammadi,
and M. Firoozabadi, “Investigation of mental fatigue
through EEG signal processing based on nonlinear
analysis: Symbolic dynamics,” Chaos Solitons Fractals,
vol. 44, no. 12, pp. 1054–1062, 2011.
[14] C. C. Chang and C. J. Lin, “LIBSVM: a library for
support vector machines,” ACM Trans. Intell. Syst.
Technol., vol. 2, no. 3, pp. 1–39, 2011.
[15] C. F. Juang and C. T. Lin, “An on-line self-constructing
neural fuzzy inference network and its applications,”
IEEE Trans. Fuzzy Syst., vol. 6, pp. 12–32, 1998.
[16] C. F. Juang, “A TSK-type recurrent fuzzy network for
dynamic systems processing by neural network and
genetic algorithms,” IEEE Trans. Fuzzy Syst., vol. 10, no.
2, pp. 155–170, 2002.
[17] Y.-T. Liu, Y.-Y. Lin, S.-L. Wu, C.-H. Chuang, and C.-T.
Lin, “Brain Dynamics in Predicting Driving Fatigue
Using a Recurrent Self-Evolving Fuzzy Neural Network,”
IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 2, pp.
347–360, 2016.