Vous êtes sur la page 1sur 10

Tamkang Journal of Science and Engineering, Vol. 13, No. 4, pp.

395-404 (2010) 395

Intelligent Safety Warning and Alert System for


Car Driving
Shih-Nan Lu1, Hsien-Wei Tseng2, Yang-Han Lee1*, Yih-Guang Jan1 and Wei-Chen Lee1
1
Department of Electrical Engineering, Tamkang University,
Tamsui, Taiwan 251, R.O.C.
2
Department of Computer and Communication Engineering, De Lin Institute of Technology,
Tucheng, Taiwan 380, R.O.C.

Abstract
The new vehicle performance has been continuously improved and the study results relating to
the safety of car driving have also been continuously reported and demonstrated, it is trying to find a
balance point between the development of vehicle speed limit and the protection of drivers safety. In
the current study and development of various products, no matter it is in the enforcement of vision
system, radar detection or the tracing and control it is always asking the driver to watch or handle the
possible issues after the occurrence of accidents. In this paper we try to develop a system to provide the
prior to accident information to the vehicle control unit so that it enables the vehicle to prevent the
happening of accident. During the vehicle movements the system will continuously record the
vehicles moving status and conditions so that the record will provide the decision basis in the accident
investigation if it unfortunately happens the fatal accident.

Key Words: Intelligent Safety, Vehicle Control Unit, Warning and Alert System, Automation,
Car Driving

1. Introduction will reach 90% if 1.5 seconds is added into the warning
period. We introduce in the following some safety warn-
When it turned into twentieth century various kinds ing systems [1-6] that are currently available in the mar-
of vehicles have been introduced to provide convenience ket and they are technically matured:
in human daily life and due to the developments of new
technologies it makes the vehicle running fast and ac- 1.1 Sleepiness Warning System
celerating easily. It on the contrary brings in some pro- It reports in statistics that the fatality rate increases
blems such as the happenings of accidents due to drivers by four times when the driver is sleepiness in driving
fatigue after a long journey of travel, the shortage of therefore many researches are focused on finding the re-
parking spaces, the bad visibility in night or the driving lationship between the sleepiness with the drivers eye-
in heavy rain days etc. The accidents sometimes bring in lids width, the visibility of the pupil, the motion of the
the fatality of human lives and loss of properties, there- head etc. Industrial Technology Research Institute
fore many measures to enforce the safety driving and the (ITRE) has even used the ultra wide bandwidth (UWB)
development of models to monitor drivers behaviors technique to integrate low power pulsed electromagnetic
have been proposed and brought in many promising re- (EM) waves to precisely measure the drivers physiolog-
sults. From a study conducted by Mercedes Benz it re- ical signals such as his heartbeat and respiration etc. It is
ports that if it can get an extra 0.5 seconds in the warning also through the development of various system algo-
period it will avoid 60% of the overrun accidents and it rithms to detect drivers psychic status. In all these tech-
nology developments its main purpose is trying to emit
*Corresponding author. E-mail: yhlee@ee.tku.edu.tw warning signal to awake the driver before his falling into
396 Shih-Nan Lu et al.

sleepiness and to avoid any possible accidents. the driver to automatically assist the driver to reverse the
car into the garage or to park the car along the road side.
1.2 Low-Speed Following Mode (LSM) System It has other systems, just mention here for reference,
The LSM exploits mini-meter wave radar to detect such as Adaptive Cruise Control (ACC), Electronic Sta-
the acceleration, deceleration and stopping of the front bility Control (ESC), Emergency Brake Assist (EBA),
car to estimate the distance away from the front car, Blind Spot Warning etc. each system has its own specific
meanwhile he also controls the brake and the fuel sys- functions and will not discuss them further [7,8].
tems to maintain his car within the safety range. If the In the design of safety vehicle driving system, it needs
front car experiences abnormal condition the system will to consider and include the following four processes:
blow alarm sound to warn the driver. (1) Normal condition - to assist the driver to lower his
driving burden and to provide him with visual and
1.3 Lane Keeping Assist System (LKA) driving assistances.
The LKA uses camera to monitor the passing or di- (2) Prior to accidence - to prevent the occurrence of acci-
viding lane in the front and the system will give warning dent and to possibly provide the actions of collision
signal if the driver crosses the passing lane or enters into avoidance and warning.
the opposite direction passing lane without giving or gi- (3) During the accidence - to reduce the damage and the
ving improper direction signal. collection of accident data and information.
(4) After accidence - to report the accidence and to pro-
1.4 Intelligent Night Vision System (INVS) vide emergency treatment.
In driving at night or in heavy rain the drivers visi-
ble range will be restricted and also the light illuminating In the above-mentioned research themes, they usu-
range will be limited to prevent the driver from clearly ally emphasize and confine in the normal and prior to ac-
noticing any pedestrian along the roadside or the person cidence processes it seldom covers the information and
is in repairing his out of condition car the INVS will dis- data collections and the emergency treatment during the
play the front road condition on the LCD screen of the accidence and the accident report after the accidence.
car audio system by using infrared camera to monitor the The main theme we will consider in this paper is the
road condition to present to the driver a complete know- monitoring of the vehicle behavior model prior to the
ledge of the front road condition to greatly reduce the happen of accidence, to warn the driver when abnormal
possible occurrences of accidents. and dangerous condition might happen and meanwhile it
will record the vehicle acceleration, deceleration and its
1.5 Adaptive Front-Lighting System (AFS) moving direction and finally to provide sufficient infor-
The AFS catches the cars moving direction by using mation or data for the investigator when he is in the in-
the direction sensor implemented in the wheel and then vestigation of the accident case.
using the units control motor to rotate the headlight and The organization of this paper is in the following.
with the installation of High Intensity Discharge (HID) We will introduce the current development of vehicle
Xenon light to extend the light illuminating range so as safety system in section 1. In the second section we will
to enable the pedestrians and the obstructions in the ve- briefly introduce the most commonly implemented in-
hicle direction to be visible to the driver. formation transmission system in the current vehicles.
We will then introduce the design concept and the test
1.6 Video Parking Assist System platform of our proposed vehicle monitoring system in
This system uses camera system to extract the images section 3. In section 4 it will present, discuss the data we
of the car in the back and side directions and in its coordi- collect and the results of analyzing these collected data.
nating with the collision avoidance radar system and the
dynamic auxiliary linear system to inform the driver of the 2. Introduction of Vehicle Transmission System
wheel rotation direction and angle to assist the driver to
complete the reversing or parking action. Currently it has It currently has more than few tens of electronic in-
a new system, in coordinating with the wheel rotating struments installed in the vehicle, but at the initial design
mechanism, without requiring the direct involvement of stage almost every instrument is just designed to inde-
Intelligent Safety Warning and Alert System for Car Driving 397

pendently perform its own function without coordinating rently the majority of cars uses the single line transmission
and accommodating with others so that the vehicle instru- mode its transmission distance can reach 35 meters [11,12].
ments are just providing the base layer data of the vehi-
cle condition such as the vehicle speed, engines torque, 2.3 CAN bus (Controller Area Network)
the remaining in the gas tank and the radiators tempera- Within the transportation vehicle it can install one
ture etc. The vehicles audio-video system just provides set or many sets of CAN buses. Low speed CAN bus can
the audio or video amusement and could not display or be used in the regular information transmission and con-
provide other conditions of the vehicle. This independent trol while the high speed CAN bus can be used in the
situation has quickly been drawn attention and every handling and management of engine condition and in the
world car manufacture has proposed its own ideas of how control of vehicle brake system. The CAN bus is the
to inter-connect instruments, basically they possess the most popular bus system used in all vehicles, almost all
characteristics of separating the high speed instrument information within each vehicle can be communicated
from the slow speed instrument, serial bus structure and and conveyed through this bus system, but each car
the capability to resist the high random noise. We give a manufacture has different definition for its information
brief description of each instrument in the following: content, it is not easy to understand the content of the in-
formation transmitted in the bus of other vehicles if the
2.1 MOST bus (Media Oriented Systems Transport) information definitions in the bus system are not trans-
The MOST bus system was agreed upon and set up parent between car manufactures [11,13,14].
by some giant car manufactures and cars equipments
providers in 1997 it uses the structure of Ring, Star or 2.4 LIN bus (Local Interconnect Network)
Daisy-chain to build up a point-to-point optical network This bus system is used within the transportation
system with data rate of 22.5 Mb/s that it is high enough vehicle itself, it is a series bus to communicate between
to convey the compressed videos. Plastic optical fiber is each detecting/monitoring instrument and electronic
the main transmission media for the optical network to switch, its highest transmission rate is 19200 bauds for a
provide a wide bandwidth, low interference data trans- maximum transmission distance of 40 meters [11].
mission network. The Germany car manufacture BMW In addition to above discussed bus structures that are
integrates this optical network with its own developed frequently implemented in the vehicles they are many
ByteFlight system to form the Intelligent Safety Integra- other designs and structures of bus systems such as MI,
tion System (ISIS). This ISIS system has been imple- DSI, OBDII, Flex Ray, D2B, SMART wire X, IDB-1394,
mented in its 7 series sedans to provide a safety monitor- IE bus, Intelli Bus, BST bus, MM bus and J1708 bus etc.
ing function for the whole vehicle.
Due to the high transmission speed of the MOST bus, 3. Design Concept and the Composition of the
the low radiation interference to its surroundings, the Design Platform
lightweight of the transmission material (it is estimated
that its weight is around 1/20 of the current copper wire), 3.1 The Composition of the Design Platform
the price dropping of the optical material and the easier This design platform consists of a microprocessor
installation and connection of the optical network etc., it is and an acceleration sensor as shown in Figure 1 is a test
anticipated that the MOST bus system will become the board of an acceleration sensor. The analog signal output
dominant system in the vehicle bus system [9-11]. from the acceleration sensor is amplified by a two-stage
amplifier and is sent to the design platform, the system is
2.2 J1850 bus completed by connecting this platform with a computer.
J1850 bus was designed in 1994, its purpose was to This test board is also integrating with an optical receiver
apply the functions of self-diagnosis and information and many sets of analog/digital converters for use with
sharing etc. within the transportation vehicle (such as other applications.
car, airplane etc.) In J18050 bus it basically has two infor-
mation transmission modes, the first mode is a 41.6 Kbps 3.2 Procedures in Data Extraction and Data
dual-line differential PWM transmission mode, the other Analysis
is a 10.4 Kbps single line VPM transmission mode. Cur- It uses vibrator to test the acceleration of the design
398 Shih-Nan Lu et al.

platform, the design platform is vertically fixed at the vi- data obtained from the design platform are reproducible
brator platform due to the vibrator is repeatedly vibrating and we can use any set of data in the analysis.
in the up/down directions. We made four random tests After analyzing the test data, obtained from the de-
and in each test we applied 1G ~ 4G vibrating force test sign platform, we have the data distributions for the
in four directions of the design platform. As shown in 1G~5G vibrating force tests as shown in Figure 4.
Figures 2 and 3 are a series of resulting vibrating wave-
forms in the tests. The vibrator delivers its sensed output 3.3 The Design of Acceleration Impulse
in each dimension of the 2D test, but we just select one Pre-Warning System and Its System Flow Chart
set of data from the x-axis and from the y-axis for analy- When a vehicle is supposed to be in slow motion or in
sis. In the test driving condition when it happens to have stopping situation but due to the malfunction of the fuel
acceleration impulse effect it will happen only in the x- supply system or due to the human mistake the vehicle en-
direction (forward-backward) with an abrupt and high- gine is accelerating to a high speed in a very short duration
slope data changes while in actual driving situation it and resulting in the vehicle damage and the fatalities of
will also happen with data variation in the y-axis (left- the driver and passengers. It intends to design a pre-warn-
right). The data obtained from these four random tests ing system to prevent the happening of the acceleration
are almost the same therefore we can conclude that the impulse in its early forming stage and to inform or to warn
on time to the fuel supply system, the electric system or
the brake system to perform appropriate action to prevent
the occurrence of this kind of accidence.
The acceleration impulse pre-warning system is ba-
sically an automatic data analysis system that is set up
from integrating the results by analyzing various test
data collected from the test. When the design platform
extracts a new data it will analyze the data and from its
analyzed result to determine how many Gs of the vehi-
cles acceleration has and to display the result on the
monitor. In the design of our pre-warning system we as-
sume that when the acceleration exceeds 3G it will have
acceleration impulse effect, therefore we will mark with
Figure 1. Test board of acceleration sensor. red symbol under the main picture when the data is

Figure 2. Test data in the x-axis.


Intelligent Safety Warning and Alert System for Car Driving 399

Figure 3. Test data in the y-axis.

Figure 4. Data distribution resulting from 1G~5G vibrating force tests.

higher than 3G to signify it is in the dangerous stage. during and after the accident. The driving behavior moni-
Furthermore in the actual test we found that when the ac- toring system is not only to record the vehicle running con-
celeration exceeds 5G this vibrating force is far more ditions for certain time interval but also gives warning sig-
than human being can be safely driving or seating in the nal to the driver before occurring any dangerous condition
vehicle we therefore do not extract any data when the ac- and to advise the driver to correct his driving behavior.
celeration force is more than 5G and the system design When a car is running on the road the driver will al-
limit is also set at 5G. The system flow chart as shown in ways have certain preparatory action when he is going to
Figures 5 and 6. perform any change, which can be modeled by an as-
sociated identifiable model, for example, when he de-
3.4 System Design for Monitoring the Driving cides to make right or left turn he will normally reduce
Behavior and Its System Flow Chart his speed and enters into the turning lane he will then ac-
Except for few buses and large-size touring buses, al- celerate after he enters into 1/2 or 1/3 of the turning lane.
most all compact vehicles are not equipping with any In another example when a driver is driving in high
driving behavior monitoring system therefore it is impos- speed and is going to make an emergent stop he will usu-
sible to trace drivers driving behavior for those cars dri- ally take a few stages to break or stopping the car instead
vers. Consequently they do not have any pre-warning of braking the car all the way in only one step from the
and verification data available during the time prior to-, considerations of the safeties of the passengers and pos-
400 Shih-Nan Lu et al.

Figure 6. Flow chart of acceleration impulse pre-warning


system (2).

matic data analysis and simulation system. Since the be-


havior model used in the monitoring of driving behavior
Figure 5. Flow chart of acceleration impulse pre-warning is rather complicated and it also needs to analyze data
system (1).
taken simultaneously in the x-axis and y-axis directions,
in this paper we design and implement a simplified driv-
sible material carried in the vehicle. ing behavior monitoring system to analyze only one x-
Based on the experience of driving a car and col- axis and one y-axis data to determine the drivers behav-
lected statistical data in normal driving situation we can ior. We will need in our future task to enforce this intro-
analyze and develop some abnormal driving behaviors ductory system to consider not only one data point but to
such as when the driver is not fully awake or he is uncon- monitor the variation of data in an interval of time and
sciously drunk that he is driving the car diverting toward then to make the decision from these integrated data in-
to one side or could not keep the car running in a straight formation. It may also need to include some fuzzy pro-
line due to he could not make correct decision or to deter- cess so that to accomplish a more delicate identification
mine the proper distance from the front car, or he could results. The system flow chart as shown in Figures 7 and 8.
not clearly identify in front road condition or he has
fallen asleep and even could not control the car. In this 4. Test Results and Its Distinguish from
situation he is driving the car toward to right or left but Other Systems
he will not have any braking action and in the worst si-
tuation he is speeding while the car is constantly making 4.1 Test Results of Acceleration Impulse
changes in right or left turns. Pre-Warning System
The intelligent driving monitoring system is an auto- When a vehicle endures acceleration impulse force it
Intelligent Safety Warning and Alert System for Car Driving 401

Figure 8. Flow chart of driving behavior monitoring system


(2).
Figure 7. Flow chart of driving behavior monitoring system
(1).
bel. When the system is actually implemented in the vehi-
is almost for sure it will be abruptly moving toward for- cle this warning label and control command will flow
ward or backward, the engine reinforces it to continu- through the data bus directly into its relevant systems to
ously rotate and is moving faster. Consequently the de- provide a timely safety protection measure or signal.
sign principle of our pre-warning system is to use the ac-
celeration sensor to measure and analyze the amount the 4.2 Test Results of the Driving Behavior
car has moved forward or backward; make its decision Monitoring System
based on the analyzed result. The test platform is in- In the driving behavior monitoring test the data
stalled on the car and it will measure the actual output of taken from the x-axis of the design platform is relating to
the acceleration sensor when the car suddenly acceler- the vehicle acceleration and braking decision while the
ates. After analyzing the measured data it is found that data taken from the y-axis axis is relating to the decision
when the sudden acceleration force has reached around to make right or left turn. In Figures 9~11 they analyze
2G the car is still controllable therefore we assume that it and display the results of many models of normal or ab-
will incur acceleration impulse effect when it reaches 3G normal driving behaviors. In the figure the label AD0
acceleration force and we will use 3G as the threshold to denotes the forward or backward movement, while AD1
issue a warning signal. represents the left or right direction movement. For an
We input the measured data into the acceleration im- illustrative example consider the third section of Figure
pulse detection system; when the input data has force 9, it initially runs the test with high speed but with
higher than 3G it will mark on the figure a red warning la- non-braking action it happens that the speed is too high
402 Shih-Nan Lu et al.

Figure 9. Vehicle makes right turn test. Figure 10. Vehicle makes left turn test.

to make a safety turn, it instantly lows the vehicle speed


to bring the vehicle safely back to its normal path and it
then accelerates again to make its turn. The fifth section
is the result of normal right turn, the vehicle decelerates
first before making turn and it accelerates again after
making 2/3 of the turn. In sixth section of Figure 10 it il-
lustrates the vehicle makes a dangerous left turn, the
speed is high when it makes left turn and it does not in-
tend to make any speed deceleration that it is easy to in-
cur accidence. In Figure 11 it is the situation when the
driver is awake but he makes an abrupt acceleration and
then makes an abrupt braking, his speed is accelerated to
certain level but he is afraid to make further acceleration Figure 11. Vehicle abruptly accelerating/abruptly applies bra-
so that in it shows in the figure that the speed is keeping king test.
at the same level for a while, it makes a little skid toward
the left when he abruptly applies the brake and all non- Each behavior is also given a name to signify its con-
fixed objects in the car are all getting loose and scattering dition. In actual implementation this system will be inte-
over everywhere. grated with the vehicles data bus and to provide the real
time data for the vehicles control system and have the
4.3 Test Data and Data Analysis control system to make proper decision.
From the data that we collected from the model of
vehicle moving behavior as described in the previous 4.4 The Integration with Vehicles Data Bus
section we conclude in Figure 12 the correlations be- The acceleration impulse pre-warning system and
tween vehicle moving directions versus vehicle mov- the driving behavior monitoring system as discussed in
ing speeds. From this figure it can identify which is the the paper are the test systems designed only for experi-
normal driving behavior that will not incur any dan- mental purpose. However if they only possess these de-
gerous action and which is the driving behavior that scribed functions or they are separately implemented
may easily generate accidence. It also displays their they will not provide many practical usages. The most
distributions. important issue is that they need to be cooperated with
The test results as shown in Figures 13 and 14 are the the vehicles data bus system so that it can convey the
results possibly displayed in the users interface. As measured data through the data bus and integrating to-
shown in Figure 13, the behavior designated with green gether with the control system to accomplish the main
line is classified as a normal condition while the danger- task of protecting the safeties of passengers lives and
ous behavior is displayed in red. properties.
Intelligent Safety Warning and Alert System for Car Driving 403

Figure 12. Correlations between vehicle moving directions with vehicle moving speeds.

Figure 13. Model of abrupt acceleration.

5. Conclusion celerate the vehicle speed prior to the happening of acci-


dent and if accident happens to reduce the damage to the
If many instruments are equipped in a high speed least level. In our study we also realize that in addition to
vehicle to provide more than necessary information to the items we have tested and verified they still have some
the driver they will draw the driver to pay particular at- tasks we can study in the near future such as the task when
tention to these instruments and furthermore he needs to the car is running along a sloppy road how the driving be-
learn how to maneuver there instruments. Diversion, fa- havior monitoring system can be incorporated with vehi-
tigue are two fatal factors in the car accidents. cle speed data, which is transmitted and obtained through
The main task of our study is trying through the study the data bus system, to provide relevant data to the moni-
of drivers driving behavior and in coordinating with the toring system to reflect a more accurate vehicles moving
information provided from the pre-warning system to de- condition and environment. To provide a more concise
404 Shih-Nan Lu et al.

Figure 14. Model of abnormal left turn.

format for the data transmitted in the data bus system to Physical and Emotional Characteristics to Safety
save some system memory is also a challenge task. Warning Sounds: Design Guidelines for Intelligent
Vehicles, IEEE Transactions on Systems, Man, and
References Cybernetics, Part C: Applications and Reviews, Vol.
99, pp. 1-7 (2010).
[1] Ioannou, P., Xu, Z., Eckert, S. and Clemons, D. Sieja, [8] Ruan, J., Yang, F., Song, R. and Li, Y., Study on
Intelligent Cruise Control: Theory and Experiment, ADRC-Based Intelligent Vehicle Lateral Locomotion
Decision and Control, 1993, Proceedings of the 32nd Control, Intelligent Control and Automation, 2008.
IEEE Conference on, Vol. 2, pp. 1885-1890 (1993). WCICA 2008. 7th World Congress on, pp. 2619-2624
[2] Juanid, K. M., Wang, S., Usman, K. and Tao, W., In- (2008).
telligent Longitudinal Cruise Control by Quadratic [9] Thomas Kibler, Stefan Poferl, Gotthard Bck, Hans-
Minimization and Robust Synthesis, Vehicular Elec- Peter Huber and Eberhard Zeeb, Optical Data Buses
tronics and Safety, 2005, IEEE International Confer- for Automotive Applications, Journal of Lightwave
ence on, pp. 182-187 (2005). Technology, Vol. 22 (2004).
[3] Mayr, R., Intelligent Cruise Control for Vehicles [10] MOST MOST Cooperation Official, 2008 MOST
Based on Feedback Linearization, American Control Cooperation, http://www.mostcooperation.com.
Conference, Vol. 1, pp. 16-20 (1994). [11] Automotive Buses, Automotive Buses and Vehicle
[4] Sun, J. and Yang, Q., Modeling and Intelligent Con- Buses, http://www.interfacebus.com/Design_Connec-
trol of Vehicle Active Suspension System, Robotics, tor_Automotive.html.
Automation and Mechatronics, 2008, IEEE Confer- [12] D. John Oliver, Implementing the J1850 Protocol,
ence on, pp. 239-242 (2008). Intel Corporation.
[5] Mayr, R. and Bauer, Q., Safety Issues in Intelligent [13] CAN in Automation (CiA), Controller Area Network
Cruise Control, Intelligent Transportation Systems, (CAN) - Protocol, http://www.can-cia.org/can/pro-
1999, Proceedings, 1999 IEEE/IEEJ/JSAI Interna- tocol/.
tional Conference on, pp. 970-975 (1999). [14] BOSCH, CAN Homepage, http://www.can.bosch.
[6] Hahn, S., Automation of Driving Functions-Future com.
Development, Benefits and Pitfalls, Intelligent Vehi-
cles Symposium, 1996, Proceedings of the 1996 IEEE,
pp. 309-312 (1999). Manuscript Received: Oct. 10, 2008
[7] Kim, M. H., Lee, Y. T. and Son, J., Age-Related Accepted: May 25, 2010

Vous aimerez peut-être aussi