National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALISATION

BY

LOPAMUDRA MOHAPATRA (200199200)

LOPAMUDRA CS200199200 1

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

INTRODUCTION
What is blink detection?
What is eye tracking? What is localization of eye?

LOPAMUDRA CS200199200

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

WHY WE GO FOR EYE LOCALIZATION

Face normalization Eye gaze based human computer interface.

For reading detection.

Security systems using the human iris for identification.

LOPAMUDRA CS200199200

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

PROPOSED PROTOCOL
WHOLE METHOD
THRESHHOLDING FRAMEDIFFERENCING EYE LOCALIZATION EYETRACKING
4

LOPAMUDRA CS200199200

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

THRESH HOLDING

LOPAMUDRA CS200199200

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

FRAME DIFFERENCING

LOPAMUDRA CS200199200

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

FRAME DIFFERENCING

LOPAMUDRA CS200199200

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

ALGORITHMS
Steps in the blink detection (1) Obtain location of possible motion using Frame differencing. (2) Suitably thresh hold the motion regions and obtain blobs using morphological operation and connected components.

LOPAMUDRA CS200199200

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

ALGORITHM CONTD...
(3) Remove unsuitable blobs that is either too big or too small or have incorrect width to height ratios to be considered as eyes. (4) Repeat (1) to (3) until a suitable pair of blobs are found and mark their positions. (5) Compute optical flow field in the blob regions (6)Mark dominant direction of motion of blobs.
LOPAMUDRA CS200199200 9

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

Algorithm contd..
If the dominant motion is downward in a pair of blobs
their positions are noted.These would represent eye closure during a blink. If the motion is not downward then steps (1) to (6) are repeated. (7) Repeat steps (1) to (6).

(8)Discard blobs that are not suited near the location of the blobs found with downward motion.
LOPAMUDRA CS200199200 10

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

Algorithm contd
(8) Compute optical flow to ascertain if the dominant

motion is upward with two ball remaining or repeat from step (7).
(9) If the dominant motion is upward, then classify the frame beginning from the frame where downward motion was detected to the frame where upward motion was detected as blink frames. If after downward motion no upward motion is detected upto 3 frames it is considered as no blinks. Process of blink detection is started from newframe.
LOPAMUDRA CS200199200 11

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

(10) The bounding boxes of the blobs where blink is deemed to have occurred is taken as eye detection. OPTICAL FLOW METHOD: It allows for the differentiation between vertical eyelid movements during blinks and movement of eyeball and horizotal head movements. EYE TRACKING : After the location of eyes tracking is done by using KLT tracker.
LOPAMUDRA CS200199200 12

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

EYETRACKING
In eye tracking mainly there are 20 feature points are taken,which gives the more accuracy.

* These feature pts are taken from the eye area and they are tracked in different places,and reinitialization is done.

LOPAMUDRA CS200199200

13

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

Results of eye tracking

(a) eye region initialized (b) tracked eye regions to a movement just before blink.
14

LOPAMUDRA CS200199200

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

COMPUTATION SPEEDUP
To speed up localization we need to speed up in

- Optical Flow
- Eye tracking.

EXPERIMENTAL RESULT :
(1) Optical flow: 10 sec (2) Tracking of eyes : 10 sec (3) reading image from disk: 13 sec
LOPAMUDRA CS200199200 15

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

CONCLUSION
In this paper we have proposed an accurate and fast method for locating and tracking the eyes of a computer user situated in front of the monitor. By computing optical flow and using both the magnitude and direction of the flow vectors, we can differentiate blinking from the other motions. In this way our study completed.

LOPAMUDRA CS200199200

16

National institute of science & technology

BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION

THANK YOU!!!

LOPAMUDRA CS200199200

17