IMAGE PROCESSING

FEATURE BASED EIGENFACE

METHOD FOR FACIAL RECOGNITION

By,
L.Sriram,
J.Pradeep Kumar,
Department of CSE,
Kongu Engineering College,
Perundurai,
Erode.

E-Mail id:
srirambecse@gmail.com
romantikdual@gmail.com

1
 ABSTRACT

Digital image processing techniques visually enhances and statistically

evaluates some aspect of an image not readily apparent in its original form. Face is the
index of the mind, so the recognition of face is an important aspect in various fields.
In this paper we discuss about the feature based recognition and eigenface method for
facial analysis. In feature based facial recognition method the importance is given to
the facial features (eyes, nose, eyebrows, etc.,), whereas the eigenface method gives
preference to the face. By combining both the above methods we obtain “Feature
Based Eigenface Method” for facial recognition, due to its superiority in its near real
time speed and reasonably simple implementation. Using the feature based eigenface
method we can develop a better facial recognition systems for Humanoid robots and
for crime investigation.

2
 defined as a two
dimensional function,
f(x,y), where x and y are
INTRODUCTION
spatial coordinates and
With
amplitude of f at any pair
the advent of
of coordinates (x,y) is
sophisticated computers,
called the intensity or
digital imaging
gray level of the image at
technology has gained
that point. The 2D
increasing importance in
continuous image f(x,y)
every field. Digital
is divided into N rows
image processing stems
and M columns. The
from two principal
intersection of a row and
application areas:
a column is termed a
improvement of pictorial
pixel.
information for human
interpretation and
OPERATIONS
processing of image data
INVOLVED IN
for storage, transmission
and representation for IMAGE

autonomous machine PROCESSING

perception. The objective Image processing

of digital image operations can be

processing techniques is roughly divided into four

to visually enhance or major categories, Image

statistically evaluate Acquisition, Image

some aspect of an image Compression, Image

not readily apparent in its Enhancement and

original form. Restoration, and Image

Feature Extraction.

A digital image
whose amplitudes are Image

finite and discrete Acquisition is the entry

quantities, may be point of the image

3
recognition process. It is take advantage of some
the module where the psychophysical aspect of
image under the human visual system.
consideration is
Image
presented to the system.
Restoration is
An acquisition module
remodeling an image for
can request a image from
some degradation by
several different
applying inverse
environments.
processes to undo some
known phenomenon in
The process of
order to recover the
image acquisition
original image. Image
frequently leads
restoration is a cognitive
(inadvertently) to image
estimation process in
degradation. Due to
which operations are
mechanical problems,
performed on an
out-of-focus blur,
observed or measured
motion, inappropriate
field to estimate the ideal
illumination and noise
image that would be
the quality of the
observed if no
digitized image can be
degradations were
inferior to the original.
present in the imaging
system. The aim of
Image
image restoration is to
enhancement operations
bring the image towards
are processing
what it would have been
techniques that serve to
if it had been recorded
enhance or in some way
without degradation.
alter the qualities of an
image. Enhancement is
Image
basically a heuristic
compression is a
procedure designed to
technique wherein,
manipulate an image to
image containing

4
tremendous amount of human face serves as a
redundant information, provider of a number of
can be run through social signals essential
algorithms that reduce for interpersonal
the number of bits communication in our
needed to represent social life. Personality,
them. Image gender, attractiveness
compression is the and age can be seen from
natural technology for someone's face. The face
handling the increased is the mean to identify
spatial resolution of other members of the
today’s imaging sensors species, to regulate the
and evolving broadcast conversation by the
television standards. means of gazing or
nodding, to interpret
Image feature what has been said by the
extraction basically means of lip-reading, and
deals with extraction of to understand
sub-components (called somebody's emotional
features) in a given state and intentions on
image. This feature the basis of the shown
extraction provides some facial expression.
quantitative information
which is necessary for Face recognition
differentiating one class is a pattern recognition
of objects from another. task performed
specifically on faces. It
NEED FOR FACIAL can be described as
RECOGNITION classifying a face either

The human "known" or "unknown",

face is involved in an after comparing it with

impressive variety of stored known

different activities. The individuals. It is

5
desirable to have a presented to the system.
system that has the An acquisition module
ability of learning to can request a face image
recognize unknown from several different
faces. environments. Image
acquisition module
GENERALIZED consists of an electronic

MODEL OF A camera equipped with

CCD sensors.
FACIAL
RECOGNITION
Pre-processing module:
SYSTEM
By means of early vision
The various
techniques, face images
blocks of a generalized
are normalized and if
model of a facial
desired, they are
recognition system is
enhanced to improve the
given below & its
recognition performance
components are
of the system. Some or
explained.
all of the following pre-
processing steps may be
implemented in a face
recognition system:
 Image
size
normaliza
tion
 Histogram
Acquisition module: equalizati
This is the entry point of on ,
the face recognition illuminati
process. It is the module on
where the face image normaliza
under consideration is tion

6
  Median database). After doing
filtering this comparison, face
 High-pass image is classified as
filtering either known or

 Backgrou unknown.

nd
removal Training set: Training

 Translatio sets are used during the

nal and "learning phase" of the

rotational face recognition process.

normaliza The feature extraction

tions and the classification

modules adjust their

Feature extraction parameters in order to

module: After achieve optimum

performing some pre- recognition performance

processing (if necessary), by making use of

the normalized face training sets.

image is presented to the

feature extraction Face library or face

module in order to find database: After being

the key features that are classified as "unknown",

going to be used for face images can be added

classification. to a library (or to a

database) with their

Classification module: feature vectors for later

In this module, with the comparisons. The

help of a pattern classification module

classifier, extracted makes direct use of the

features of the face face library.

image is compared with

the ones stored in a face TWO MAJOR
library (or face APPROACHES TO

7
FACE  Second-order
RECOGNITION features values:
Feature Based Face Another
Recognition which is configurable set of
based on the extraction features which
of the properties of characterize the
individual organs located spatial relationships
on a face such as eyes, between the
nose and mouth, as well positions of the first-
as their relationships order features and
with each other. information about
Effective features that the shape of the face
can be used in feature are called second-
based face recognition order features.
can be classified as For different
follows: facial contours, different
models should be utilized

 First-order features to extract them from the

values: Discrete original portrait. Because

features such as the shapes of eyes and

eyes, eyebrows, mouth are similar to

mouth, chin, and some geometric figures,

nose, which have they can be extracted in

been found to be terms of the deformable

important in face template model.

identification and are The other facial

specified without features such as

reference to other eyebrows, nose and face

facial features, are are so variable that they

called first-order have to be extracted by

features. the active contour

model. These two

8
models can be illustrated relies upon non-
in the following: deformable features
like face, eyebrows
 Deformable and nose. Without
template model: these features the
The deformable face recognition
templates are becomes a complex
specified by a set of job. These features
parameters which provide a finalized
uses a prior output when the
knowledge about the deformable features
expected shape of are completely
the features to guide specified.
the contour
deformation process. PRINCIPAL
The templates are COMPONENT
flexible enough to ANALYSIS (PCA)
change their size and It is based on
other parameter information theory
values, so as to concepts, seek a
match themselves to computational model that
the data. The final best describes a face, by
values of these extracting the most
parameters can be relevant information
used to describe the contained in that face
features. This without dealing with the
method works well individual properties of
regardless of facial organs such as
variations in scale, eyes or mouth.
tilt, and rotations. The jobs which
PCA can do are
 Active contour prediction, redundancy
model: It basically removal, feature

9
extraction, data subspace spanned by the
compression, etc. PCA eigenfaces and then
utilizes eigenvectors for classifying the face by
facial recognition. comparing its position in
face space with the
FACE positions of known
RECOGNITION individuals.
USING EIGENFACES
Eigenfaces Calculating Eigenfaces
approach is a principal Let a face image I(x, y)
component analysis be a two-dimensional N
method, in which a small x N array of 8-bit
set of characteristic intensity values. An
pictures are used to image may also be
describe the variation considered as a vector of
between face images. dimension N2, so that a
Goal is to find out the typical image of size 256
eigenvectors (eigenfaces) x 256 becomes a vector
of the covariance matrix of dimension 65,536, or
of the distribution, equivalently a point in
spanned by a training set 65,536-dimensional
of face images. Later, space. An ensemble of
every face image is images, then, maps to a
represented by a linear collection of points in
combination of these this huge space. Images
eigenvectors. Evaluation of faces, being similar in
of these eigenvectors is overall configuration,
quite difficult for typical will not be randomly
image sizes but, an distributed in this huge
approximation can be image space and thus can
made. Recognition is be described by a
performed by projecting relatively low
a new image into the dimensional subspace.

10
The main idea of the which best describes the
principal component distribution of the data.
analysis is to find the The kth vector, uk, is
vectors that best account chosen such that
for the distribution of
face images within the
entire image space.
These vectors define the
subspace of face images,
which we call "face is a maximum, subject to

space". Each vector is of

length N2, describes an N
x N image, and is a linear
combination of the
original face images.
The vectors uk and
Let the training set of scalars λk are the
face images be Г1, Г2… eigenvectors and
Гm then the average of eigenvalues, respectively
the set is defined by of the covariance matrix

Each face differs from

where the matrix
the average by the vector
A=[φ 1,φ 2,…φ m] The
covariance matrix C,
however is N2XN2 real
This set of very
symmetric matrix, and
large vectors is then
determining the N2
subject to principal
eigenvectors and
component analysis,
eigenvalues is an
which seeks a set of M
intractable task for
orthonormal vectors, un,

11
typical image sizes. We Premultiplying both
need a computationally sides by A, we have
feasible method to find
these eigenvectors.
If the number of
data points in the image
from which we see that
space is less than the
Avi are the eigenvectors
dimension of the space
of C=AAT Following
(M<N2), there will be
these analysis, we
only M-1, rather than
construct the M x M
N2 , meaningful
matrix L=ATA, where
eigenvectors. The
Lmn=φ T
m φ n , and find
remaining eigenvectors
the M eigenvectors Vl, of
will have associated
L. These vectors
eigenvalues of zero. We
determine linear
can solve for the N2
combinations of the M
dimensional eigenvectors
training set face images
in this case by first
to form the eigenfaces
solving the eigenvectors
Ul.
of an M x M matrix such
as solving 16 x 16 matrix
rather than a 16,384 x
16,384 matrix and then,
taking appropriate linear
combinations of the face
images φ i. Using Eigenfaces to
Consider the Classify a Face Image
T
eigenvectors Vi of A A A new face image (Г) is
such that transformed into its
eigenface components
(projected onto "face
space") by a simple
operation,

12
 classes, if any, best
describes the face.

for k = 1,...,M. This

describes a set of point
by point image
multiplications and
summations, operations
performed at
approximately frame rate
on current image
processing hardware,
with a computational
complexity of O(N4 ).
The weights form a
feature vector,
A) Person’s face
B) Eigenfaces obtained
by manipulation

that describes the

Rebuilding a Face
contribution of each
Image with Eigenfaces:
eigenface in representing
A face image can
the input face image,
be approximately
treating the eigenfaces as
reconstructed (rebuilt) by
a basis set for face
using its feature vector
images. The feature
and the eigenfaces as
vector is then used in a
standard pattern
recognition algorithm to
find which of a number
of predefined face

13
Where, those features in the face.
The face is expressed in
the face space by its
eigenface coefficients (or
weights). We can handle
a large input vector,
is the projected image. facial image, only by
We see that the face taking its small weight
image under vector in the face space.
consideration is rebuilt This means that we can
just by adding each reconstruct the original
eigenface with a face with some error,
contribution of wi to the since the dimensionality
average of the training of the image space is
set images. much larger than that of
PCA computes face space. Each face in
the basis of a space the training set is
which is represented by transformed into the face
its training vectors. space and its components
These basis vectors, are stored in memory.
actually eigenvectors, The face space has to be
computed by PCA are in populated with these
the direction of the known faces. An input
largest variance of the face is given to the
training vectors, we call system, and then it is
them eigenfaces. Each projected onto the face
eigenface can be viewed space. Since a face is
a feature. When a well represented by the
particular face is face space, its
projected onto the face reconstruction is similar
space, its vector into the to the original; hence the
face space describes the reconstruction error will
importance of each of be small.

14
 feature vectors are
formed.
ADVANTAGES:
Face background:

Speed and simplicity: Eigenfaces approach is

Eigenfaces approach is very sensitive to face

superior in its near real background, in case

time speed and feature vectors are

reasonably simple obtained by image

implementation, where additions and

as feature based face multiplications. Feature

recognition involves based face recognition

complex computations algorithms are less

such as deformable sensitive to face

templates and active background due to the

contour models. localization of facial

contours by deformable

Learning capability: templates.

Feature based face

recognition systems are
generally trained to Presence of small

optimize their parameters details: Feature based

in a supervised manner. face recognition

In the eigenfaces algorithms can suffer

approach, training is when some details are

done in an unsupervised present on the face image

manner. User selects a such as dark glasses or

training set that beards. For a feature

represents the rest of the based face recognition

face images. Eigenfaces system, it is quite

are obtained from the impossible to extract the

training set members and features that are related

to the eyes when dark

15
glasses are present on the combination of machine
face. Eigenfaces tool technology,
approach excels in this electronics and computer
aspect of face science. With the advent
recognition. Small of science and
changes in face images technology, robot finds
such as glasses, beards or its place in each and
mustaches does not cause every field. Robots
a decrease in the face called humanoids, having
recognition performance features of that of
because the information humans are being created
that is present in the rest now a day. For robots to
of the face image makes recognize face, a facial
it enough to be classified recognition system is
correctly. needed. We can
implement the face
The recognition module using
disadvantages of the feature based
feature based face eigenface technique
recognition can be because it is widely
overcome by combining implemented and well
feature based approach known for its simplicity
(eigeneyes, eigenmouth) and computational
and eigenface method, efficiency. The simple
called as Feature Based implementation of
Eigenface Recognition. robotic facial recognition
system is shown below
APPLICATIONS:

In Robotics:
Robotics
is an applied engineering
science that refers to as

16
 number of social signals
In crime investigation: essential for
In present interpersonal
situation, the number of communication in our
crimes committed per social life. Personality,
year is increasing gender, attractiveness
tremendously. It is and age can be seen from
necessary to have a someone's face. This
check over this crime insists the need for face
rates. Most of the crimes recognition. Feature
are committed by based eigenface method
changing one’s identity, provides a better
i.e., by changing facial alternative to existing
features (like eyebrows, methods. Feature based
mustache etc.,). The eigenfaces approach
crime investigation excels in its speed and
organizations can utilize simplicity and delivers
the advantages of feature good recognition
based eigenface performances under
recognition technique to controlled conditions.
check the crimes. This Training is done in an
can be achieved by unsupervised manner. In
maintaining a database of this paper we have
criminals, and by specified the importance
comparing (after of face recognition using
eigenface manipulation) eigenvectors and we
the image of the culprit have highlighted the
with the existing images applications involving
in the database. feature based eigenface
approach, viz., robotics
CONCLUSION: and crime investigation.
The human face
serves as a provider of a

17
 by
BIBLIOGRAPHY Ian.T.Young
 “Digital et al.
Image  “Digital
Processing” Image
by Gonzalez Processin
& Woods. g” by
 “Digital Castleman
Image .K.R.
Processing”  “Face
by Recogniti
William.K.Pr on using
att. Eigenface
 “Fundame s”-IEEE
ntals of Image transactio
Processing” ns.

18