Face Recognition Using

Neural Networks


Bhavin Pandya EM2007066
Siddhesh Panderkar EM2006044
Gaurav Hansda EM2006022
Hardeepsinh Jadeja EM2006023

Guided By : Prof Hemant Kasturiwale
What is Face Recognition?
A face recognition system is a computer application for automatically
identifying or verifying a person from a digital image or a video frame
from a video source. One of the ways to do this is by comparing selected
facial features from the image and a facial database.

Feature to be compared for face recognition:
1. Inter-ocular distance
2. distance between the lips and the nose
3. distance between the nose tip and the eyes
4. distance between the lips and the line joining the two eyes
5. eccentricity of the face
6. ratio of the dimensions of the bounding box of the face
7. width of the lips

What are Neural Network?
A Neural Network is a system of programs and data structures
that approximates the operation of the human brain.
A neural network usually involves a large number of
processors operating in parallel, each with its own small
sphere of knowledge and access to data in its local memory.
Typically, a neural network is initially "trained" or fed large
amounts of data and rules about data relationships (for
example, "A grandfather is older than a person's father").
A program can then tell the network how to behave in
response to an external stimulus or can initiate activity on its
own.

MODEL OF NEURON

Neural Network Architecture
Single layer feed forward network.

Multilayer Feedforward Network
Back-Propagation
Self Organizing Map(Unsupervised Learning)

Recurrent Network


Single layer feedforward
network
Multilayer Feedforward
Network
Recurrent Networks
Learning Algorithms
Supervised learning

Unsupervised learning

Reinforcement Learning
Approaches to Feature Extraction
Appearance Based
Feature Based (Component Based)
Appearance Based Methods
Principle Component Analysis
Linear Discriminant Analysis
Block Diagram of Different
Training Methods

PCA based Face Recognition
PCA
14
Disadvantages of PCA
Problems with Eigenfaces (PCA)
Different illumination
Different alignment
Different facial expression
Block Diagram of LDA-NN Face
Recognition System
Steps For Face Recognition Using
LDA-NN
Assumptions
Square images with W=H=N
M is the number of images in the
database
P is the number of persons in the
database

Algorithm For LDA-NN Face
Recognition.
The database

We compute the average of all faces

Compute the average face of each person

And subtract them from the training faces
We build scatter matrices S1, S2, S3, S4

And the within-class scatter matrix SW

From this scatter matrix we calculate the Fisher
face vectors.

Fisherfaces, the algorithm
The database
2
1
2
N
b
b
b
| |
|
|
=
|
|
|
\ .
2
1
2
N
c
c
c
| |
|
|
=
|
|
|
\ .
2
1
2
N
d
d
d
| |
|
|
=
|
|
|
\ .
2
1
2
N
e
e
e
| |
|
|
=
|
|
|
\ .
2
1
2
N
a
a
a
| |
|
|
=
|
|
|
\ .
2
1
2
N
f
f
f
| |
|
|
=
|
|
|
\ .
2
1
2
N
g
g
g
| |
|
|
=
|
|
|
\ .
2
1
2
N
h
h
h
| |
|
|
=
|
|
|
\ .
Fisherfaces, the algorithm
We compute the average of all faces





2 2 2
1 1 1
2 2 2
1
, 8
N N N
a b h
a b h
m where M
M
a b h
+ + +
| |
|
+ + +
|
= =
|
|
|
+ + +
\ .
Fisherfaces, the algorithm
Compute the average face of each
person
2 2 2 2
2 2 2 2
1 1 1 1
2 2 2 2
1 1 1 1
2 2 2 2
1 1
, ,
2 2
1 1
,
2 2
N N N N
N N N N
a b c d
a b c d
x y
a b c d
e f g h
e f g h
z w
e f g h
+ +
| | | |
| |
+ +
| |
= =
| |
| |
| |
+ +
\ . \ .
+ +
| | | |
| |
+ +
| |
= =
| |
| |
| |
+ +
\ . \ .
Fisherfaces, the algorithm
And subtract them from the training
faces
2 2 2 2 2 2 2 2
2 2
1 1 1 1 1 1 1 1
2 2 2 2 2 2 2 2
1 1 1 1
2 2
, , , ,
,
m m m m
N N N N N N N N
m m
N N
a x b x c y d y
a x b x c y d y
a b c d
a x b x c y d y
e z f z
e z f
e f
e z

| | | | | | | |
| | | |

| | | |
= = = =
| | | |
| | | |
| | | |

\ . \ . \ . \ .

| |
|

|
= =
|
|
|

\ .
2 2 2 2 2 2
1 1 1 1
2 2 2 2 2 2
, ,
m m
N N N N N N
g w h w
z g w h w
g h
f z g w h w

| | | | | |
| | |

| | |
= =
| | |
| | |
| | |

\ . \ . \ .
Fisherfaces, the algorithm
We build scatter matrices S
1
, S
2
, S
3
,
S
4





And the within-class scatter matrix
S
W
( ) ( )
( ) ( )
1 2
3 4
, ,
,
m m m m m m m m
m m m m m m m m
S a a b b S c c d d
S e e f f S g g h h
T T T T
T T T T
= + = +
= + = +
1 2 3 4 W
S S S S S = + + +
How is Face Recognition using LDA-NN performed
25
Advantages of LDA-NN
Faster than Eigen faces
Has lower error rates
Works well even if different illumination
Works well even if different facial expressions.
Works well with different allignment.

26
Comparison
FERET database








Best Identification rate: eigenfaces(or PCA)
80.0%, fisherfaces(or LDA) 93.2%
Comparison of Different Methods
of Face Recognition

PROJECT OBJECTIVE


To implement the concept of Neural Networks for the purpose
of Face Recognition.
Further Recognition of unclear images by removing the
background noise.
To improve the accuracy of Face recognition by reducing the
number of false rejection and false acceptance errors.
To use Face Thermogram that is output of an infrared camera
to detect the faces in dark environments.
Recognition of images captured while in motion.
Recognition of faces in videos (motion picture).

Advantages
When an element (Artificial neuron) of the neural network
fails, it can continue without any problem by their parallel
nature.

A neural network learns and does not need to be
reprogrammed.

It can be implemented in any application.

If there is plenty of data and the problem is poorly understood
to derive an approximate model, then neural network
technology is a good choice.

Advantages (contd..)
There is no need to assume an underlying data distribution
such as usually is done in statistical modeling.

Neural networks are applicable to multivariate non-linear
problems.

The transformations of the variables are automated in the
computational process.

A neural network can perform tasks that a linear program can
not.


31
Applications of Face
Recognition
Passport control at terminals in airports
Participant identification in meetings
System access control
Scanning for criminal persons

Thank you