FACIAL EMOTION

RECOGNITION
By:
Ankita Thakur
1PE08IS011
Archana Alva M
1PE08IS012
Melvin C Carvalho 1PE08IS053
Guide:
Dr. Gowri Srinivasa
Professor
PES School Of Engineering

Facial Emotion Recognition

Introduction
Facial expressions are the facial changes in
response to a persons
internal emotional states,
Intentions,
social communications.
Facial
Emotion
Recognition
System

INPUT

OUTPUT
Guided by: Dr. Gowri Srinivasa

Facial Emotion Recognition

Introduction

Fear

Surprise

Anger

Sadness

Happy

Disgust

Guided by: Dr. Gowri Srinivasa

Facial Emotion Recognition

Literature Survey
Face
Acquisition

Face
Detection

Head
Pose
Estimatio
n

Facial Data
Extraction
and
representatio
n

Feature
based

Appearan
ce based

Guided by: Dr. Gowri Srinivasa

Facial
Expression
Recognition

Frame
based

Sequenc
e based

Facial Emotion Recognition

Literature Survey
Face Detection method
Haar Classifiers
Finding faces by skin color
Feature based
Gabor wavelets
Feature based clustering
Appearance Based
Active Appearance Model
Classifiers
HMM
SVM
DBN

Guided by: Dr. Gowri Srinivasa

Facial Emotion Recognition

Existing System
Smile detection

Noldus Face Reader4

Guided By: Dr. Gowri Srinivsa

Facial Emotion Recognition

Switch on the camera

Proposed
system

Guided by: Dr. Gowri Srinivasa

Facial Emotion Recognition

Statement of Problem
Design and implement software system that detects facial
emotion for frontal faces

Guided by: Dr. Gowri Srinivasa

Facial Emotion Recognition

Functional Requirement

Face acquisition

Facial feature extraction for expression analysis

Facial expression recognition

Guided by: Dr. Gowri Srinivasa

Facial Emotion Recognition

Non- Function Requirement

1 Performance: The system should be able to detect
expressions for 2 to 3 individuals in a frame.

2. Reliability: The resultant of the application should be

accurate for at least two individuals when applied on three
individuals in a frame.

3. Timeliness: The time taken to detect faces present in one

frame and the expression should be within a reasonable
stipulated time.

Guided by: Dr. Gowri Srinivasa

Facial Emotion Recognition

Application
This can be widely used to understand emotions while
o Video chatting,
o create facial mobile applications,
o security concerns in public locations,
o user friendly interfaces
o e learning and distance education
o Multimodal human computer interface (HCI).

Guided by: Dr. Gowri Srinivasa

Facial Emotion Recognition

System
Architecture
faces detected

Capture
image

Display of
emotion for
each face

Feature
extraction

Classification

Guided By: Dr. Gowri Srinivasa

12

Data Flow Diagram

VIDEO

LEVEL 0

FACIAL
EMOTION
RECOGNITION
STSTEM

EMOTION
DETECTED

Facial Emotion Recognition

Data Flow Diagram

LEVEL 1

Guided by: Dr. Gowri Srinivasa

Data Flow
Diagram

Level 2

Facial Emotion Recognition

Stand in front of
webcam

Show proper
emotion

Emotion
detected

Guided by: Dr. Gowri Srinivasa

U
S
E
C
A
S
E

Activity Diagram

Guided by: Dr. Gowri Srinivasa

Facial Emotion Recognition

Guided by: Dr. Gowri Srinivasa

Facial Emotion Recognition

Operational Requirement
Hardware
requirement

Software
requirements :

o Processor : Intel
Pentium 4/AMD
Athlon 64 and
above
o RAM: atleast 512
MB and above
o Hard disk : 3 GB
free space and
above

o Operating system:
Windows XP and
later
o Platform : .NET 3.0
or later versions,
Aforge.NET,
Accord.NET
o Programming
Language: C#

Guided by: Dr. Gowri Srinivasa

References
Ko Kwang-Eun & Sim Kwee-Bo Development of facial
emotion recognition method based on AAM with DBN.IEEE
2010 International conference on Cyberworlds.
Hosseini Iraj, Shams Nasim , Amini Pooyan Mohammad S.
Sadri, Rahmaty Masih & Rahmaty Sara Facial Expression
Recognition using Wavelet-based Salient points and
Subspace Analysis Methods.IEEE May 2006.
A. Ghahari, Y. Rakhshani Fatmehsari & R.A. Zoroofi A Novel
Clustering-Based Feature Extraction Method for an
Automatic Facial Expression Analysis System.IEEE 2009.
Michel F. Valstar, Bihan Jiang, Marc Mehu, Maja Pantic, and
Klaus Scherer The First Facial Expression Recognition and
Analysis Challenge.IEEE conference on face and gesture
recognition 2011
http://www.face-rec.org/databases/
Guided by: Dr. Gowri Srinivasa

Facial Emotion Recognition

CONCLUSION
In computer vision, Facial Expression is classification of facial
features into six basic emotions fear, anger, happy, disgust,
sadness and surprise.
The camera will detect and capture multiple faces for each frame.
Specific features from the faces are extracted and classified
based on certain algorithms.
The appropriate emotion is detected and displayed at the position
of the each face in the frame.

Guided by: Dr. Gowri Srinivasa

Thank You