International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395 -0056

Volume: 04 Issue: 05 | May -2017 www.irjet.net p-ISSN: 2395-0072

The Emotion Recognition Based On Facial Expression Play Music

Megheshwari Sanjay Lad, Ashwini Balkrishna Sontakke, Pooja Vankat Borule

1. Student of Computer Engineering, Dr. DY Patil School Of Engineering Lohegaon, Pune-47,Maharashtra, India.
2 Student of Computer Engineering, Dr. DY Patil School Of Engineering Lohegaon, Pune-47,Maharashtra, India.
3 Student of Computer Engineering, Dr. DY Patil School Of Engineering Lohegaon, Pune-47,Maharashtra, India.
Professor:-Mrs.Pankaj Agarkar, Dept. Computer Engineering Research scholar at JJTU,zhunzuno,Raj
---------------------------------------------------------------------***---------------------------------------------------------------------
Abstract - The study of facial expression with emotion
recognize and suggest the music.The main purpose of this
project is the recognize the human emotion depend on facial
expression and list of music based on the different emotion .
The study of emotion and music suggested , there is connection
between a emotion of persons and type of songs they listen to .
Two important approaches of expression recognition
template based and classifier based by using naive base
classifier also haar -cascade. The facial characterstic point
(FCP)easy to calculated by using template . Information is the
facial expression cognition field like mouth,eye,eyebrow this
sector are splitting from the facial expression image.

Key Words: facial characteristics point (FCP),feature

extraction,template,emotion recognition data
mining,naive base algorithm,haar cascade.

1.INTRODUCTION Fig :- Emotion Recognition System

Facial expression is indicates the mind of human.In
this paper study of facial expression detect the emotion
recognize and advise the music library.This images
processing using apply the input like capture image,video
and output is to keep of
happy,sadness,angry,disgust,surprise,neural.In the project
different technique are used to emotion recognization .After
words it species humans playlist depend the user emotion
two important categaries of program and capture the image
using web cam and detect the emotion of the person specify
the playlist which is based on that emotion . In this
developed application such a method that it can analysis the
propenties of image and determine the mood of user. Also
incorporate categories playlist of music based on mp3 which
is according to mood.
Emotion recognition is portion in to three
point;face detection, feature extraction and emotion
classification.One the face place has inflexible and face
extracted mangment moves onto extracting field of
interest,in special the eye,mouth,eyebrow.This state is
afterwords by a feature extraction state ,where to
individualize algorithm are used to resource multiple technic
.Their output are accessed and display after the testing and
evaluation.This extracted datum is blas to classifier which
decide the emotion of the persons.
A) Expression Recognition using template:-
Expression recognition is the process of extracting
eventful attribute which is help to segment of image into
other classes.Templates matching is state support by making
use of roll and inter course coefficient for the higher and
faultless matching.The wanted eyebrow,eye,mouth template
are stage transcript from the image and extracted output
which is selected rectangle from show in the fig.

2017, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal | Page 210
 International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395 -0056
Volume: 04 Issue: 05 | May -2017 www.irjet.net p-ISSN: 2395-0072

eye 2 right eye right eye/2 eye

Left 17 Length Template Left

eyebrow +width of +height of eyebrow
left left
eyebrow/2 eyebrow/3

Length Template
+width of +height of
Right 18 right right Right
eyebrow eyebrow/2 eyebrow/2 eyebrow

Length of Template
mouth +height of
Mouth 23 mouth /2 Mouth

C) Open CV:-

Open cv is stands for open source computer vision

library.Open cv library programming function is mainly used
on real time computer vision. It was used in languages
c,c++,java,python interface.It was mainly supported
operating system like windows,linux,mac operating
system,ios and android.Open cv can be used in our project
because it was mainly aimed at real time image processing.In
Fig:-Template images this open cv can be accelerated if intels integrated
performance primitives is installed on the our program.The
B)Extracting the facial characterstic points:-
open cv supply complex number of function for face
recognition and face detection .Open cv can be used in
The cropping rectangle form the matched template trainer and detector,if we want to train our own classifer for
used to conjecture the value of top left angle pixel from the any object like mobile,pen,we can used cv to create one.
rectangle in table 1 specified by using height and width of
template we enumerate all 30 fcp[10].These value of pixel is D)Haar-cascade :-
used to detect the facial enlivement attribute described
The haar cascade cross finding using haar feature based
s,opening of eye(oe),height of eyebrow(he),opening of
cascade classifiers is an effective object detection
mouth(om),width of eye(we),width of mouth(wm),task
method.Haar cascade is the machne learning bbased
explain the calculation of fcps.
request.In this request a cascade responcibility is trained
Register Fcp X- Y- Register from a lot of positive and negative image.Firstly we can used
number coordinate coordinate positive means image of faces and negative means images
without faces in train the classifer.Then next features can be
Length Template extracted.They are just like our roll of kernel.Every
+width of +height of conuntenance is a celibate value obtained by subtracting
Left eye 1 left eye left eye Left eye sum of pixels under white rectangle from sum of pixels
*4/5 under black rectangle.Haar cascade features shown in below
images can be used.
Length Template
+width of +height of
Right Right

2017, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal | Page 211
 International Research Journal of Engineering and Technology (IRJET)
Volume: 04 Issue: 05 | May -2017
Fig: common Haar feature
Now every bit workable sizes and
place of each kernel are used to compute amplitude of
feature.Simply among all these features we calculated most
of them are irrelevant.The basic feature selected seem to
focus on the possession that the ground of the eyes is again
and again darker than district of the nose and cheeks.The
second feature selected relies on belongs that the eyes are
darker than the bridge of the nose.Each and every feature on
all the education images is applied.The feature with quantity
incorrect percentage,which means they are the features that
pre-eminent classifies the face and non-face images are
selected.Once the user leave bored of choosing the songs
manually he could choose the squirm instead.The hesitance
here is that the song played randomly as a result of using the
wiggle button may not discount the current mood of the
user.The separate route is that the user needs to manually
classify songs in conformity with two separate types of
emotions which is hectic and can be clean rendered needless
by the work of this device/scheme.
Conclusion:-
The aim of this paper was to explore to sector of automatic
facial expression recognition based music player. Initiative
with the mental impulse for facial bearing analysis, this field
of science has been extensively studied in terms of instance
and automation. Manuscript face analysis used by
psychologists was fast replaced by suitable computer
software.Thus the instance developed volition reduce the
practice of user in creating and managing playlist.It will
supply better joy to the music listeners by providing the
wqemost suitable songs to the user in conformity with
2017, IRJET | Impact Factor value: 4.45 | ISO 9001:2008 Certified Journal
e-ISSN: 2395 -0056
www.irjet.net p-ISSN: 2395-0072
current emotion.It will not only contribute user but also the
songs are systematically sorted.
Refrences:-
[1]. Facial Expression Recognition Using Data Mining
Algorithm , Journal of Economics,
Business and Management, Vol. 1, No. 4, November 2013.
[2]. Emotion Based Music System International Journal of
Emerging Trends in Science and Technology,2016.
[3]. Emotion Based Music Player XBeats, International
Journal of Advanced Engineering Research and Science
(IJAERS) [Vol-3, Issue-9, Sept- 2016].
[4]. INTERNATIONAL JOURNAL OF INNOVATIVE RESEARCH
& DEVELOPMENT, March, 2014 Vol. 3 Issue 3.
[5]. Analysis of Emotion Recognition using Facial
Expressions, Speech and Multimodal Information2015 Vol. 3
Issue 3
[6]. IJCSN International Journal of Computer Science and
Network, Volume 5, Issue 6, December 2016, Facial
Expression Recognition Algorithm Based
On KNN Classifier.
[7]. International Journal of Emerging Technologies in
Computational and Applied Sciences (IJETCAS), December
2016.
[8]. IJRET: International Journal of Research in Engineering
and Technology eISSN: 2319-1163 | pISSN: 2321-7308
Volume: 05 Issue: 08 | Aug-2016, Available @
http://ijret.esatjournals.org 313.
[9]. International Journal of Engineering Research and
Applications (IJERA) ISSN: 2248-9622 www.ijera.com Vol. 2,
Issue 3, May-Jun 2012.
[10]. Object detection using Haar-cascade Classifier, Vol. 2,
Issue 3, May-Jun 2015.
| Page 212