Académique Documents
Professionnel Documents
Culture Documents
Abstract— This paper introduces a Bayesian image segmentation histogram and the accuracy of the estimates of the model
algorithm based on finite mixtures. An EM algorithm is parameters. However, the model-based segmentation
developed to estimate parameters of the Gaussian mixtures. The algorithms not allows a good results if the histogram of an
finite mixture is a flexible and powerful probabilistic modeling image is a poor Gaussian approximation. The application of
tool. It can be used to provide a model-based clustering in the this model in image segmentation is, therefore, limited to the
field of pattern recognition. However, the application of finite images which are a good approximations of Gaussian mixtures
mixtures to image segmentation presents some difficulties; with well-defined modes.
especially it’s sensible to noise. In this paper we propose a variant
of this method which aims to resolve this problem. Our approach Among the techniques of classification, we used in this
proceeds by the characterization of pixels by two features: the work models of Gaussian mixtures. An EM algorithm is
first one describes the intrinsic properties of the pixel and the developed to estimate parameters of the Gaussian mixtures.
second characterizes the neighborhood of pixel. Then the The finite mixture is a flexible and powerful probabilistic
classification is made on the base on adaptive distance which modeling tool. It can be used to provide a model-based
privileges the one or the other features according to the spatial clustering in the field of pattern recognition. However, the
position of the pixel in the image. The obtained results have application of finite mixtures to image segmentation presents
shown a significant improvement of our approach compared to some difficulties; especially it’s sensible to noise. In this paper
the standard version of EM algorithm. we propose a variant of this method which aims to resolve this
Keywords- EM algorithm, image segmentation, adaptive distance
problem.
The remainder of the paper is organized as follows.
I. INTRODUCTION Section 2 describes the EM algorithm briefly and the
Image segmentation is one of the major challenges in parameter estimation of multi-variate normal densities by the
image processing and computer vision. When the problem of EM algorithm. In Section 3 an unsupervised segmentation
image segmentation is approached by a process of algorithm for grey level images is proposed on the basis of the
classification, several methods exist. Recently, finite mixture ML estimation. Section 4 presents experimental results to
models have attracted considerable interest for image show the performance of the proposed algorithm, and Section
segmentation [2,8,16,17]. However, the application of finite 5 concludes by summarizing the paper
mixtures model to image segmentation presents some
difficulties. For the classical mixture statistical model each II. SEGMENTATION METHOD BASED ON GMM-EM
pixel must be associated with exactly one class. This The expectation-maximization algorithm (in English
assumption may be not realistic. Thus, several methods have Expectation-maximization algorithm), proposed by Dempster
been proposed to circumvent this problem. For example, the [19], is a class of algorithms that find the maximum likelihood
fuzzy-c mean algorithm has widely been used in image parameters of probabilistic models where the model depends
segmentation. Also, some methods mixing fuzzy and on unobserved variables. The finite mixture of distributions
statistical model have been developed by Gath. Recently, the has provided a mathematical approach to the statistical
Markov Random Field (MRF) models were used with images modeling of a wide variety of random phenomena. In the past
in an important number of works to add spatial smoothness decades, the extent and the potential of the applications of
into the process of image segmentation [11,13,15]. This finite mixture models have widened considerably. In the field
approach provide satisfactory results in many case, but most of pattern recognition, the finite mixture can be used to
case the assumption of a single Gaussian distribution typically provide a model-based clustering. A finite mixture density has
limits image segmentation accuracy. The segmentation the form :
fx|θ = ∑
p f x|θ
algorithm developed in this paper is based on a parametric
model in which the probability density function of the gray
levels in the image is a mixture of Gaussian density functions. Where :
This model has received considerable attention in the o is the proportion of the class ( ≥
development of segmentation algorithms and it has been noted 0 and ∑ = 1
that the performance is influenced by the shape of the image
19 | P a g e
www.ijacsa.thesai.org
(IJACSA) International Journal of Advanced Computer Science and Applications,
Special Issue on Image Processing and Analysis
θ = μ , ∑, μ et ∑ are respectively the center and the The covariance matrices are initialized by the identity matrix,
variance matrix of kth normal component f. |α . and K mean vectors are initialized by the various centers of
Gaussian mixture estimated by the algorithm K-means.
The evaluation of all these parameters can be calculated by
maximizing the log-likelihood of the global parameter θ: Let's suppose that we have K components in the model of
ln fX|θ = ∑$!
ln f x! "θ#
mixtures. The shape of the density of probability of this
(1) mixture is given by :
Where X=(x1,…,xn), this maximization can be made by the 3
EM algorithm of Dempster. Besides, the k number of /0|1 = 2 / 0|1 3
components can also be estimated while keeping the value
between k=1 and k_sup (k_sup to choose a priori) that where x is the characteristic vector, is the weight of the
mixture as ∑3
= 1 , 1 represents the parameters
minimizes the Bayesian BIC criteria.
BICK = −2 ln f X"θ+ # + v ln n (2) , 5 , … , 3 , 1 , 15 , … , 13 and / the density of the gaussian
+
Where θ and v are respectively the maximum likelihood parameterized by 1 that is to say 7 , 8 :
estimator and the number of degrees of freedom model.
1 x − μ 5
Px|θ = exp =>− ? @ = 1,2, … , A >
2σ5
A. Classification
Any classification model is defined on the space N of maps :2πσ
20 | P a g e
www.ijacsa.thesai.org
(IJACSA) International Journal of Advanced Computer Science and Applications,
Special Issue on Image Processing and Analysis
Pixel to classify
Spatial
No feature Yes
Classification Classification
21 | P a g e
www.ijacsa.thesai.org
(IJACSA) International Journal of Advanced Computer Science and Applications,
Special Issue on Image Processing and Analysis
22 | P a g e
www.ijacsa.thesai.org
(IJACSA) International Journal of Advanced Computer Science and Applications,
Special Issue on Image Processing and Analysis
23 | P a g e
www.ijacsa.thesai.org
(IJACSA) International Journal of Advanced Computer Science and Applications,
Special Issue on Image Processing and Analysis
c) d)
VI. CONCLUSION
A segmentation algorithm for grey level images was
proposed. In the algorithm the image is considered as a
mixture of multi-variate
variate normal densities and
segmentation is carried out by the ML estimation based on
EM algorithm. It’s a new approach that we proposed of
pixels classification based on a dynamic and weighted
similarity distance. The main idea is to use a manner
conjoined and adaptive two attributes of classification:
level of gray of the pixels and a spatial
spa attribute (the local
average). The adaptation must privilege one or the other of
Figure 6 : a) original image b) Result of the standard EM c) Result of the DEM
d) Result of the ADEM (σ=40)
these attributes according to the spatial configuration of
the pixel to classify. The originality of our approach
Table I : Badly classified pixels number within contours and inside regions of resides in the manner with which is calculated these
MRI cerebral image weights
ghts and that take as a basis on a mechanism of fuzzy
inference. The new distance that we proposed thus
EM DEM ADEM permitted to get a new variant of the EM method that is
Region CSF 200 10 4 adapted more to the segmentation of images. It has been
GM 500 60 30 confirmed by the tests achieved on a cerebral
cer MRI image.
WM 15 5 0
Contour CSF 500 450 100
GM 1120 1100 190
WM 450 70 15
c) d)
Figure 8:: a) original image b) Result of the ADEM (σ =15) c) Result of the
ADEM (σ=40) d) Result of the ADEM (σ=70)
a)
b) REFERENCES
[1] Mohamed Walid Ayech, Karim El Kalti, Kalti Béchir el Ayeb: Image
Segmentation Based on Adaptive Fuzzy-C-Means
Fuzzy Clustering. ICPR 2010:
2306-2309
[2] L.Xu, M.I.Jordan, On Convergence Properties of the EM Algorithm for
Gaussian Mixture, Neural Computation, 8, 1996, pp. 129-151.
129
[3] J-C.
C. Bezdek, Pattern recognition with w fuzzy objective functions
algorithms, Plenum Press,, New York, 1981.
[4] T-N. Tran, R. Wehrens, L-M-C. Buydens, Clustering multispectral images:
a tutorial, Chemometric and intelligent laboratory systems,
systems pp. 211-218,
c) d) 2004.
Figure 7 : a) original image b) Result of the standard EM c) Result of the [5] P-W-T. Krooshof, T-N. Tran, G-J. J. Postma, Effects of including spatial
DEM d) Result of the ADEM (σ=40) information in clustering of multivariate image data, Trends in Analytical
Chemistry, Vol. 25, pp. 1067-1080,
1080, 2006.
On the other hand, experiments have shown that a value of [6] K-S.
S. Chuang, Fuzzy c means clustering with spatial information for image
sigma equal to 40 is quite sufficient for segmenting MRI segmentation, Elsevier Science,, Vol.30, pp. 9-15,
9 2006.
images (figure 8).
24 | P a g e
www.ijacsa.thesai.org
(IJACSA) International Journal of Advanced Computer Science and Applications,
Special Issue on Image Processing and Analysis
[7] Y-A. Tolias, S-M. Panas, On applying spatial constraints in fuzzy image Spatially Variant Finite Mixtures and the Generalized EM algorithm",
clustering using a fuzzy rule based system, IEEE Signal Processing IEEE trans. Image Processing, Vol. 7, No.7, pp1014-1028, 1998.
Letters, Vol.5, pp. 245-247, 1998. [17] R. A. Redner, H. F. Walker, Mixture densities, maximum vraisemblance
[8] GU D. B, SUN J.-X EM image segmentation algorithm based on an and the EM algorithm, SIAM Review, 26, pp195-239, 1984.
inhomogeneous hidden MRF model IEEE proceedings, Vision, image and [18] C.Biernacki, R.Mohr. Indexation et appariement d’images par modèle de
signal processing 2005, vol. 152, no2, pp. 184-190. mélang gaussien des couleurs. Institut National de Recherche en
[9] S-C. Chen, D-Q. Zhang, Robust image segmentation using FCM with Informatique et en Automatique, Rapport de recherche n_3600_Janvier
spatial constraints based in new kernel-induced distance measure, IEEE 2000.
Trans. Systems Man Cybernetics, Vol. 34, pp. 1907-1916, 2004. [19] A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood
[10] J. Kawa, E. Pietka, Image clustering with median and myriad spatial from in- complete data via the em algorithm. Journal of the Royal
constraint enhanced FCM, Springer-Verlag Berlin Heidelberg, Vol. 30, Statistical Society: Series B, 39(1):1–38, November 1977.
pp. 211-218, 2005. [20]Zhi Kai Huang, Unsupervised image segmentation using EM algorithm by
[11] D-J. Hemanth, D. Selvathi, J. Anitha, Effective fuzzy clustering histogram, Lecture Notes in Computer Science, 2007, Volume
algorithm for abnormal MR brain image segmentation, IEEE 4681/2007, 1275-1282, DOI: 10.1007/978-3-540-74171-8_130
International Advance Computing Conference, pp. 609-614, March 2009.
[12] S. Shen, Preprocessing and segmentation of brain magnetic resonance AUTHORS PROFILE
images, Proc of the 4th Annual IEEE Conference on Information Dr Mohamed Ali Mahjoub is an assistant professor in computer science at
Technology Application in Biomedicine, UK, pp.149-152, 2003. the Preparatory Institute of Engineering of Monastir. His research interests
[13] J. Wang, L. Dou, N. Che, D. Liu, B. Zhang, J. Kong, Local based fuzzy concern the areas of Bayesian Network, Computer Vision, Pattern
clustering for segmentation of MR brain images, IEEE International Recognition, HMM, and image retrieval. His main results have been published
Conference on Bioinformatics and Bioengineering, pp. 1-5, October in international journals and conferences.
2008.
[15] L. Zadeh, Fuzzy sets, Information and Control, Vol. 8, pp. 338-353, Dr Karim kalti is an assistant professor in the department of computer
1965. Archambeau C., Vrins F., Verleysen M. (2001), Flexible and science at the faculty of science of Monastir (Tunisia). His research interests
Robust Bayesian Classification by finite Mixture Models., Proceedings of concern the areas of Image processing, Pattern Recognition, Medical imaging
the ESANN’2004 congress. and Data Retrieval. His main results have been published in international
[16] S. Sanjay-Gopal and T. J. Hebert, Bayesian Pixel Classification Using journals and conferences.
25 | P a g e
www.ijacsa.thesai.org