IS J AA

International Journal of Systems , Algorithms & Applications

Performance Assessment of Feature Based Image Retrieval using Neural Networks

Dr. M.Seetha, 2G. Malini Devi, 3Dr. K.V.N.Sunitha Professor, Dept.of CSE, GNITS,Hyderabad-8,INDIA, 2 Asst.Professor, Dept.of CSE, GNITS,Hyderabad-8,INDIA 3 Head and Professor, Dept. of CSE, GNITS,Hyderabad-8,INDIA e-mail: smaddala2000@yahoo.com1, malini_g12@yahoo.co.in2, k.v.n.sunitha@gmail.com3
1

Abstract- Satellite image classification plays an important role in remote sensing, where information of an object or phenomenon is acquired from real time sensing devices, such as satellites and spacecrafts. In satellite image classification, the goal is to correctly classify vegetation, agriculture, water bodies, urban and open areas. In this paper a neural network is trained using supervised learning algorithm with Feed forward Back Propagation to perform Feature-based classification, which reduces the misclassifications that occur in pixel based classification. In this, Indian Remote Sensing (IRS)-1D Linear Image Self Scanning (LISS) III satellite images are classified by extracting features like mean, standard deviation, energy, entropy, skewness and kurtosis. Feature-based image retrieval method retrieves images from a database that are close to the given input image based on certain spatial features of the image. This paper emphasizes when satellite image is given to the Feature-based image retrieval module, it retrieves the closest images to the given input image while demonstrating the feature values, precision and recall. An experimental comparison of these approaches together with other considerations has made the Feature based image retrieval to have better accuracy when compared to neural networks. Keywords: Image classification, neural networks, remote sensing, spatial data, classification accuracy.

ment of large image databases for a variety of applications have now become realizable. Databases of art works, satellite and medical imagery have been attracting more and more users in various professional fields, for like, geography, medicine, architecture, advertising, design, fashion, and publishing. Effectively and efficiently accessing desired images from large and varied image databases is now a necessity. Feature-based Image Retrieval is the retrieval of images based on spatial features of the image such as mean, standard deviation, skew-ness, kurtosis, energy and entropy. Reasons for its development are that in many large image databases, traditional methods of image indexing have proven to be insufficient, laborious, and extremely time consuming. These old methods of image indexing, ranging from storing an image in the database and associating it with a keyword or number, to associating it with a categorized description, have become obsolete. Today, there are several algorithms and software existing for performing image searches. But, NN is the option left unexplored. This paper attempts to perform image retrieval using NN. II. FEATURE EXTRACTION The basic of all image features is some measure of image amplitude in terms of luminance, spectral value, or other units. One of the simple ways to extract statistical features in an image is to use the first-order probability distribution of the amplitude of the quantized image. They are generally easy to compute and largely heuristic [2]. The first order histogram estimate of P (b) is simply P (b) = N (b)/M Where b is a gray level in an image, M represents the total number of pixels in a neighborhood window of specified size located around the pixel, and N (b) is the number of pixels of gray value b in the window where 0 b L 1 A. Mean The mean, indicated by (a lower case Greek mu), is the statistician's jargon for the average gray-level of image or each region.

I. INTRODUCTION Data collection using Satellite Remote Sensing offers a variety of advantages compared to other forms of data acquisition, making it possible to measure energy (such as ultra-violet, infrared and microwave) at wavelengths that cannot be reached by human vision. It involves gathering information about the earth's surface using satellites orbiting around the earth. Through this, scientific advancements have resulted in a variety of discipline such as agriculture, forestry, hydrology, geology, cartography and meteorology. Satellite image classification is used to specify the vegetation, agriculture, water bodies, open area and urban lands present in a satellite image, which is used for crop acreage, groundwater identification, disaster management, etc. This paper emphasizes when satellite image is given to the Feature-based image retrieval module, it retrieves the closest images to the given input image while demonstrating the feature values, precision and recall. An experimental comparison of these approaches together with other consideration have made the feature based image retrieval to have better accuracy compared to neural networks [1]. As processors become increasingly powerful, and memories become increasingly cheaper, the deploy-

Volume 2, Issue ICTM 2011, February 2012, ISSN Online: 2277-2677 ICTM 2011|June 8-9,2011|Hyderabad|India

PERFORMANCE ASSESSMENT OF FEATURE BASED IMAGE RETRIEVAL USING NEURAL NETWORKS

IS J AA

International Journal of Systems , Algorithms & Applications

S M = b = bP (b)
b =0

L 1

distribution have kurtosis greater than 3. Distributions that are less outlier-prone have kurtosis less than 3. Kurtosis is the fourth moment about the mean. A normal distribution is a mesokurtic distribution [6]. A pure leptokurtic distribution has a higher peak than the normal distribution and has heavier tails. A pure platykurtic distribution has a lower peak than a normal distribution and lighter tails (figure 2).

Mean is used to measure the average intensity of an image. B. Standard Deviation Standard Deviation is a measure of gray-level contrast. The standard deviation is similar to the average deviation, except the averaging is done with power instead of amplitude. Standard Deviation is the second moment about the mean.

S D = b = [ ( b b) P(b)]1/ 2
b=0

L 1

This feature is used to measure the average contrast of an image. C .Skew-ness To get information on the shape of the distribution of intensity values within a window, the skew-ness and kurtosis are determined. Skew-ness is a measure of the asymmetry of the probability distribution of a real-valued random variable. It is the third moment about the mean. Skew-ness characterizes the degree of asymmetry of the intensity distribution around the mean intensity. If skew-ness is negative, the data spread out more to the left of the mean than to the right. If skew-ness is positive, the data are spread out more to the right. A positively skewed distribution has a "tail" which is pulled in the positive direction. A negatively skewed distribution has a "tail" which is pulled in the negative direction (figure 1).

Figure 2: Forms of Kurtosis

Most departures from normality display combinations of both skew-ness and kurtosis differ from a normal distribution. The kurtosis is defined as

SK =

b4

(b b) P(b) 3
b =0

L 1

E. Energy Energy is a feature for measuring the uniformity of an image. Energy is maximum for an image in which all graylevels are equal (maximally uniform).

S E = P (b) log 2 {P (b)}

b =0

L 1

This feature is a common concept in many fields, mainly in signal processing. F .Entropy Entropy is a feature for measuring disorder-ness of intensity distribution. Entropy is a measure of variability and zero for a constant image. The formula that can be used to calculate entropy is

Figure 1: Distribution of Skew

The skew-ness is defined as

SK =

(b b) P(b)
b =0

L 1

S N = [ P (b)]2
b=0

L 1

D. Kurtosis Kurtosis is the degree of peaked-ness of a distribution. That is, it measures the relative peaked-ness or flatness of the intensity distribution relative to the normal distribution. The kurtosis of the normal distribution is 3. Distributions that are more outlier-prone than the normal
Volume 2, Issue ICTM 2011, February 2012, ISSN Online: 2277-2677 ICTM 2011|June 8-9,2011|Hyderabad|India

This feature is useful to examine the power content (repeated transitions) in a certain frequency band. Procedure Feature based image retrieval involves the following steps:
5

PERFORMANCE ASSESSMENT OF FEATURE BASED IMAGE RETRIEVAL USING NEURAL NETWORKS

IS J AA

International Journal of Systems , Algorithms & Applications

Feature Extraction: The first step in the process is extracting features of a set of images to a distinguishable extent. Training: Design and train NN with the extracted features [7]. Testing: Test the trained network with new input images. In this process, first extract the features of the given input image and simulate the network with these features. Repeat the process of simulation for the given input image for a certain number of iterations to get various network outputs. These outcomes are later used to retrieve the close images from a database of images. The network performance can be further improved by increasing the training set.

tion of these features should be used instead of using a single feature for image retrieval. The retrieval efficiency and timing performance can be further increased if the image collection is trained (pre-processed) and grouped using supervised learning such as classification or unsupervised learning such as clustering. With that, the images with high similarities in the feature space will be grouped together and will result in a smaller search space. This will greatly enhance the search time and precision. IV .EXPERIMENTAL RESULTS When a LISS-III satellite image was given as input to each pixel-based classifier, classified images were produced [4]. These images were dependent on the type of classifier. When a satellite image is given to the featurebased image retrieval module, it retrieves the closest images to the given input image while demonstrating the feature values, precision and recall.

Thus, the images in the database that are spatially similar to the given input image can be retrieved. III. PERFORMANCE EVALUATION OF IMAGE RETRIEVAL Testing the effectiveness of an image search algorithm is about testing how well the search algorithm can retrieve similar images to the given input image [5]. The big question here is how to know that which image is relevant. Determining whether or not two images are similar is purely up to the user's perception. Human perceptions can easily recognize the similarity between two images although in some cases, different users can give different opinions. Two evaluation measures were used here to evaluate the effectiveness of this feature based-image retrieval mechanism [7].They are Recall Precision A. Recall Recall is a measure of the ability of a system to present all relevant items. The equation for calculating recall is given below: Recall =
Number of retrieved images that are also relevant Total number of relevant images

Figure 3.1 LISS-III Original Image (Image 1)

Feature-based Image Retrieval of Image 1: The retrieved images of Image 1 (figure 3.1), when given to feature-based image retrieval system, are shown below (figures 3.1, 3.2, 3.3, 3.4, 3.5).

Recall is the answer to the question: How close am I to getting all good matches? B. Precision Precision is a measure of the ability of a system to present only relevant items [3]. The equation for calculating precision is given below. Precision = Number of retrieved images that are also relevant
Total number of retrieved images

Figure 3.2 Retrieved Image 1

Figure 3.3 Retrieved Image 2

The precision is the answer to the question: How close am I to getting only good matches? For as to increase retrieval efficiency, the combinaVolume 2, Issue ICTM 2011, February 2012, ISSN Online: 2277-2677 ICTM 2011|June 8-9,2011|Hyderabad|India

Figure 3.4 Retrieved Image 3

Figure3.5 Retrieved Image 4

Table 1..1: Feature Values of the Given Input Image

6

PERFORMANCE ASSESSMENT OF FEATURE BASED IMAGE RETRIEVAL USING NEURAL NETWORKS

IS J AA

International Journal of Systems , Algorithms & Applications

Feature Mean Standard Deviation Skew-ness Kurtosis Energy Entropy

Values 140 120 100 80 60 40 20 0 -20

Values 128.4119 49.1303 -0.4419 -0.0293 0.0062 7.5102

Figure 4.2 Retrieved Image 1

Figure 4.3 Retrieved Image 2

Values

M ea n

S Sk D ew -n es s Ku rto si s En er gy En t ro py

Figure 4.4 Retrieved Image 3

Figure 4.5 Retrieved Image 4

The feature values of the original image (figure 3.1) are shown in table 1.1. Table 1.2: Performance Evaluation of Image Retrieval
Measure Precision Recall Value 43.5% 71.4%

Table 2.1: Feature Values of the Given Input Image

Feature Mean Standard Deviation Skew-ness Kurtosis Energy Entropy Values 125.2756 43.6134 0.8529 0.3778 0.0078 7.3206

The feature values of the original image (figure 4.1) are shown in table 2.1

The precision and recall values obtained, when the image (figure 3.1) is given as input to NN, are shown in table 1.2. Table 2.2: Performance Evaluation of Image Retrieval
Measure Precision Recall Value 61.9% 59.1%

Figure 4.1 LISS-III Original Image (Image 2)

Feature-based Image Retrieval of Image 2 : The retrieved images of Image 2 (figure 4.1), when given to feature-based image retrieval system, are shown below (figures 4.2, 4.3, 4.4, 4.5).

The precision and recall values obtained, when the image (figure 4.1) is given as input to NN, are shown in table 2.2
7

Volume 2, Issue ICTM 2011, February 2012, ISSN Online: 2277-2677 ICTM 2011|June 8-9,2011|Hyderabad|India

PERFORMANCE ASSESSMENT OF FEATURE BASED IMAGE RETRIEVAL USING NEURAL NETWORKS

IS J AA

International Journal of Systems , Algorithms & Applications

V. CONCLUSIONS This paper makes an attempt to use Back Propagation neural network for performing feature-based image retrieval. For this purpose, LISS-III satellite images were used. In addition, it was observed that the results were good when the number of epochs was 40 and the number of hidden neurons 8. It was also observed that as the size of the training set increased, the classification accuracy increased. The same observations regarding neural network elements (number of epochs, number of hidden neurons) were seen in case of feature-based image retrieval. The feature-based image retrieval module of the paper can be further extended by considering visual features like colour, texture, etc. The results obtained from using only visual features and only spatial features can be compared. This paper uses a database of 50 images. This number can be further increased and then a DT classifier can be implemented for the image search. Apart from these, satellite images other than LISS-III can also be classified and compared with each other.

REFERENCES
[1] Camps-Valls, Gustavo, Tatyana V. Bandos and Dengyong Zhou. Semi-supervised Graph-based Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing 13 Feb. 2007. Print. [2] Aria, E. Hosseini, J. Amini and M.R.Saradjian. Back Propagation Neural Network for Classification of IRS-1D Satellite Images. Tehran University, Iran. Print [3] Performance Evaluation of Image Search: Precision and Recall. 4 Mar. 2009. Web. http://inperc.com/blog2/2009/03/04/ performance-evaluation-of-image-search-precision-and-recall [4] Remote Sensing - Satellite Remote Sensing. Web. http://www.clearleadinc.com/site/remote-sensing.html [5] Image Processing and Analysis. Web. http://www.gisdevelopment.net/tutorials/tuman005pf.htm. [6] Hagan, M. T., and M. Menhaj,(1994) "Training feedforward networks with the Marquardt algorithm," IEEETransactions on Neural Networks, vol. 5, no. 6, pp. 989-993. [7] Hepner, G. F., Logan, T., Ritter, N. and Brayant, N., (1990), Artificial neural network classification using a minimal training set: comparison to conventional supervised classification.

Volume 2, Issue ICTM 2011, February 2012, ISSN Online: 2277-2677 ICTM 2011|June 8-9,2011|Hyderabad|India