Académique Documents
Professionnel Documents
Culture Documents
DOI 10.1007/s11947-012-1015-2
ORIGINAL PAPER
Abstract A key aspect for the consumer when it comes platform and its performance is evaluated against that of
to deciding on a particular product is the colour. In a spectrophotometer used as a reference in the analysis
order to make fruit available to consumers as early as of colour in food. The results obtained prove that our
possible, the collection of oranges and mandarins begins analysis system predicts the colour index of citrus with
before they ripen fully and reach their typical orange a good reliability (R2 00.925) working in real time.
colour. As a result, they are therefore subjected to Findings also show that it is effective for classifying
certain degreening treatments, depending on their stan- harvested fruits in the field according to their colour.
dard colour citrus index at harvest. Recently, a mobile
platform that incorporates a computer vision system Keywords Colour analysis . Citrus fruits . Degreening .
capable of pre-sorting the fruit while it is being har- Machine vision . Automatic inspection
vested has been developed as an aid in the harvesting
task. However, due to the restrictions of working in the
field, the computer vision system developed for this Introduction
machine is limited in its technology and processing
capacity compared to conventional systems. This work Colour is one of the most important attributes of agrifood
shows the optimised algorithms for estimating the col- products, since consumers associate it with freshness and it
our of citrus in-line that were developed for this mobile is a critical factor in the customers preference for a particular
product over others (Campbell et al. 2004). Producers strive to
A. Vidal : P. Talens guarantee that the products they put on the market have the
Departamento de Tecnologa de Alimentos, Universitat Politcnica attractive colour typical of mature fruits of the variety, as well
de Valncia, Camino de Vera s/n,
as ensuring that individual products are packed in batches with
46022 Valencia, Spain
a similar colour or quality (Daz et al. 2000; Blasco et al.
A. Vidal : S. Cubero : J. Blasco (*) 2009). The analysis of the colour of the whole production can
Centro de Agroingeniera, Instituto Valenciano de Investigaciones be performed automatically using different optical technolo-
Agrarias (IVIA), Cra. Moncada-Nquera km 5,
46113 Moncada, Valencia, Spain
gies (Pathare et al. 2012), but in most cases there is a need to
e-mail: blasco_josiva@gva.es use some colour index or criteria to sort the product into
different colour categories (Yam and Papadakis 2004).
J. M. Prats-Montalbn When an object is assessed visually, three physical factors
Departamento de estadstica e investigacin operativa, Universitat
must be present: a source of light, the object itself and a light-
Politcnica de Valncia, Camino de Vera s/n,
46022 Valencia, Spain receiving mechanism, the spectral distribution of the light source
having a strong influence on the perceived colour (Sahin and
F. Albert Sumnu 2006). There are different standard sources of light, but
Instituto Interuniversitario de Investigacin en Bioingeniera y
the most widely used in colour measurement of food is the
Tecnologa Orientada al Ser Humano, Universitat Politcnica de
Valncia, Camino de Vera s/n, standard D65 (Noboru and Robertson 2005), which corresponds
46022 Valencia, Spain to the spectral distribution of the midday sun in Western Europe,
Food Bioprocess Technol
built-in microprocessor and therefore does not need an synchronised with the image acquisition, which allowed a
external processing unit, such as a computer. The camera saving of about 90 % of the energy in comparison with
operates under the MS Windows XP operating system, and standard powering using direct current. This was done using
the software to acquire and process the images was the strobe output of the camera and controlled by a specific
programmed specifically for this purpose in programming electronic board designed for this purpose. Polarising filters
language C. The main advantage of this camera is that it can were used to avoid bright spots.
be powered directly from the battery of the mobile platform This mobile platform, which is described in Cubero et al.
and there is no need to use an external processing unit (2010), is capable of pre-sorting the harvested fruit into
(computer), since the camera already has this capability. three different categories of quality in the field using the
This makes this configuration optimal for working in the computer vision system. To do so, a series of rotating
field, where there is no external power supply. In contrast, elements individualise the harvested fruit and separate the
the computational power is very low compared with a pieces into two lanes. Fruit enters the inspection chamber on
standard personal computer and this makes it necessary to rollers that allow the fruit to be transported and rotated
develop highly optimised image-processing algorithms. under the camera while images are captured. The camera
The light source used to acquire the images was com- captures 1,280 969 pixel images with a resolution of
posed of four strips, each 500 mm in length, with 50 light- 0.31 mm/pixel that contain up to eight fruits from the two
emitting diodes (LEDs) per strip. Each 0.3 W LED produces lanes. Image acquisition is synchronised with the movement
light with a colour temperature of 6,000 K and a colour of the fruit using an optical encoder that supplies the camera
reproduction of 70 Ra, the gamma correction parameter of with one trigger pulse each time a new roller enters the
the camera being set to 1.0. Due to the limited energy scene. In this way, four images of each fruit are acquired
sources available in the field, to achieve a sustainable sys- in different views while the fruit rolls along under the
tem we powered the LEDs using a stroboscopic mode camera at a speed of 0.4 m/s. To freeze the movement, a
Table 1 Time required by the different algorithms to process one Figure 3 shows some illustrative samples of the fruit used
image
for the experiments.
Operation Time (ms)
order to speed up the colour space conversion, this To obtain the reference values, the spectral data of six points
operation was performed previously off-line by calculat- on each fruit were taken using a spectrophotometer. The acquired
ing the CCI of all possible RGB values in the image, areas were chosen randomly in an attempt to cover the whole
these values being stored in a Look-Up Table (LUT). surface, but including coloured spots when they were present.
This table is preloaded in the memory of the computer, The average of these spectral data was calculated to obtain the
so that during in-line processing, the HunterLab value colour reflectance curve of each orange. The data of this reflec-
of each pixel can be obtained just by consulting the tance curve were multiplied by a CIE standard illuminant D65
LUT, which dramatically reduces the computational cost and by the CIE standard observer 10 and converted into the
and makes it very effective for in-line processes. tristimulus values of XYZ (Hutchings et al. 2002). The XYZ
To decide the CCI of a fruit, two different algorithms coordinates were converted to HunterLab using the same equa-
were tested in order to know the accuracy and performance tions as those implemented in the image processing algorithm
of each one: (Hunterlab 2008). Later, the corresponding CCI value is calcu-
lated using Equation 1.
1. The RGB values of all pixels in the image segmented as
fruit were converted to HunterLab (the LUT was con-
sulted for each pixel). Then the CCI was calculated for Test
each pixel. The CCI of the image was calculated as the
mean of the CCI of all the pixels of the fruit. The result The CCI values estimated for each fruit by the laboratory
was called LUTCCI. and industrial vision systems were compared with those
2. The mean of all the RGB values of the pixels belonging obtained using the spectrophotometer by means of a qua-
to the fruit was calculated. The resulting value was dratic regression.
transformed into the CCI value using the LUT. The Two tests were carried out during this work:
result was called PIXCCI.
1. To assess which approach for image analysis provides a
The CCI of the fruit was then calculated as the mean more accurate prediction of the CCI
of the CCI of the four partial images of the fruit. 2. To determine the behaviour of the vision system to-
Figure 4 shows the flowchart of these two algorithms. wards the spectrophotometer
The statistical analysis of data was performed through inspect the statistical significance of both the linear and
multiple regression models using Statgraphics Centurion quadratic effects of the computer vision system, which have
(StatPoint Technologies, USA). a p value of 0 %a value that gives complete confidence in
the model that was built. When a new term (cubic) was
included, the R2 value did not improve from a statistical
Results and Discussion point of view (general test for hypothesis testing), which
meant that this new term should not be included.
In terms of processing speed and computational cost, this The R2 is very good, which offers confidence in the
system cannot be compared with a standard configuration computer vision acquisition system that was developed.
for image processing composed of a camera and a computer, The model for the LUTCCI algorithm presents statistically
as is commonly used in a packing house. Using this standard significant linear and quadratic coefficients, which means
equipment would allow more complex algorithms to be that there is some curvature in the relation between the
implemented, but on the other hand the power supply would spectrophotometer and the vision system.
become a problem, as a power inverter would be needed to In order to validate the models properly, the next step was
convert the supply from the battery to the standard 220 V to use the regression models to predict the colour values of the
used by this equipment. Table 1 shows the processing time validation set. Figure 5 presents the corresponding validation
needed by the system for each image. By estimating the results. In this case, the validated R2 value is even a little bit
average RGB of the fruit and then making just one conver- higher than the one obtained for the calibration set. This result
sion to HunterLab, an in-line process of eight images per indicates that the vision system developed for working on a
second can be achieved. mobile platform under field conditions is completely reliable.
values for the vision system, that it is similar to that provid- affect consumer preferences for satsuma mandarins. HortScience,
39(7), 16641669.
ed by the LUTCCI algorithm.
Cavazza, A., Corradini, C., Rinaldi, M., Salvadeo, P., Borromei, C., &
Finally, Table 4 presents the 95 % confidence interval for Massini, R. (2012). Evaluation of pasta thermal treatment by
the comparison of the (percentage) determination coefficient determination of carbohydrates, furosine, and color indices.
values. From this information, it is possible to see that all Food and Bioprocess Technology. doi:10.1007/s11947-012-
0906-6. In-press.
models provide comparable prediction R2 values, so they
Cubero, S., Aleixos, N., Molt, E., Gmez-Sanchis, J., & Blasco, J.
can all be used with the same reliability. (2011). Advances in machine vision applications for automatic
inspection and quality evaluation of fruits and vegetables. Food
and Bioprocess Technology, 4(4), 487504.
Cubero, S., Molt, E., Gutirrez, A., Aleixos, N., Garca-Navarrete, O.
Conclusions L., Juste, F., & Blasco, J. (2010). Real-time inspection of fruit on a
mobile harvesting platform in field conditions using computer
A computer vision system allowing the colour index of vision. Progress in Agricultural Engineering Science, 6, 116.
citrus fruits to be measured automatically while the fruit is Daz, R., Faus, G., Blasco, M., Blasco, J., & Molt, E. (2000). The
application of a fast algorithm for the classification of olives by
being harvested has been developed and tested. This system machine vision. Food Research International, 33, 305309.
allows pre-sorting the fruit in the field according to the DOGV (2006) Diari Oficial de la Comunitat Valenciana, 5346, 30321-
amount of degreening that is needed. The main advantages 30328.
are the high speed of processing the fruit using low compu- Gardner, J. L. (2007). Comparison of calibration methods for tristim-
ulus colorimeters. Journal of Research of the National Institute of
tational performance equipment and the ability to include Standards and Technology, 112, 129138.
the colour of the entire surface of the fruit. To determine the Hashim, N., Janius, R. B., Baranyai, L., Rahman, R. A., Osman, A., &
systems capability to reproduce the colour of whole fruits, Zude, M. (2011). Kinetic model for colour changes in bananas
they were compared with the measurements obtained using during the appearance of chilling injury symptoms. Food and
Bioprocess Technology, 5(8), 29522963.
a spectrophotometer (reference system in colour measure- HunterLab (2008): Applications note, 8(9), http://www.hunterlab.com/
ments of food). The colour of the fruits was measured by the appnotes/an08_96a.pdf. Accessed September 2012.
imaging systems using two different algorithms: from the Hutchings, J. B., Luo, R., & Ji, W. (2002). Calibrated colour imaging
average of the CCI values and from the average RGB analysis of food. In D. MacDougall (Ed.), Colour in Food (pp.
352366). Cambridge: Woodhead Publishing.
values, the latter being faster and more reliable. High corre- Jimnez-Cuesta MJ, Cuquerella J & Martnez-Jvega JM (1981)
lations were achieved in all cases. In both cases a well- Determination of a color index for citrus fruit degreening. In
adjusted R2 value was obtained: 92.30 % for the LUT Proc. of the International Society of Citriculture, Vol. 2, 750-753
CCI system and 92.51 % for the PIX-CCI system. Being Kang, S. P., East, A. R., & Trujillo, F. J. (2008). Colour vision system
evaluation of bicolour fruit: A case study with B74 mango.
faster the latter, it is the recommended method. These results Postharvest Biology and Technology, 49, 7785.
are promising and demonstrate the feasibility of a computer Lang, C., & Hbert, T. (2011). A colour ripeness indicator for apples.
vision system to inspect the colour of citrus fruits in field Food and Bioprocess Technology, 5(8), 32443249.
conditions while the fruit is being harvested, which is a Lpez-Camelo, A. F., & Gmez, P. A. (2004). Comparison of color indexes
for tomato ripening. Horticultura Brasileira, 22(3), 534537. http://
valuable step forward for this industrial sector. www.scielo.br/scielo.php?script0sci_arttext&pid0S0102-
05362004000300006.
Acknowledgments This work was partially funded by the INIA Lpez-Garca, F., Andreu-Garca, A., Blasco, J., Aleixos, N., &
through research project RTA2009-00118-C02-01 with the support of Valiente, J. M. (2010). Automatic detection of skin defects in
European FEDER funds, and by the project PAID-05-11-2745, Vice- citrus fruits using a multivariate image analysis approach.
rectorat dInvestigaci, Universitat Politcnica de Valncia. Computers and Electronics in Agriculture, 71, 189197.
Lorente, D., Aleixos, N., Gmez-Sanchis, J., Cubero, S., Garca-
Navarrete, O. L., & Blasco, J. (2012). Recent advances and
applications of hyperspectral imaging for fruit and vegetable
quality assessment. Food and Bioprocess Technology, 5(4),
References
11211142.
Mendoza, F., Dejmek, P., & Aguilera, J. M. (2006). Calibrated color
Arzate-Vzquez, I., Chanona-Prez, J. J., Perea-Flores, M. J., Caldern- measurements of agricultural foods using image analysis.
Domnguez, G., Moreno-Armendriz, M. A., Calvo, H., Godoy- Postharvest Biology and Technology, 41, 285295.
Caldern, S., Quevedo, R., & Gutirrez-Lpez, G. (2011). Image Montgomery, D. C. (2005). Design and analysis of experiments, 6th
processing applied to classification of avocado variety Hass (Persea ed. Tempe: Wiley.
americana Mill.) during the ripening process. Food and Bioprocess Noboru, O., & Robertson, A. R. (2005). Colorimetry. West Sussex: Wiley.
Technology, 4(7), 13071313. Pathare, P. B., Opara, U. L., & Al-Said, F. A. (2012). Colour
Blasco, J., Aleixos, N., Cubero, S., Gmez-Sanchis, J., & Molt, E. measurement and analysis in fresh and processed foods: a
(2009). Automatic sorting of satsuma (Citrus unshiu) segments review. Food and Bioprocess Technology. doi:10.1007/s11947-
using computer vision and morphological features. Computers 012-0867-9. In-press.
and Electronics in Agriculture, 66, 18. Quevedo, R. A., Aguilera, J. M., & Pedreschi, F. (2010). Colour of
Campbell, B. L., Nelson, R. G., Ebel, C. E., Dozier, W. A., Adrian, J. salmon fillets by computer vision and sensory panel. Food and
L., & Hockema, B. R. (2004). Fruit quality characteristics that Bioprocess Technology, 3, 637643.
Food Bioprocess Technol
Sahin, S., & Sumnu, S. G. (2006). Physical properties of foods. New Smith, T., & Guild, J. (1931). The C.I.E. colorimetric standards
York: Springer. and their use. Transactions of the Optical Society, 33(3), 73
Quevedo, R., Valencia, E., Alvarado, F., Ronceros, B., & Bastias, J. M. 134.
(2011). Comparison of whiteness index vs. fractal Fourier in the Yam, K. L., & Papadakis, S. E. (2004). A simple digital imaging
determination of bloom chocolate using image analysis. Food and method for measuring and analyzing color of food surfaces.
Bioprocess Technology. doi:10.1007/s11947-011-0729-x. In-press. Journal of Food Engineering, 61, 137142.