Académique Documents
Professionnel Documents
Culture Documents
net/publication/309061685
Novel Edge Detection Scheme in the Trinion Space for Use in Medical Images
with Multiple Components
CITATIONS READS
2 61
2 authors:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Ondrej Krejcar on 20 November 2017.
1 Introduction
A trinion is defined with one real and two vector components as t = a+ib+jc
where i, j are operators satisfying: i2 = j, ij = ji = −1, and j 2 = −i. It
can easily be checked that trinions with the three base elements {1, i, j} form
an abelian (commutative) group where 1 = j 3 is the multiplicative identity
element. Distinct from quaternions, trinions with the above structure form a
commutative ring. Trinions are associative, commutative, and distributive with
respect to addition and multiplication. It is also easy to show that all other
field axioms are satisfied by trinions except invertibility. Hence trinions are not
fields. In comparison, the skew field of quaternions Q is a four dimensional, non-
commutative field over the field of real numbers R. Sum and product of trinions
is defined analogous to the complex/quaternion case. Trinion exponentiation,
conjugate and inverse (when it exists) have all quite complicated expressions.
For example, the conjugate t̄ of t = a + ib + jc is given by:
M −1 N −1
1 ux vy ux vy
T F T 1(u, v) = h(x, y) cos(2π( + )) − μ1 sin(2π( + ))
M N x=0 y=0 M N M N
(4)
M
−1 N
−1
ux vy ux vy
h(x, y) = T F T 1(u, v) cos(2π( + )) + μ2 sin(2π( + ))
u=0 v=0
M N M N
(5)
where μ1 is a unit, pure trinion, and μ2 is a trinion such that μ1 μ2 = −1. Note
that μ1 and μ2 are chosen arbitrarily and the expression μ1 μ2 = −1 generally
results in a system of non-linear algebraic equations (with respect to the trinion
coefficients) and so μ1 and μ2 must be chosen such that this system has a real
Novel Edge Detection Scheme in the Trinion Space 235
√
solution. For √a RGB image, we customarily use μ1 = (i − j)/ 2 and μ2 =
(−1 − i + j)/ 2. It can be seen that TFT1 resembles the euler form of QFT2.
Otherwise the two are distinct. For example the conjugate relationship that exists
between the kernels of the forward and inverse transforms in the case of the QFT
doesn’t hold in the TFT space. There are also other properties which are known
to hold in the complex and quaternion spaces but not with the trinions. However,
as shown in previous studies, such unique properties of the trinions do not pose
much problems in using the TFTs for efficient color image analysis.
The discrete TFT of type II and its inverse are similarly defined as follows:
M
−1 N
−1
1 ux ux vy vy
T F T 2(u, v) = h(x, y) cos(2π ) − μ1 sin(2π ) cos(2π ) − μ2 sin(2π ) (6)
M N x=0 y=0 M M N N
M
−1 N
−1
ux ux vy vy
h(x, y) = T F T 2(u, v) cos(2π ) + μ3 sin(2π ) cos(2π ) + μ4 sin(2π ) (7)
u=0 v=0 M M N N
where μ1 , μ2 are unit, pure trinions, and μ3 , μ4 are arbitrary trinions satisfying
μ1 μ3 = −1 = μ2 μ4 . In the current work we assumed μ1 = μ4 = i and μ2 =
μ3 = j. As shown in [8], in terms of symmetry analysis, TFT2 is a desired choice
than TFT1. However, it has also been shown previously that many operations
of interest in image processing including convolutions and correlations are easier
using TFT1 than TFT2, and hence TFT1 has been adopted in the current study.
Given a color image h(x, y), say an RGB with components R(x, y), G(x, y) and
B(x, y), by mapping R(x, y) to the real component of a trinion and G(x, y)
and B(x, y) to the two imaginary components, h(x, y) can be written: h(x, y) =
R(x, y) + iG(x, y) + jB(x, y).
As demonstrated in [8], one main advantage of use of trinions over the quater-
nions is the ability to see color spatial frequency spectra as a whole rather than
just its amplitude or phase. This is so as the TFT of a given three band image
itself has three components and hence both the input image as well as its TFT
can be plotted as color images. The case is different in the quaternion space
as the QFT of a given three channel color image, often represented as a pure
quaternion, has four components with generally non zero real part. In most
color applications ranging from a low level (non-linear) filtering to the higher
level ones such as segmentation, the extra fourth dimension in the quaternion
space is only redundant and use of the trinions should alleviate such redundancy.
In that regard, an efficient color edge detection scheme is proposed in the next
section making use of features extracted from a spatially localized application of
the TFT.
Fig. 1. Original color image (left), trinion edge map (middle), and quaternion edge
map (right).
central pixel value. For the purpose of edge detection, the following feature F
was computed:
log(1 + P (x, y))
F = M etric (8)
log(1 + max{P (x, y)})
x,y
where P (x, y) is the square amplitude (‘power’) of the TFT, and M etric is a
second order statistical feature (variance, standard deviation, etc.). The above
step is repeated across all pixels that are included in the color image under
consideration and the resulting matrix is plotted as an edge map. Note that all
discrete TFT calculations were performed using a repeated use of the 2D Fast
Fourier Transform (FFT).
The primary intent of the current study is to show the application and fea-
sibility of the above edge detection scheme on MP-MR image sets. The MP-MR
images in this study were taken from a cohort of 29 patients treated for glioblas-
toma multiforme(GBM), the most aggressive of the gliomas, and is the same
data set used in previous studies [9,10]. Contrast-enhanced T1W gradient-echo,
T2-Fluid-Attenuated Inversion Recovery (FLAIR) spin-echo as well as ADC MR
images of the patients acquired at baseline as well as within and after radiation
therapy were available for analysis. The MR trios came with distinct image slice
thickness and the number of slices were also different. Hence, for each patient,
the normalized mutual information algorithm was used on all serial MR volumes
and were registered to the orientation of the baseline T1W image volume and
trilinear interpolation was used to re-sample them to a common resolution. The
edge detection analysis on the MP-MR images was then carried out by combining
the T1W, T2-FLAIR and the ADC images (parameters) as three channel ‘RGB’
color images. However, two main issues have to be considered when applying the
proposed algorithm in edge detection of these data sets. Primarily, our scheme
assumes that the different MR parameters behave well so that our color assump-
tion and representation is acceptable. For example, not all glioma tumors show
elevated ADCs, which can be problematic when trying to detect tumor edges.
Hence such cases should be excluded from our analysis. This issue of course is
not present in actual color images. Another issue is possible registration inaccu-
racy, which in most cases is unavoidable, accompanied by the fact that we have
also applied interpolation as a pre processing step so that all MR image para-
meters assume a common resolution. These could potentially pose a challenge
in implementing our edge detection scheme.
We start with some standard test images to evaluate the performance of our
edge detection scheme. Note that only qualitative analysis is presented in this
work while a more quantitative evaluation awaits further validation steps. The
first two natural images in Fig. 1 contain horses with a grass background while
there is an increased degree of difficulty on the second compared to the first
238 D. Assefa and O. Krejcar
Fig. 2. Original color image (left), edge map using the max gradient method (second),
trinion edge map (third), and quaternion edge map (right).
Fig. 3. Columns 1 to 3 are original T1, T2-FLAIR and ADC images respectively con-
taining contrast enhanced glioma tumors; column 4 contains the respective combined
color images and column 5 contains the corresponding edge maps generated in the
trinion space.
(top) as the former contains more noise. In both cases, the edge maps generated
using the proposed scheme picked the edges effectively. For comparison the edge
map generated in the quaternion space (using QF T 2) is also presented. We see
similar edge map results generated in the two distinct spaces while the amount
of computation involved and the memory requirement in the trinion space is at
least an order less than the corresponding operation in the quaternion space.
The next two images contain the standard lena image and another color image
with visible patterns. The corresponding edge maps identified the edges quite
well. Note that, in all the results presented in this paper, the statistical feature
computed (M etric in Eq. (8)) is standard deviation. Results found using other
statistical features like second order variance were generally similar.
One efficient color edge detection scheme proposed in the literature is the max
gradient method. Like the trinions, quaternions and other vectorial approaches, it
treats colors as vectors. The edge detection results we found using the max gradient
method were satisfactory for most of the test images we considered. Here we want
to show with demonstrating examples that the trinion/quaternion formulation is
much more powerful than standard vectorial approaches. The example shown in
Novel Edge Detection Scheme in the Trinion Space 239
Fig. 2 show a case where the max gradient method fails to detect edges appropri-
ately. In this example what was mostly desired is to detect the bird sitting in the
middle of the grass field. Both the trinion and the quaternion schemes effectively
detected the bird and other visible edges while it was hardly with the max gradient
method. Note that the max gradient implementation was based on a recent ver-
sion of the algorithm by J. Henriques which is freely available on the Matlab Cen-
tral website. The original color scene in this example and many other natural color
scenes are freely available on the McGill calibrated color image database at http://
tabby.vision.mcgill.ca/html/browsedownload.html. All tests carried out showed
that the trinion/quaternion scheme is by far superior to other vectorial approaches
including the max gradient operator indicating that an effective color edge detec-
tion requires not just a vectorial scheme but a more systematic manipulation of the
inter correlation information that is embedded among the monochromes that make
up the color image.
Figure 3 presents typical edge detection results we found using the proposed
algorithm applied on representative MP-MRI slices. Only the trinion edge maps
are presented as the results in the quaternion space were very similar. The brain
tissue edges were very well detected with some difficulties around skull bound-
aries which may have resulted from some image registration inaccuracies. The
images also present identified contrast enhanced glioma tumors. The algorithm
performs well in detecting the tumor edges and surrounding edema. In most cases
that we considered, the scheme robustly showed well defined edges for tumors
and the surrounding edemas. However, only representative preliminary results
are shown in this paper while further investigation of the method is still under-
way including clinical validations. For example, two relaxation (T1 and T2) and
one functional (ADC) MR parameters are used in this study for the MP-MRI
edge detection. Looking at just one set at a time, i.e. three relaxation or three
functional parameters, could be an interesting case to try. Resolving these and
similar other issues is awaiting further investigation.
6 Conclusions
An automatic color edge detection scheme that makes use of statistical features
derived from locally computed trinion Fourier transforms (TFT) is proposed.
The scheme is holistic in the sense that it takes into account the inter-correlation
information that is embedded within color components. The various tests that we
performed both on synthetic and natural color images as well as MP-MR images
of the brain clearly showed that the proposed trinion/quaternion formulation
offered promising results proving that a systematic use of the inter-correlation
information that is embedded within the monochromes (separate color bands)
is useful for efficient and effective edge detection of color images. The study is
partly a continuation of our ongoing effort to find robust techniques that are
able to uniquely characterize different tissues in MP-MRIs and also study their
clinical significance. Though the edge detection results found were very similar
for both the trinion and quaternion based schemes, the trinion formulation is
240 D. Assefa and O. Krejcar
shown to be more efficient. It is also demonstrated with examples that the pro-
posed trinion/quaternion formulation is more powerful and efficient than other
vectorial approaches like the max gradient operator. However, there are still
rooms to improve the performance of our edge detection scheme particularly
when considering more complex color images. After computing the windowed
Fourier transforms, ways to extract more powerful features than the once used
in this study (second order variance, standard deviation, etc.) can be benefi-
cial. This for example could mean searching for statistical features which are
less sensitive to certain subtle changes within the color image and also noise.
Moreover, other than the trinion local amplitude/power, research on inclusion
of the other two attributes, the eigen axis and eigen angle (phase), is a work in
progress. In principle, other than MRIs, the proposed scheme can be applied to
images acquired through other modalities such as CT, PET, and also other color
medical images; this without implying that we have proposed an edge detection
scheme that can work for any given color image.
Acknowledgements. This work was supported by the project “Smart Solutions for
Ubiquitous Computing Environments” FIM (ID: UHK-FIM-SP-2016-2102), University
of Hradec Kralove, Czech Republic.
References
1. Sonka, M., Hlavac, V., Boyle, R.: Image Processing Analysis and Machine Vision,
2nd edn., Thomson Asia Pte Ltd and PPTPH, Berlin (2001)
2. Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal.
Mach. Intell. 8(6), 679–698 (1986)
3. Trahanias, P.E., Venetsanopoulos, A.N.: Color edge detection using vector order
statistics. IEEE Trans. Image Proc. 2(2), 259–264 (1993)
4. Tang, H., Wu, E.X., Ma, Q.Y., Gallagher, D., Perera, G.M., Zhuang, T.: MRI
brain image segmentation by multi-resolution edge detection and region selection.
Comput. Med. Imaging Graph. 24, 349–357 (2000)
5. Lukac, R., Smolka, B., Martin, K., Plataniotis, K.N., Venetsanopoulo, A.N.: Vector
filtering for color imaging: opening a world of possibilities. IEEE Sig. Proc. Mag.
22(1), 74–86 (2005)
6. Zhu, S.-Y., Venetsanopoulos, A.N., Plataniotis, K.N.: Comprehensive analysis of
edge detection in color image processing. Opt. Eng. 38(4), 612–625 (1999)
7. Hamilton, W.R.: Lectures on Quaternions. Hodges and Smith, Dublin (1853).
http://historical.library.cornell.edu/
8. Assefa, D., Mansinha, L., Tiampo, K.F., Rasmussen, H., Abdella, K.: The trinion
Fourier transform of color images. Sig. Proc. 91, 1887–1900 (2011)
9. Assefa, D., Keller, H., Jaffray, D.A.: Signal analysis of multi-parametric MR images
in higher order Fourier Spaces. Int. J. Comput. Biosci. 4(1) (2013)
10. Assefa, D., Keller, H., Jaffray, D.A.: Multi-parametric MR image processing using
higher dimensional vector algebra. ACTA Press, Proced. IASTED, ISPHT, pp.
24–31, May 2011
11. Sangwine, S.J., Ell, T.A.: Hypercomplex Fourier transforms of color images. In:
IEEE International Conference on Image Processing (ICIP 2001), Thessaloniki,
Greece, vol. 1, pp. 137–140, October 2001
Novel Edge Detection Scheme in the Trinion Space 241
12. Sangwine, S.J.: The problem of defining the Fourier transform of a color image. In:
IEEE Proceedings of International Conference on Image Processing (ICIP 1998),
Chicago, IL, USA, vol. 1, pp. 171–175, October 1998
13. Ell, T.A., Sangwine, S.J.: Hypercomplex Fourier transforms of color images. IEEE
Trans. Image Proc. 16(1), 22–35 (2007)
14. Chernov, V.M.: Some FFT-like algorithms for RGB-spectra calculation. Mach.
Graph. Vis. Int. J. 11(2/3), 139–151 (2002)
15. Labunets, V.: Clifford Algebras as unified language for image processing and pat-
tern recognition. In: Byrnes, J., Ostheimer, G. (eds.) NATO Sciences Series II
Mathematics, Physics & Chemistry, vol. 136. Kluwer (2003)
16. Sangwine, S.J., Ell, T.A., Gatsheni, B.N.: Color-dependent linear vector image
filtering. In: Proceedings of the EUSIPCO 2004, 12th European Signal Processing
Conference, Vienna, Austria, pp. 585–588, 6–10 September 2004
17. Denis, P., Carre, P., Fernandez-Maloigne, C.: Spatial and spectral quaternionic
approaches for colour images. Comput. Vis. Image Underst. 107(1–2), 74–87 (2007)
18. Sangwine, S.J., Ell, T.A.: Hypercomplex auto and cross-correlation of color images.
In: IEEE Proceedings of International Conference on Image Processing (ICIP
1999), Kobe, Japan, vol. 4, pp. 319–322, October 1999
19. Le Bihan, N., Sangwine, S.J.: Quaternion principal component analysis of color
images. In: IEEE International Conference on Image Processing, vol. 1, pp. 809–
812, September 2003
20. Pei, S.C., Chang, J.H., Ding, J.J.: Quaternion matrix singular value decomposition
and itsapplications for color image processing. In: IEEE International Conference
on Image Processing, vol. 1, pp. 805–808, September 2003
21. Bülow, T., Sommer, G.: Quaternionic Gabor filters for local structure classification.
In: Proceedings of the 14th Annual Conference on Pattern Recognition, vol. 11,
pp. 808–810 (1998)
22. Bayro-Corrochano, E.: The theory and use of the quaternion wavelet transform. J.
Math. Imaging Vis. 24(1), 19–35 (2006)
23. Chan, W.L., Choi, H., Baraniuk, R.G.: Coherent multiscale image processing using
dual-tree quaternion wavelets. IEEE Trans. Image Proc. 17(7), 1069–1082 (2008)
24. Assefa, D., Mansinha, L., Tiampo, K.F., Rasmussen, H., Abdella, K.: Local quater-
nion fourier transform and color image texture analysis. Sig. Proc. 90(6), 1825–
1835 (2010)
25. Pei, S.-C., Hsiao, Y.-Z.: Colour image edge detection using quaternion quantized
localized phase. In: EURASIP, Aalborg, Denmark, 23–27 August 2010
26. Pei, S.-C., Cheng, C.-M.: Color image processing by using binary quaternion-
moment-preserving thresholding technique. IEEE Trans. Image Proc. 8(5), 614–
628 (1999)
27. Ell, T.A.: Quaternion-fourier transforms for analysis of two-dimensional linear
time-invariant partial differential systems. In: IEEE Proceedings of the 32nd Con-
ference on Decision and Control, San Antonio, TX, USA, pp. 1830–1841, December
1993
28. Bora, D.J., Gupta, A.K., Khan, F.A.: Comparing the performance of L*A*B* and
HSV color spaces with respect to color image segmentation. Int. J. Emerg. Technol.
Adv. Eng. 5(2) (2015)
29. Manian, V., Vásquez, R.: Approaches to color and texture based image classifica-
tion. J. Int. Soc. Opt. Eng. (SPIE) 41(7), 1480–1490 (2002)