Fractal Descriptors Applied to Image Analysis

Joao B. Florindo
Physics Institute of Sao Carlos - University of Sao Paulo - Brazil
College of Medical and Dental Sciences - University of Birmingham
jbflorindo@gmail.com
http://scg.ifsc.usp.br

Joao B. Florindo

Fractal Descriptors Applied to Image Analysis

1 / 45

Joao B. Florindo

Fractal Descriptors Applied to Image Analysis

2 / 45

University of Sao Paulo
Top university in Latin-America (QS World University Rankings)
Numbers (approximate):
Established as university in 1934
93,000 students (30,000 PhD)
Total area: 76 million m2

Joao B. Florindo

Fractal Descriptors Applied to Image Analysis

3 / 45

1

Introduction

2

Fractal Geometry

3

Fractal Descriptors

4

Results

5

Other Works

6

Conclusions

7

Bibliography

Joao B. Florindo

Fractal Descriptors Applied to Image Analysis

4 / 45

Introduction Introduction Fractals are geometrical objects defined within an infinite range of scales Complex and self-similar structures at any scale Joao B. Florindo Fractal Descriptors Applied to Image Analysis 5 / 45 .

Introduction Introduction Joao B. Florindo Fractal Descriptors Applied to Image Analysis 6 / 45 .

1982] Complex and self-similar objects (within a limited range of scales) Joao B.Introduction Introduction Nature shows many fractal-like processes [Mandelbrot. Florindo Fractal Descriptors Applied to Image Analysis 7 / 45 .

2007.. 2012] TEXTURES Joao B.. Backes et al. Xu et al. Florindo SHAPES Fractal Descriptors Applied to Image Analysis 8 / 45 .. 2013a. 2009] Good results in texture and shape analysis [Xu et al. Florindo and Bruno.Introduction Introduction Fractal Theory has been widely applied to image analysis [Tian-Gang et al. 2009..

multiscale fractal dimension. fractal descriptors Joao B.Introduction Introduction The most important measure of a fractal is its dimension[Mandelbrot. Florindo Fractal Descriptors Applied to Image Analysis 9 / 45 . 1982] This can be adapted to describe objects in nature Limited information / scale-dependent Multifractals.

Florindo Fractal Descriptors Applied to Image Analysis 10 / 45 .Fractal Geometry Fractal Geometry Fractal dimension measures how the amount of details in the object changes according to scale Mathematically. it is a real non-negative number provided by the Hausdorff-Besicovitch dimension Such concept cannot be directly applied to finite objects (and images) but can be approximated Joao B.

Fractal Geometry Fractal Geometry A general expression can be defined for real-world objects (fractal-like) and applied to the respective image representation D ∝ lim →0 Joao B. Florindo log(M()) log() Fractal Descriptors Applied to Image Analysis 11 / 45 .

Florindo Fractal Descriptors Applied to Image Analysis 12 / 45 .Fractal Geometry Fractal Geometry Fractal Geometry in Computer Vision Euclidean Geometry is limited to describe the complexity of nature Many objects in nature present high complexity and self-similarity and can be modelled by fractals Fractal dimension measures the complexity or spatial occupation Joao B.

..Fractal Descriptors Fractal Descriptors Fractal dimension alone is scale-dependent and it is not sufficient in more complex problems Multiscale Fractal Dimension [Bruno et al. Florindo Fractal Descriptors Applied to Image Analysis 13 / 45 . 2008] Joao B. 2008] Figure based on [Bruno et al.

etc. Complete mapping of object complexity. Florindo Fractal Descriptors Applied to Image Analysis 14 / 45 . either in microstructures or in a global viewpoint Joao B.Fractal Descriptors Fractal Descriptors Descriptors derived from the definition of descriptors in images: Fourier. It uses the entire fractality curve Descriptors u : log() → log(M). wavelets.

Florindo COLOUR Fractal Descriptors Applied to Image Analysis 15 / 45 .Fractal Descriptors Fractal Descriptors SPECTRUM TEXTURE IMAGE SHAPE Joao B.

Florindo COLOUR Fractal Descriptors Applied to Image Analysis 16 / 45 .Fractal Descriptors Fractal Descriptors: Texture SPECTRUM TEXTURE IMAGE SHAPE Joao B.

Florindo Z ψ( < t −b )u(t)dt a Fractal Descriptors Applied to Image Analysis 17 / 45 .Fractal Descriptors Fractal Descriptors: Multiscale transform Multiscale transform [Florindo and Bruno. a) = g ∗ (t − b)u(t)e −2πat dt −∞ Time-scale 1 U(b. 2013b] Space-scale Z +∞ U(b. a) = a Joao B. a) = u 0 (t − b)ga dt n=−∞ Time-frequency Z +∞ U(b.

2011] Measures on log-log curve are addressed through an analytical function The descriptors are obtained from the coefficients of the projection onto a set of basis functions FDA yji = u i (xji ) + ij 0 ui = q X 0 αj (u i )φj j=1 β(u) = Sα(u) Joao B.Fractal Descriptors Fractal Descriptors: FDA Functional data analysis [Florindo et al.. Florindo Fractal Descriptors Applied to Image Analysis 18 / 45 .

0 0..8 0.8 0.6 10 20 30 40 50 60 70 80 D1M 90 0 10 20 30 40 50 D1ρ k k 60 70 80 0. K(ψ→n)] Joao B. Florindo Fractal Descriptors Applied to Image Analysis 19 / 45 .0 1.0 1.0 0.6 D(k) 0.6 70 80 90 60 70 80 90 0.2 D(k) k 1.2 0 0 0... DlmaxM(i)] → ψ i = [D1ρ(i) D2ρ(i) .4 0.2 0 10 20 30 40 50 60 k 70 80 0 90 10 20 30 40 50 0.4 0 D(k) 10 D(k) 0 D(k) 60 k 1.2 10 20 30 40 50 90 D2M k 60 70 80 90 0 10 20 30 40 D2ρ 50 60 70 80 90 1.0 0.0 0.6 0.4 0.4 0...0 1.2 10 20 30 40 50 k 60 70 80 90 0 10 20 30 k 40 50 60 70 80 90 k DlmaxM Dlmaxρ → φ i = [D1M(i) D2M(i) .2 0.. 2013a] .4 0..8 0.8 0.8 0.2 0.4 0.0 0.6 0. Dlmaxρ(i)] → EFV = [K(φ→1) K(φ→2) .2 0.4 0.6 0.4 0.6 D(k) 0. K(φ→n) K(ψ→1) K(ψ→2) .8 0.0 1.Fractal Descriptors Fractal Descriptors: Multilevels Multilevel descriptors [Florindo and Bruno.4 0.8 0.0 D(k) 0. 1..8 0..6 0.8 0.6 0..8 0.6 D(k) 1.2 20 30 40 50 60 70 80 0 90 10 20 30 40 50 k 1.2 D(k) D(k) 0.4 0.

and segmentation TRAINING TESTING WINDOWS WINDOWS DESCRIPTORS DESCRIPTORS CLASSIFIER Joao B. as usual in nanotechnology. Florindo Fractal Descriptors Applied to Image Analysis 20 / 45 .Fractal Descriptors Fractal Descriptors: Window-based Used in large dimension images.

Fractal Descriptors Fractal Descriptors: Colour SPECTRUM TEXTURE IMAGE SHAPE Joao B. Florindo COLOUR Fractal Descriptors Applied to Image Analysis 21 / 45 .

Florindo Fractal Descriptors Applied to Image Analysis 22 / 45 . 2011b] Joao B.Fractal Descriptors Fractal Descriptors: Colour Combining descriptors from EEE channels [Florindo and Bruno.

Florindo COLOUR Fractal Descriptors Applied to Image Analysis 23 / 45 .Fractal Descriptors Fractal Descriptors: Shapes SPECTRUM TEXTURE IMAGE SHAPE Joao B.

Florindo Fractal Descriptors Applied to Image Analysis 24 / 45 .Fractal Descriptors Fractal Descriptors: Curvature (shapes) Curvature fractal descriptors [Backes et al. 2012] Joao B..

Florindo COLOUR Fractal Descriptors Applied to Image Analysis 25 / 45 .Fractal Descriptors Fractal Descriptors: Spectrum SPECTRUM TEXTURE IMAGE SHAPE Joao B.

Fractal Descriptors Fractal Descriptors: Gabor Gabor-transformed fractal descriptors [Zuniga et al. 2014] Joao B.. Florindo Fractal Descriptors Applied to Image Analysis 26 / 45 .

Results Results: Brodatz Joao B. Florindo Fractal Descriptors Applied to Image Analysis 27 / 45 .

Results Results: Brodatz 1 T1 0.975 0.995 D(k) 0.99 0. Florindo T1 T2 0 10 20 30 k Fractal Descriptors Applied to Image Analysis 40 50 60 28 / 45 .985 T2 0.97 Joao B.98 0.

92 92.61 92.83 86.28 99.10 94.46 99.95 Fractal Descriptors Applied to Image Analysis 29 / 45 .46 99.28 99.61 89. Florindo Method Multifractals LBP Fourier GLCM Gabor ND 17 20 16 20 7 CR (%) 92.16 Lacunarity+Multilevels Brownian+Multilevels Fourier+Multilevels Probability+Multilevels + TS Bouligand-Minkowski+Multilevels + TS Triangular+Multilevels Lacunarity+Wavelets + TS 11 19 20 16 20 19 13 99.75 84.52 82.10 98.Results Results: Brodatz KNN Joao B.46 99.85 Bouligand-Minkowski Multilevels + TS Probability + TS Lacunarity + TS Wavelets + TS Triangular + TF Fourier 14 18 8 10 8 10 10 99.01 88.25 87.14 82.

Results Results: Taxonomy [Florindo et al.. 2014] Joao B. Florindo Fractal Descriptors Applied to Image Analysis 30 / 45 .

2010] Joao B. Florindo Fractal Descriptors Applied to Image Analysis 31 / 45 ..Results Results: Taxonomy [Florindo et al.

Florindo Fractal Descriptors Applied to Image Analysis 32 / 45 ..Results Results: Microscopy [Silva et al. 2014] Joao B.

2 -0.4 D(r) 0.Results Results: Nanotechnology [Florindo et al. 2013] 0.2 0 -0. Florindo 20 40 r 60 Fractal Descriptors Applied to Image Analysis 33 / 45 ..4 0 Joao B.

Results Results: Segmentation Joao B. Florindo Fractal Descriptors Applied to Image Analysis 34 / 45 .

Other Works Other Complexity-Based Methods Fractal Geometry is an example of complexity modelling Here ”complexity” means the degree of heterogeneity of a texture or irregularity of a shape Other examples of complexity-based methods are Complex Networks. 2005].. etc. Complex Networks and Fractal Geometry are related [Song et al. Joao B. Florindo Fractal Descriptors Applied to Image Analysis 35 / 45 . Deterministic Partially Self-avoiding Walks.

Florindo Fractal Descriptors Applied to Image Analysis 36 / 45 .Other Works Other Complexity-Based Methods DIFFUSION DYNAMIC Joao B.

Other Works Other Complexity-Based Methods BOX-COVERING log NB (lB ) lB →0 log lB D ∝ lim Joao B. Florindo Fractal Descriptors Applied to Image Analysis 37 / 45 .

Florindo log k(d) log d Fractal Descriptors Applied to Image Analysis 38 / 45 .Other Works Other Complexity-Based Methods CLUSTERING COEFFICIENT D ∝ lim d→0 Joao B.

Florindo Fractal Descriptors Applied to Image Analysis 39 / 45 .Conclusions Conclusions Fractal descriptors express all the complexity of the object They capture nuances at different levels of scale They discriminate among complex materials automatically and with high precision Inexpensive technique (both in terms of computational and money resources) and providing promising results in different applications Joao B.

Conclusions Thank you all! Questions .. Florindo Fractal Descriptors Applied to Image Analysis 40 / 45 . Joao B..

M. O. and de Castro. (2013a). R. Fractal dimension applied to plant identification... Expert Systems with Applications. Florindo. A. O. 178(12):2722–2733. J. B. M. Florindo Fractal Descriptors Applied to Image Analysis 41 / 45 . (2008).. 40(10):4022–4028. Sci. and Bruno. Chaos. Bruno. R.Bibliography Bibliography I Backes. Inf. (2012). O. and Bruno. Falvo. M. Florindo. Texture analysis by multi-resolution fractal descriptors. 22(1):043103. de Oliveira Plotze. J... M. Shape analysis using fractal dimension: a curvature based approach. Joao B.

and Bruno. SPRINGER-VERLAG BERLIN. Backes. Leaves shape classification using curvature and fractal dimension. O. Florindo. D-14197 BERLIN. J. R. 21(4):1–10. 44(10):851–861. pages 456–462. O. Chaos.. (2010). Fractal descriptors in the fourier domain applied to color texture analysis. A. and Bruno. M. Chaos Solitons & Fractals. (2011a).Bibliography Bibliography II Florindo. M. Joao B. volume 6134 of Lecture Notes in Computer Science. B. B. In IMAGE AND SIGNAL PROCESSING. J. and Bruno. GERMANY. B.. M. Closed contour fractal dimension estimation by the fourier transform. J. Florindo. Florindo Fractal Descriptors Applied to Image Analysis 42 / 45 . PROCEEDINGS. HEIDELBERGER PLATZ 3. (2011b). O.

. O. M.. M. Herling. and Bruno. Florindo. Computers and Electronics in Agriculture. da Silva. V. Florindo Fractal Descriptors Applied to Image Analysis 43 / 45 . H. de Cerqueira Luz. Joao B.. O. Brachiaria species identification using imaging techniques based on fractal descriptors.. Romualdo. N. M. B. De Castro. J. (2013b). F. Journal of Physics: Conference Series. M. J. B. L. 410(1):012022. 103(0):48 – 54. 22(9):929–952... J. (2011). Multiscale fractal descriptors applied to texture classification. and Bruno. B. O. Florindo.Bibliography Bibliography III Florindo. P. R. International Journal of Modern Physics C... de Fatima da Silva. and Bruno. (2014). Enhancing volumetric bouligand-minkowski fractal descriptors by using functional data analysis. R. M.

Characterization of nanostructured material images using fractal descriptors. M. 490(1):012085.. 392(7):1694 – 1701.. M. R. E. Florindo Fractal Descriptors Applied to Image Analysis 44 / 45 . Joao B. M.. M. and Bruno. (2013).. B. S. Kolb. B. and Bruno. Freeman.. R. The Fractal Geometry of Nature. (2014). C. C. O. (1982).Bibliography Bibliography IV Florindo. Florindo. B. Physica A: Statistical Mechanics and its Applications. N. Silva. Sikora. Mandelbrot. G´ omez. Journal of Physics: Conference Series.. O. Fractal descriptors for discrimination of microscopy images of plant leaves. B. J. J. M.. Pereira.

Zuniga. (2009).Bibliography Bibliography V Song.. and Bruno. Viewpoint invariant texture description using fractal analysis. Joao B. Int. Havlin. Florindo Fractal Descriptors Applied to Image Analysis 45 / 45 . J. (2007). and Zhao. S. A. Comput. Ji. L. C. M. Computerized Medical Imaging and Graphics.. O. Y. S. J.. and Makse.. 36:135–143. Vision. A... Nature. Pattern Recognition Letters. Gabor wavelets combined with volumetric fractal dimension applied to texture analysis. N. and Ferm¨ uller. C. Florindo. Wa. H. 31(8):665–671. Fractal research of pathological tissue images. G.. Self-similarity of complex networks. B. Xu. 83(1):85–100. Tian-Gang. 433(7024):392–395. (2014). (2005). H..

Sign up to vote on this title
UsefulNot useful