Fractal Descriptors Applied to Image Analysis

Joao B. Florindo
Physics Institute of Sao Carlos - University of Sao Paulo - Brazil
College of Medical and Dental Sciences - University of Birmingham
jbflorindo@gmail.com
http://scg.ifsc.usp.br

Joao B. Florindo

Fractal Descriptors Applied to Image Analysis

1 / 45

Joao B. Florindo

Fractal Descriptors Applied to Image Analysis

2 / 45

University of Sao Paulo
Top university in Latin-America (QS World University Rankings)
Numbers (approximate):
Established as university in 1934
93,000 students (30,000 PhD)
Total area: 76 million m2

Joao B. Florindo

Fractal Descriptors Applied to Image Analysis

3 / 45

1

Introduction

2

Fractal Geometry

3

Fractal Descriptors

4

Results

5

Other Works

6

Conclusions

7

Bibliography

Joao B. Florindo

Fractal Descriptors Applied to Image Analysis

4 / 45

Introduction Introduction Fractals are geometrical objects defined within an infinite range of scales Complex and self-similar structures at any scale Joao B. Florindo Fractal Descriptors Applied to Image Analysis 5 / 45 .

Introduction Introduction Joao B. Florindo Fractal Descriptors Applied to Image Analysis 6 / 45 .

Florindo Fractal Descriptors Applied to Image Analysis 7 / 45 .Introduction Introduction Nature shows many fractal-like processes [Mandelbrot. 1982] Complex and self-similar objects (within a limited range of scales) Joao B.

2009] Good results in texture and shape analysis [Xu et al. Xu et al.. 2009. Backes et al. Florindo SHAPES Fractal Descriptors Applied to Image Analysis 8 / 45 . 2007...Introduction Introduction Fractal Theory has been widely applied to image analysis [Tian-Gang et al.. 2012] TEXTURES Joao B. 2013a. Florindo and Bruno.

1982] This can be adapted to describe objects in nature Limited information / scale-dependent Multifractals.Introduction Introduction The most important measure of a fractal is its dimension[Mandelbrot. fractal descriptors Joao B. multiscale fractal dimension. Florindo Fractal Descriptors Applied to Image Analysis 9 / 45 .

it is a real non-negative number provided by the Hausdorff-Besicovitch dimension Such concept cannot be directly applied to finite objects (and images) but can be approximated Joao B.Fractal Geometry Fractal Geometry Fractal dimension measures how the amount of details in the object changes according to scale Mathematically. Florindo Fractal Descriptors Applied to Image Analysis 10 / 45 .

Fractal Geometry Fractal Geometry A general expression can be defined for real-world objects (fractal-like) and applied to the respective image representation D ∝ lim →0 Joao B. Florindo log(M()) log() Fractal Descriptors Applied to Image Analysis 11 / 45 .

Florindo Fractal Descriptors Applied to Image Analysis 12 / 45 .Fractal Geometry Fractal Geometry Fractal Geometry in Computer Vision Euclidean Geometry is limited to describe the complexity of nature Many objects in nature present high complexity and self-similarity and can be modelled by fractals Fractal dimension measures the complexity or spatial occupation Joao B.

. 2008] Figure based on [Bruno et al.Fractal Descriptors Fractal Descriptors Fractal dimension alone is scale-dependent and it is not sufficient in more complex problems Multiscale Fractal Dimension [Bruno et al. 2008] Joao B. Florindo Fractal Descriptors Applied to Image Analysis 13 / 45 ..

etc. It uses the entire fractality curve Descriptors u : log() → log(M). Florindo Fractal Descriptors Applied to Image Analysis 14 / 45 . Complete mapping of object complexity. wavelets. either in microstructures or in a global viewpoint Joao B.Fractal Descriptors Fractal Descriptors Descriptors derived from the definition of descriptors in images: Fourier.

Florindo COLOUR Fractal Descriptors Applied to Image Analysis 15 / 45 .Fractal Descriptors Fractal Descriptors SPECTRUM TEXTURE IMAGE SHAPE Joao B.

Florindo COLOUR Fractal Descriptors Applied to Image Analysis 16 / 45 .Fractal Descriptors Fractal Descriptors: Texture SPECTRUM TEXTURE IMAGE SHAPE Joao B.

a) = g ∗ (t − b)u(t)e −2πat dt −∞ Time-scale 1 U(b.Fractal Descriptors Fractal Descriptors: Multiscale transform Multiscale transform [Florindo and Bruno. a) = u 0 (t − b)ga dt n=−∞ Time-frequency Z +∞ U(b. Florindo Z ψ( < t −b )u(t)dt a Fractal Descriptors Applied to Image Analysis 17 / 45 . a) = a Joao B. 2013b] Space-scale Z +∞ U(b.

. 2011] Measures on log-log curve are addressed through an analytical function The descriptors are obtained from the coefficients of the projection onto a set of basis functions FDA yji = u i (xji ) + ij 0 ui = q X 0 αj (u i )φj j=1 β(u) = Sα(u) Joao B.Fractal Descriptors Fractal Descriptors: FDA Functional data analysis [Florindo et al. Florindo Fractal Descriptors Applied to Image Analysis 18 / 45 .

4 0.2 0.0 0..6 70 80 90 60 70 80 90 0.Fractal Descriptors Fractal Descriptors: Multilevels Multilevel descriptors [Florindo and Bruno.0 0.8 0.8 0.0 0.2 0.. 1.4 0..0 1.6 D(k) 0. K(φ→n) K(ψ→1) K(ψ→2) .6 0..2 10 20 30 40 50 k 60 70 80 90 0 10 20 30 k 40 50 60 70 80 90 k DlmaxM Dlmaxρ → φ i = [D1M(i) D2M(i) ..0 1.2 0.2 10 20 30 40 50 90 D2M k 60 70 80 90 0 10 20 30 40 D2ρ 50 60 70 80 90 1..4 0 D(k) 10 D(k) 0 D(k) 60 k 1.4 0. Dlmaxρ(i)] → EFV = [K(φ→1) K(φ→2) .8 0.6 D(k) 1.4 0.2 0 10 20 30 40 50 60 k 70 80 0 90 10 20 30 40 50 0.0 0.4 0.8 0..0 D(k) 0. Florindo Fractal Descriptors Applied to Image Analysis 19 / 45 .6 D(k) 0.8 0.8 0.8 0. DlmaxM(i)] → ψ i = [D1ρ(i) D2ρ(i) . K(ψ→n)] Joao B.8 0.2 0 0 0.2 20 30 40 50 60 70 80 0 90 10 20 30 40 50 k 1.4 0.6 0.4 0.8 0. 2013a] .6 0.0 1.2 D(k) k 1.6 0.8 0.6 0.4 0..0 0.6 10 20 30 40 50 60 70 80 D1M 90 0 10 20 30 40 50 D1ρ k k 60 70 80 0.4 0.0 1...2 D(k) D(k) 0.

Fractal Descriptors Fractal Descriptors: Window-based Used in large dimension images. Florindo Fractal Descriptors Applied to Image Analysis 20 / 45 . and segmentation TRAINING TESTING WINDOWS WINDOWS DESCRIPTORS DESCRIPTORS CLASSIFIER Joao B. as usual in nanotechnology.

Florindo COLOUR Fractal Descriptors Applied to Image Analysis 21 / 45 .Fractal Descriptors Fractal Descriptors: Colour SPECTRUM TEXTURE IMAGE SHAPE Joao B.

Fractal Descriptors Fractal Descriptors: Colour Combining descriptors from EEE channels [Florindo and Bruno. 2011b] Joao B. Florindo Fractal Descriptors Applied to Image Analysis 22 / 45 .

Florindo COLOUR Fractal Descriptors Applied to Image Analysis 23 / 45 .Fractal Descriptors Fractal Descriptors: Shapes SPECTRUM TEXTURE IMAGE SHAPE Joao B.

Florindo Fractal Descriptors Applied to Image Analysis 24 / 45 .. 2012] Joao B.Fractal Descriptors Fractal Descriptors: Curvature (shapes) Curvature fractal descriptors [Backes et al.

Florindo COLOUR Fractal Descriptors Applied to Image Analysis 25 / 45 .Fractal Descriptors Fractal Descriptors: Spectrum SPECTRUM TEXTURE IMAGE SHAPE Joao B.

Florindo Fractal Descriptors Applied to Image Analysis 26 / 45 ..Fractal Descriptors Fractal Descriptors: Gabor Gabor-transformed fractal descriptors [Zuniga et al. 2014] Joao B.

Florindo Fractal Descriptors Applied to Image Analysis 27 / 45 .Results Results: Brodatz Joao B.

995 D(k) 0.99 0. Florindo T1 T2 0 10 20 30 k Fractal Descriptors Applied to Image Analysis 40 50 60 28 / 45 .97 Joao B.975 0.985 T2 0.Results Results: Brodatz 1 T1 0.98 0.

46 99. Florindo Method Multifractals LBP Fourier GLCM Gabor ND 17 20 16 20 7 CR (%) 92.10 94.46 99.01 88.92 92.28 99.61 89.75 84.95 Fractal Descriptors Applied to Image Analysis 29 / 45 .52 82.46 99.85 Bouligand-Minkowski Multilevels + TS Probability + TS Lacunarity + TS Wavelets + TS Triangular + TF Fourier 14 18 8 10 8 10 10 99.28 99.14 82.Results Results: Brodatz KNN Joao B.10 98.25 87.16 Lacunarity+Multilevels Brownian+Multilevels Fourier+Multilevels Probability+Multilevels + TS Bouligand-Minkowski+Multilevels + TS Triangular+Multilevels Lacunarity+Wavelets + TS 11 19 20 16 20 19 13 99.83 86.61 92.

. 2014] Joao B. Florindo Fractal Descriptors Applied to Image Analysis 30 / 45 .Results Results: Taxonomy [Florindo et al.

Florindo Fractal Descriptors Applied to Image Analysis 31 / 45 .Results Results: Taxonomy [Florindo et al. 2010] Joao B..

2014] Joao B. Florindo Fractal Descriptors Applied to Image Analysis 32 / 45 ..Results Results: Microscopy [Silva et al.

Florindo 20 40 r 60 Fractal Descriptors Applied to Image Analysis 33 / 45 .4 0 Joao B.2 -0.. 2013] 0.4 D(r) 0.Results Results: Nanotechnology [Florindo et al.2 0 -0.

Results Results: Segmentation Joao B. Florindo Fractal Descriptors Applied to Image Analysis 34 / 45 .

Joao B. Complex Networks and Fractal Geometry are related [Song et al. Deterministic Partially Self-avoiding Walks. etc. Florindo Fractal Descriptors Applied to Image Analysis 35 / 45 .Other Works Other Complexity-Based Methods Fractal Geometry is an example of complexity modelling Here ”complexity” means the degree of heterogeneity of a texture or irregularity of a shape Other examples of complexity-based methods are Complex Networks.. 2005].

Florindo Fractal Descriptors Applied to Image Analysis 36 / 45 .Other Works Other Complexity-Based Methods DIFFUSION DYNAMIC Joao B.

Florindo Fractal Descriptors Applied to Image Analysis 37 / 45 .Other Works Other Complexity-Based Methods BOX-COVERING log NB (lB ) lB →0 log lB D ∝ lim Joao B.

Other Works Other Complexity-Based Methods CLUSTERING COEFFICIENT D ∝ lim d→0 Joao B. Florindo log k(d) log d Fractal Descriptors Applied to Image Analysis 38 / 45 .

Florindo Fractal Descriptors Applied to Image Analysis 39 / 45 .Conclusions Conclusions Fractal descriptors express all the complexity of the object They capture nuances at different levels of scale They discriminate among complex materials automatically and with high precision Inexpensive technique (both in terms of computational and money resources) and providing promising results in different applications Joao B.

. Florindo Fractal Descriptors Applied to Image Analysis 40 / 45 .Conclusions Thank you all! Questions .. Joao B.

and de Castro. O. Expert Systems with Applications.. Fractal dimension applied to plant identification. Florindo. Shape analysis using fractal dimension: a curvature based approach. 178(12):2722–2733. O. M. Falvo. Inf. Joao B. R. Chaos. de Oliveira Plotze. Sci. R.Bibliography Bibliography I Backes. J. (2008).. and Bruno. Florindo. Bruno. Texture analysis by multi-resolution fractal descriptors.... M. 22(1):043103. Florindo Fractal Descriptors Applied to Image Analysis 41 / 45 . and Bruno. B. A. 40(10):4022–4028. (2012). J. M. (2013a). M. O.

HEIDELBERGER PLATZ 3. B. Leaves shape classification using curvature and fractal dimension.. R. A. Florindo.Bibliography Bibliography II Florindo. M. GERMANY. B. 21(4):1–10. and Bruno. volume 6134 of Lecture Notes in Computer Science. (2010). J. O. J. D-14197 BERLIN. J. and Bruno. O. Florindo. Joao B. O. M. Closed contour fractal dimension estimation by the fourier transform. SPRINGER-VERLAG BERLIN. Chaos Solitons & Fractals.. Florindo Fractal Descriptors Applied to Image Analysis 42 / 45 . and Bruno. M. Chaos. (2011b). PROCEEDINGS. 44(10):851–861. B. Backes. Fractal descriptors in the fourier domain applied to color texture analysis. In IMAGE AND SIGNAL PROCESSING. (2011a). pages 456–462.

O..Bibliography Bibliography III Florindo. M. Herling.. O.. Multiscale fractal descriptors applied to texture classification. de Cerqueira Luz. (2013b). International Journal of Modern Physics C. J. 22(9):929–952. M. and Bruno.. de Fatima da Silva. Florindo. Florindo Fractal Descriptors Applied to Image Analysis 43 / 45 . 410(1):012022. Enhancing volumetric bouligand-minkowski fractal descriptors by using functional data analysis. Brachiaria species identification using imaging techniques based on fractal descriptors. F. Computers and Electronics in Agriculture. B. (2011). M. Journal of Physics: Conference Series. and Bruno. R.. L. M.. Joao B. and Bruno. Florindo. (2014). O... V. da Silva. M. 103(0):48 – 54. B. P. R. J. N. J. De Castro. Romualdo. H. B.

The Fractal Geometry of Nature. J. E. M. M. (2014).Bibliography Bibliography IV Florindo. and Bruno. B... S. Florindo. Silva. Physica A: Statistical Mechanics and its Applications. Joao B. (1982). M. R.. Journal of Physics: Conference Series. C. G´ omez. C. Florindo Fractal Descriptors Applied to Image Analysis 44 / 45 . Freeman.. (2013). Fractal descriptors for discrimination of microscopy images of plant leaves. B. N. Sikora. Kolb. Mandelbrot. O. M. 392(7):1694 – 1701. 490(1):012085. B. O. B. R... and Bruno. Characterization of nanostructured material images using fractal descriptors. Pereira.. J. M.

S. Zuniga. Florindo Fractal Descriptors Applied to Image Analysis 45 / 45 . Computerized Medical Imaging and Graphics. C. (2007). 433(7024):392–395. L. Havlin. A. Florindo.. S. M.. (2009). C.. A. Tian-Gang. and Zhao.. Vision. Nature. Y. Self-similarity of complex networks. O. Gabor wavelets combined with volumetric fractal dimension applied to texture analysis.Bibliography Bibliography V Song. Joao B. (2005). Comput.. J.. Ji. N. and Makse. Xu. Wa.. G. H. and Bruno. Int. 83(1):85–100.. J. 31(8):665–671. B. 36:135–143. H. Viewpoint invariant texture description using fractal analysis. Pattern Recognition Letters. Fractal research of pathological tissue images. and Ferm¨ uller. (2014).

Sign up to vote on this title
UsefulNot useful