A

Presentation on
Rational Fractal Interpolation Based
Single-Image Super-Resolution

by
Suraj Rathaur, M.Tech ECE 1st Year
 2
Contents
• Introduction
• Rational Fractal Interpolation
• Image Interpolation
• Pixel Mapping
• Experimental Results
• Challenges
• Conclusion
 3
Introduction
• What is super resolution?
-Generating high resolution(HR)
image with more resolving power
using one or more low
resolution(LR) images

-More resolving power- more details

 4
Introduction (contd.)
• Why Super Resolution?

Super-Resolution

Low-Resolution

High-Resolution
Fig. 1. Super-resolution Example
 5
Introduction (contd.)
Applications:
• Satellite image processing
-LANDSAT and remote sensing

Fig. 2. SR for satellite image

 6
Introduction (contd.)
Applications:
• Medical image processing
-Magnetic resonance imaging (MRI)
-Computed tomography (CT) and X-ray

Fig. 3. SR in medical imaging

 7
Introduction (contd.)
Applications:
• Microscopy image processing
-To visualize the biological structures
including cell and tissue

Fig. 4. SR in Microscopy
 8
Introduction (contd.)
Applications:
• Multimedia industry
-video enhancement
• Video surveillance
-Preserving people security
-Solving criminal cases
 9
Introduction (contd.)
Applications:
• Astrological studies
-To visualize many tightly grouped stars
and far away objects in a better way
LR image SR image

Fig. 5. SR in Astronomy
 10
Introduction (contd.)

• Two main categories of SR methods:

(i) Interpolation-based methods
-Bi-linear and bi-cubic interpolation
-Edge-directed interpolation
-Rational function interpolation
 11
Introduction (contd.)
(ii) Learning-based methods
-Regression-based methods
-Sparse representation-based methods
-Patch-based SR methods

• improve the visual effects

• degrade the quality of HR image when larger
magnification ratios are performed
 12
Rational Fractal Interpolation

• Rational interpolation function

-Preserves image edge structures well
• Fractal function
-Describes image texture
• Reconstructed HR image has fine textural
details and structural information
 13
Rational Fractal Interpolation

Fig. 6. Algorithm framework

• Rational Fractal interpolation
• Rational Interpolation
• Pixel mapping
 14
Image Interpolation
Regional Division :
• Isoline method is used to detect textural
and structural information.
• Procedure:

Fig. 7. Texture detection

 15
Image Interpolation (Contd.)
Regional Division:
• For LR image patch, average pixel value is given as:
σ5𝑚=1 σ5𝑛=1 𝑓𝑚,𝑛
𝜆=
5×5
where 𝑓𝑚,𝑛 is pixel value at point (m, n), m,n=1,2,. . .,5,
• Let Δ𝑥𝑚,𝑛 = 𝑓𝑚,𝑛 − 𝜆, m, n=1, 2, 3,
• Then,
𝑛𝑜𝑛 − 𝑡𝑒𝑥𝑡𝑢𝑟𝑒 𝑟𝑒𝑔𝑖𝑜𝑛, Δ𝑥𝑚,𝑛 ≥ 0 𝑜𝑟 Δ𝑥𝑚,𝑛 ≤ 0, ∀𝑚, 𝑛,
( 𝑡𝑒𝑥𝑡𝑢𝑟𝑒 𝑟𝑒𝑔𝑖𝑜𝑛, 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
 16
Image Interpolation (Contd.)
Scaling factor calculation:

Fig. 8. Scaling factors

 17
Image Interpolation (Contd.)
Interpolation model:

Fig. 9. Rational fractal interpolation model

 18
Pixel mapping

Fig. 10. Process of pixel mapping

 19
Experimental Results
Down sampling:

Low-Resolution image

Original image
 20
Experimental Results
Super-resolution using rational fractal interpolation :

Super-Resolution

Low-Resolution

High-Resolution
Fig. 1. Super-resolution Example
 21
Experimental Results
Performance parameters:
• Peak signal-to-noise ratio
(PSNR)=29.4126
• Feature similarity index
(FSIM)=0.9321
• Structure similarity index
(SSIM)=0.9316
 22
Challenges

• Selection of the methods for regional

division
• Shape parameters affect the rational
fractal interpolation function.
• Selection of shape parameters
• Calculation of scaling factors
 23
Conclusion

• The Rational fractal interpolation function is

an Iterated Function System (IFS), the
image can be amplified at any integral
multiple by selecting a suitable mapping.

• This algorithm will achieve competitive

performance and generates high-quality SR
images with sharp edges and rich texture.
 24

THANK YOU