Académique Documents
Professionnel Documents
Culture Documents
Dorit Moshe
In today’s show
Denoising – definition
Denoising using wavelets vs. other methods
Denoising process
Soft/Hard thresholding
Known thresholds
Examples and comparison of denoising methods
using WL
Advanced applications
2 different simulations
Summary
24 April 2019 2
In today’s show
Denoising – definition
Denoising using wavelets vs. other methods
Denoising process
Soft/Hard thresholding
Known thresholds
Examples and comparison of denoising methods
using WL
Advanced applications
2 different simulations
Summary
24 April 2019 3
Denoising
Denosing is the process with which we reconstruct a signal from a
noisy one.
original
denoised
24 April 2019 4
In today’s show
Denoising – definition
Denoising using wavelets vs. other methods
Denoising process
Soft/Hard thresholding
Known thresholds
Examples and comparison of denoising methods
using WL
Advanced applications
2 different simulations
Summary
24 April 2019 5
Old denoising methods
24 April 2019 6
Fourier based signal processing
24 April 2019 7
Motivation
Non-linear method
The spectra can overlap.
The idea is to have the amplitude, rather than the
location of the spectra be as different as possible
for that of the noise.
This allows shrinking of the amplitude of the
transform to separate signals or remove noise.
24 April 2019 8
original
24 April 2019 9
noisy
Fourier filtering –
Spline method - suppresses
leaves features sharp
noise, by broadening,
but doesn’t really
erasing certain features suppress the noise
24 April 2019 10
denoised
Here we use Haar-basis
shrinkage method
original
24 April 2019 11
Why wavelets?
Wavelet denoising works for additive noise since wavelet transform is linear
White noise means the noise values are not correlated in time
Whiteness means noise has equal power at all frequencies.
Considered the most difficult to remove, due to the fact that it
affects every single frequency component over the whole
length of the signal.
24 April 2019 15
Denoising process
24 April 2019 17
We define the risk measure :
R ( Xˆ , X ) E[|| x xˆ || 22 ]
E[|| W 1 ( Xˆ X ) || 22 ] E[|| Xˆ X || 22 ]
i
|| Y X || 2
|| N i 2,
|| 2
Xi
E[|| Y X || 2 ]
2 i 2
|| 0 X ||
i 2
2
|| X i 2,
|| 2
Xi
i 1xi
N
Rid ( Xˆ , X ) min( X 2 , 2 )
n 1
18 24 April 2019
3 step general method
24 April 2019 19
Questions
24 April 2019 20
In today’s show
Denoising – definition
Denoising using wavelets vs. other methods
Denoising process
Soft/Hard thresholding
Known thresholds
Examples and comparison of denoising methods
using WL
Advanced applications
2 different simulations
Summary
24 April 2019 21
Thresholding Methods
24 April 2019 22
Hard Thresholding
x(t ), | x(t ) |
yhard (t )
0, | x(t ) |
=0.28
24 April 2019 23
Soft Thresholding
24 April 2019 24
Soft Or Hard threshold?
24 April 2019 25
24 April 2019 26
Edges aren’t kept.
However, the noise
was almost fully
suppressed
24 April 2019 27
In today’s show
Denoising – definition
Denoising using wavelets vs. other methods
Denoising process
Soft/Hard thresholding
Known thresholds
Examples and comparison of denoising methods
using WL
Advanced applications
2 different simulations
Summary
24 April 2019 28
Known soft thresholds
No need to calculate λ
foreach level (sub-band)!!
24 April 2019 30
SureShrink
24 April 2019 33
In today’s show
Denoising – definition
Denoising using wavelets vs. other methods
Denoising process
Soft/Hard thresholding
Known thresholds
Examples and comparison of denoising methods
using WL
Advanced applications
2 different simulations
Summary
24 April 2019 34
Example
24 April 2019 35
Difference!!
More examples
Original
signals
24 April 2019 36
Noisy
signals
N = 2048 = 211
37 24 April 2019
Denoised
signals
Soft threshold
38 24 April 2019
The reconstructions have two properties:
1. The noise has been almost entirely suppressed
2. Features sharp in the original remain sharp in
reconstruction
24 April 2019 39
Why it works (I)
Data compression
24 April 2019 40
The Haar transform of the noiseless object Blocks
compresses the l2 energy of the signal into a very
small number of consequently) very large
coefficients.
On the other hand, Gaussian white noise in any one
orthogonal basis is again a white noise in any other.
In the Haar basis, the few nonzero signal coefficients
really stick up above the noise
the thresholding kills the noise while not killing the
signal
24 April 2019 41
Formal:
Data: di = θi + εzi , i=1,…,n
zi standard white noise
Goal : recovering θi
Ideal diagonal projector : keep all coefficients
where θi is larger in amplitude than ε and ‘kill’ the
rest.
The ideal is unattainable since it requires
knowledge on θ which we don’t know
24 April 2019 42
The ideal mean square error is
24 April 2019 43
Setting
db
db fourier
Haar
Haar fourier
24 April 2019 45
Another aspect - Vanishing
Moments
(t )dt
m
t
The mthmoment of a wavelet is defined as
If the first M moments of a wavelet are zero, then all
polynomial type signals of the form x(t ) cmt m
0 m M
24 April 2019 47
Original singal
24 April 2019 50
Example :
we want to reconstruct the discrete signal (xi)i=0..n-1, given
the noisy data :
24 April 2019 56
We will describe a variety of wavelet and
wavelet packet based denoising methods and
compare them with each other by applying
them to a simulated, noised signal
f is a known signal. The noise is a free
parameter
The results help us choose the best wavelet,
best denoising method and a suitable denoising
threshold in pratictical applications.
24 April 2019 57
A noised singal ƒi i=0,…,2jmax-1
Wavelet
Wavelet pkt
24 April 2019 58
Denoising methods
WL
24 April 2019 59
In packet wavelets, fine scaled signal structures can
be represented not only by fine scale coefficients but
also by coarse scale coefficients with high
frequency. Therefore, it is necessary to eliminate not
only fine scale coefficients through linear denoising,
but also coefficients of a scale and frequency
combination which refer to a certain fine scale
structure.
PL
24 April 2019 60
Non linear – cutting of the coefficients (hard or soft), threshold = λ
24 April 2019 61
Measuring denoising errors
Lp norms (p=1,2) :
Entropy -
24 April 2019 62
Choosing the best threshold
and basis
Using Monte Carlo simulation DB with 3 vanishing
moments has been chosen for PNLS method.
Min Error
24 April 2019 63
Threshold – universal soft threshold
For normally distibuted noise, λu = 0.008
However, it seems that λu lies above the optimal
threshold.
Using monte carlo to evaluate the ‘best’ threshold
for PNLS, 0.003 is the best
DJ WP
close
to the
Best!!
66 24 April 2019
Improvements
Original Denoised
24 April 2019 67
• Solution : the artifacts live only on fine scales,
we can adapt λ to the scale j λ j = λ * µj
24 April 2019 74
[DJ] In this case, VIS performs best.
24 April 2019 75
Denoising Implementation
in Matlab
First,
analyze the
signal with
appropriate
wavelets
Hit
Denoise
24 April 2019 76
Choose
thresholding
method
Choose
noise type
Choose
thresholds
Hit
Denoise
24 April 2019 77
24 April 2019 78
In today’s show
Denoising – definition
Denoising using wavelets vs. other methods
Denoising process
Soft/Hard thresholding
Known thresholds
Examples and comparison of denoising methods
using WL
Advanced applications
2 different simulations
Summary
24 April 2019 79
Summary
24 April 2019 80
81 24 April 2019
Bibliography
Nonlinear Wavelet Methods for Recovering Signals, Images, and
Densities from indirect and noisy data [D94]
Filtering (Denoising) in the Wavelet Transform Domain Yousef M.
Hawwar, Ali M. Reza, Robert D. Turney
Comparison and Assessment of Various Wavelet and Wavelet Packet
based Denoising Algorithms for Noisy Data F. Hess, M. Kraft, M.
Richter, H. Bockhorn
De-Noising via Soft-Thresholding, Tech. Rept., Statistics, Stanford,
1992.
Adapting to unknown smoothness by wavelet shrinkage, Tech. Rept.,
Statistics, Stanford, 1992. D. L. Donoho and I. M. Johnstone
Denoising by wavelet transform [Junhui Qian]
Filtering denoising in the WL transform domain[Hawwr,Reza,Turney]
The What,how,and why of wavelet shrinkage denoising[Carl Taswell,
2000]
24 April 2019 82