Académique Documents
Professionnel Documents
Culture Documents
x
CycIostationary Approach to SignaI
Detection and CIassification in
CognitiveRadio Systems
Hao Hu
8cijing Unitcrsi|q cf Pcs|s an Tc|cccmmunica|icns
P. R. Cnina
1. Introduction
Cognilive radio (CR) is a nevIy energing lechnoIogy (MiloIa & Maguire, 1999, MiloIa,
2OO1), vhich has leen recenlIy proposed lo inpIenenl sone kind of inleIIigence lo
aulonalicaIIy sense, recognize, and nake vise use of any avaiIalIe radio frequency
speclrun. Wilh lhe increasing denand for vireIess appIicalion, access lo avaiIalIe speclrun
is leconing increasingIy difficuIl. On lhe olher hand, nosl Iicensed speclrun go unused
nosl of lhe line according lo lhe ICC's Speclrun IoIicy Task Iorce Reporl (ICC, 2OO3). In
order lo soIve lhese prolIens, cognilive radio is proposed for sharing lhe Iicensed speclrun
lo unIicensed users vilhoul harnfuI inlerference lo Iicensed syslen.
Speclrun sensing is a key eIenenl in cognilive radio syslen vhich enalIes lhe cognilive
radio lo share lhe speclrun in Iicensed lands ly delecling lenporariIy unused speclraI
resources (Haykin, 2OO5, Chaseni & Sousa, 2OO5). RecenlIy, severaI speclrun sensing
lechniques have leen expIored for cognilive radios, such as nalched fiIler deleclion, energy
deleclion and cycIoslalionary fealure deleclion (AkyiIdiz al eI., 2OO6). Many signaIs used in
connunicalion syslens exhilil periodicilies of lheir second order slalislicaI paranelers due
lo lhe operalions such as sanpIing, noduIaling, nuIlipIexing and coding. These
cycIoslalionary properlies, vhich are naned as speclraI correIalion fealures, can le used for
speclrun sensing. Moreover, speclrun sensing can nol le reslricled lo sinpIy nonilor lhe
pover in sone frequency lands of inleresl lul nusl incIude deleclion and idenlificalion in
order lo avoid inlerference (Iehske al eI., 2OO5). Therefore, cycIoslalionary fealure deleclion
is undoulledIy a good soIulion for prinary user signaI deleclion and recognilion. In lhis
chapler, severaI veII-knovn speclrun sensing lechniques are revieved firsl. A survey of
signaI deleclion and cIassificalion for cognilive radios conlining lhe speclraI correIalion
anaIysis and supporl veclor nachine (SVM) is given in Seclion 3. SeveraI speclraI coherence
characlerislic paranelers vhich are sensilive vilh noduIalion lypes and insensilive vilh
SNR varialion are chosen via speclraI correIalion anaIysis. In order lo give leller
perfornance of lhe SVM, an aIignnenl lased kerneI seIeclion nelhod is proposed in Seclion
4, vhich is used lo choose lhe lesl kerneI funclion for lhe SVM vilh speclraI coherence
characlerislic lraining sanpIes. A sinpIe cross-vaIidalion nelhod is aIso inlroduced lo
5
Cognitive Radio Systems 52
choose lhe nosl appropriale kerneI paranelers and penaIly paranelers for lhe SVM. The
perfornance anaIysis of lhe proposed approach is given over lolh Caussian channeI and
ILLL 8O2.22 WRAN channeI in Seclion 5. Conpared lo lhe exisling nelhods incIuding lhe
cIassifiers lased on linary decision lree (DT) and nuIliIayer Iinear perceplron nelvork
(MLIN), lhe proposed approach is nore effeclive in lhe case of Iov SNR and Iiniled
lraining nunlers.
2. Overview of Spectrum Sensing in Cognitive Radio System
Inlerference due lo a cognilive radio nelvork is deened harnfuI if il causes lhe signaI-lo-
inlerference ralio (SIR) al any prinary receiver lo faII leIov a cerlain lhreshoId, vhich
suppIied ly lhe reguIalory lodies. This lhreshoId depends on lhe receiver's roluslness
lovard inlerference and varies fron one prinary land or service lo anolher. In order lo
achieve speclrun sharing, lhe sensilivily of cognilive radio shouId le higher lhan lhal of
prinary receiver. Ior exanpIe, in order lo share lhe radio speclrun lelveen cognilive users
and TV users in ILLL 8O2.22 slandard, lhe sensilivily of cognilive receiver shouId exceed lhe
TV receiver vilhoul hidden lerninaI prolIen. To inprove lhe sensing accuracy, an
addilionaI nargin of 3Od - 4Od shouId le added lo lhe deleclion lhreshoId. Moreover, due
lo lhe dynanic characlerislic of lhe radio environnenl and difference lelveen prinary
users as veII as unknovn infIuence of inlerference, speclrun sensing has lecone a
chaIIenging prolIen in cognilive radio. CeneraIIy, lhe speclrun sensing lechniques can le
cIassified as lransniller deleclion, cooperalive deleclion, and inlerference-lased deleclion,
as shovn in Iig. 1. In lhis chapler, ve focus on lhe lransniller deleclion vhich is connonIy
used in lhe praclicaI syslen. Transniller deleclion approach is lased on lhe deleclion of lhe
veak signaI fron a prinary lransniller. To achieve dynanic speclrun sharing, lhe
cognilive radio lransniller shouId have capaliIily lo delernine if a signaI fron prinary
user is IocaIIy presenl in a cerlain speclrun. asic hypolhesis nodeI for lransniller
deleclion can le defined as foIIovs
O
1
n(l) H
x(l) =
hs(l) + n(l) H
(1)
vhere x(l) is lhe signaI received ly lhe cognilive user, s(l) is lhe lransnilled signaI of lhe
prinary user, n(l) is lhe addilive vhile Caussian noise and h is lhe anpIilude gain of lhe
channeI. H
Q
is a nuII hypolhesis, vhich slales lhal lhere is no Iicensed user signaI in a cerlain
speclrun land. On lhe olher hand, H
a
is an aIlernalive hypolhesis, vhich indicales lhal
lhere exisls sone Iicensed user signaIs.
Three approaches exisl for lransniller deleclion, lased on lhe sensing users' knovIedge on
lhe lransnilled signaIs, vhich are iIIuslraled in Iig. 1.
Cyclostationary Approach to Signal Detection and Classication in CognitiveRadio Systems 53
Iig. 1. Speclrun Sensing Techniques.
2.1 Matched FiIter Detection
When lhe infornalion of lhe prinary user signaI is veII-knovn lo lhe cognilive radio, lhe
nalched fiIler is lhe oplinaI Iinear fiIler for naxinizing lhe signaI lo noise ralio (SNR) in lhe
presence of addilive Caussian noise (Sahai al eI., 2OO4, AkyiIdiz al eI., 2OO6). In cognilive
radio syslen, lhe nalched fiIler is ollained ly correIaling a knovn signaI, or prinary user
signaI lenpIale, vilh an unknovn signaI lo delecl lhe presence of prinary user signaI in lhe
unknovn signaI. This is equivaIenl lo convoIving lhe unknovn signaI vilh a line-reversed
version of lhe lenpIale. According lo lhe hypolhesis nodeI for lransniller deleclion, lhe
received signaI x(n) can le expressed as
O
c 1
v(n) H
x(n) =
1 - s(n) + s (n) +v(n) H
(2)
vhere s(n) and
c
s (n) are originaI signaI and piIol signaI lransnilled ly prinary user, vhich
are orlhogonaI. is lhe ralio of pover aIIocaled lo piIol signaI. The correIalion funclion of
received signaI x(n) and unil veclor of piIol signaI
c
s (n) is given ly
_
N
n=1
c
1
T(x) = x(n)s (n)
N
(3)
The Lqualion (3) can aIso le expressed as
{ }
_
_
N
n=1
N
n=1
c
2
O
c c
2
1
v(n)s (n)
~ N(O, N) H
N
T(x) =
1 - s(n) + s (n) + v(n) s (n)
~ N( I, N) H
N
(4)
Cognitive Radio Systems 54
vhere I is lhe pover of lhe piIol signaI, and a
2
is noise variance. Then lhe decision funclion
can le given ly
1
O
H
H
T(x)
>
<
(5)
vhere lhe lhreshoId \ is delernined ly lhe prolaliIily of faIse aIarn I
IA
. The prolaliIily of
faIse aIarn I
IA
and deleclion I
D
are given as foIIovs
( )
| |
|
\ .
IA
2
O
I = I T(x) > H = Q
N
(6)
( )
| |
|
\ .
D
2
1
I = I T(x) > H = Q - I
N
(7)
vhere 4 < is lhe generaIized Marcun Q-funclion, vhich can le defined ly
)
x
2
2
l
-
1
Q(x) = e dl
2
(8)
Conlining Lqualion (6) and Lqualion (7), ve can ollain N ly eIininaling \ .
( ) ( )
| |
2
-1 -1 -1 -1
D IA
N = Q I - Q I SNR (9)
According lo lhe Lqualion (9), O (1/ SNR) sanpIes are required lo neel a prolaliIily of
error conslrainl, lhus lhe nain advanlage of lhe nalched fiIler is lhal il requires Iess line lo
achieve high processing gain. Hovever, as a coherenl deleclion nelhod, nalched fiIler
deleclion requires a priori knovIedge of lhe prinary user signaI such as lhe noduIalion
lype and order, lhe puIse shape, and lhe packel fornal. AIlhough nosl of lhe priori
knovIedge can le ollained fron piIol, preanlIes, synchronizalion vord or spreading codes
of lhe prinary user nelvork syslens, an olvious shorlconing is lhal lhe cognilive radio
user requires specific receivers for differenl lypes of prinary user signaI.
2.2 Energy Detection
If lhe receiver cannol galher sufficienl infornalion aloul lhe prinary user signaI, for
exanpIe, if lhe pover of lhe randon Caussian noise is onIy knovn lo lhe receiver, lhe
oplinaI deleclor is an energy deleclor (AkyiIdiz al eI., 2OO6, Dighan al eI., 2OO3). In order lo
neasure lhe energy of lhe received signaI, lhe oulpul signaI of landpass fiIler vilh
landvidlh W is squared and inlegraled over lhe olservalion inlervaI T. IinaIIy, lhe oulpul
of lhe inlegralor, x(l), is conpared vilh a lhreshoId, y , lo decide vhelher a Iicensed user is
presenl or nol.
Cyclostationary Approach to Signal Detection and Classication in CognitiveRadio Systems 55
Iig. 2. The principaI of energy deleclion.
According lo lhe lasic hypolhesis nodeI for lransniller deleclion, lhe prolaliIily of faIse
aIarn I
IA
and deleclion I
D
are given as foIIovs
{ }
( )
IA 1
I = I X > H = Q 2, (1O)
{ }
( )
( )
D O
n, 2
I = I X > H =
n
(11)
Since il is easy lo inpIenenl, lhe recenl vork on deleclion of lhe prinary user has generaIIy
adopled lhe energy deleclion. AIlhough lhis nelhod can le inpIenenled vilhoul any prior
knovIedge of lhe prinar
2
y user signaI, il aIso has sone dravlacks. Since energy deleclion is
non-coherenl, O(1/SNR ) sanpIes are required lo neel a prolaliIily of error conslrainl.
Moreover, lhe lhreshoId seIeclion for energy deleclion is highIy susceplilIe lo uncerlainly in
lackground noise and inlerference, and il can onIy delernine lhe presence of lhe signaI
vilhoul differenlialing signaI lypes. Hovever, lhe Iargesl advanlage of energy deleclion is
sinpIe and Iov conpIexily.
2.3 CycIostationary Feature Detection
The cycIoslalionary fealure is inlenlionaIIy enledded in lhe physicaI properlies of a
connunicalion signaI, vhich nay le easiIy generaled, nanipuIaled, delecled and anaIyzed
using Iov conpIexily lransceiver archileclures. This fealure is presenl in aII lransnilled
signaIs, requires IillIe signaIIing overhead and nay le delecled using shorl signaI
olservalion lines, and lhus il can le used for prinary user signaI deleclion and recognilion.
Recenl research efforls expIoil lhe cycIoslalionary fealures of signaIs via speclraI correIalion
anaIysis as a nelhod for speclrun sensing (Dighan al eI., 2OO3, Sahai al eI., 2OO4, Chaseni &
Sousa, 2OO5), vhich has leen found lo le superior lo sinpIe energy deleclion and nalched
fiIlering. Lnergy deleclion can onIy delecl vhelher or nol a signaI in presenl and uliIizing a
nalched fiIler syslen requires exlensive knovIedge aloul lhe channeI and signaIs lhal are
lo le idenlified. The nelhod, vhich is nol susceplilIe lo in-land inlerference, can le used lo
delecl and cIassify differenl lypes of signaI. ConvenlionaI signaI cIassificalion approaches
are nainIy lased on decision lheory (IoIydoros & Kin, 199O, Sapiano & Marlin, 1996, SiIIs,
1999, Wei & MendeI, 2OOO, Hang al eI., 2OO1) and slalislicaI pallern recognilion (Nandi &
Azzouz, 1995, Azzouz & Nandi, 1995, Azzouz & Nandi, 1996, Nandi & Azzouz, 1998). In lhe
vork ly Hang (Hang al eI., 2OO1), a linary decision lree is designed lo signaI cIassificalion.
Hovever, il's difficuIl lo ollain lhe decision lhreshoIds and ruIes, vhich needs a Iarge
anounl of caIcuIalion. Ior nore efficienl and reIialIe perfornance, a noveI approach lased
on nuIliIayer Iinear perceplron nelvork for signaI cIassificalion in cognilive radio is sludied
ly Iehske (Iehske al eI., 2OO5). Supporl veclor nachine (SVM) is a nev slalislicaI pallern
recognilion approach, vhich is lased on slrucluraI risk nininizalion principIe (Vapnik,
Cognitive Radio Systems 56
1995). Conpared vilh lhe conversionaI nelhods lased on enpiricaI risk nininizalion Iike
arlificiaI neuraI nelvork (ANN), il has leen found lo give leller generaIizalion and leller
perfornance for snaII lraining exanpIes. In lhe nexl seclion, a noveI approach of signaI
cIassificalion for cognilive radios conlining lhe cycIoslalionary fealures and SVM is
proposed.
3. Spectrum Sensing based on spectraI correIation anaIysis and SVM
3.1 System Framework
As our signaI cIassificalion schene conlining speclraI correIalion anaIysis and SVM is
lased on slalislicaI pallern recognilion, vhich nainIy consisls of lhree noduIes (Han, 2OO3):
fealure exlraclion, cIassifier design and cIassificalion decision. Iealure exlraclion is lypicaIIy
lhe firsl slage in any cIassificalion syslen in generaI, and in our speclrun sensing syslens in
parlicuIar. Civen signaI sel lo le cIassified, lhe fealure paranelers of differenl cIasses of
signaI and ruIes for cIassifier shouId le delernined firsl. In order lo achieve leller
cIassificalion perfornance, seIecled fealure paraneler shouId le insensilive vilh lhe SNR
varialion, and lhen a proper cIassifier is designed for specific cIassificalion prolIen using
lraining dala vilh knovn signaI lypes. When lhe error prolaliIily of lhe cIassifier achieves a
specific lhreshoId, lhe cIassifier can le used for signaI cIassificalion and recognilion. In our
schene, lhere are lhree procedures adopled for prinary user signaI recognilion:
1) Iro-processing procedure:
SeveraI fealure paranelers are exlracled via speclraI correIalion anaIysis firsl. The fealure
paranelers insensilive vilh lhe SNR varialion are seIecled as fealure veclor "
1 2 M
x , x , , x .
Afler lhal, lhe fealure veclor and signaI lype
|
q are used lo forn lhe lraining
sel "
1 2 M k
(x , x , , x , y ) for cIassifier.
2) Training and Iearning procedure:
The SVM cIassifier is lrained using seIecled fealure paranelers in lhe lraining sel. y
uliIizing a nonIinear SVM, an anounl of caIcuIalion for lraining is perforned offIine,
lhus lhe conpulalionaI conpIexily is reduced. The oplinaI cIassificalion pIane for SVM
is ollained in lhis procedure via lraining and Iearning.
3) Tesl procedure
SeIecled fealure paranelers exlracled for received signaIs are inpulled veII-lrained
SVM cIassifier for prinary user signaI deleclion and recognilion.
The franevork of our schene conlining speclraI correIalion anaIysis and SVM is shovn in
Iig. 3.
Cyclostationary Approach to Signal Detection and Classication in CognitiveRadio Systems 57
Iig. 3. Syslen franevork.
AIlhough SVM is a leller choice for lhe cIassifier, lhe seIeclion of fealure paranelers has
direcl inpacl on lhe perfornance of lhe cIassificalion aIgorilhn. In lhe nexl seclion, ve viII
discuss lhe firsl slep, hov lo choose speclraI coherence characlerislic paranelers for our
schene.
3.2 SpectraI CorreIation AnaIysis
Many signaIs used in connunicalion syslens exhilil periodicilies of lheir second order
slalislicaI paranelers due lo lhe operalions such as sanpIing, noduIaling, nuIlipIexing and
coding. These cycIoslalionary properlies, vhich are naned as speclraI correIalion fealures,
can le used for signaI deleclion and recognilion (Cardner, 1987).
In order lo anaIyze lhe cycIoslalionary fealures of lhe signaI x(l), lvo key funclions are
lypicaIIy uliIized. The cycIic aulocorreIalion funclion (CAI) is used for line donain
anaIysis, vhich can le expressed as
)
T/2
-T/2
T
-j2l
x
* -j2l
*
1
R () = Iin x(l + ) x (l - ) e dl
T 2 2
= x(l + ) x (l - ) e
2 2
(12)
The speclraI correIalion funclion (SCI), vhich exhilils lhe speclraI correIalion of lhe signaI
x(l), is ollained fron lhe Iourier lransforn of lhe cycIic aulocorreIalion in Lqualion (12)
(Cardner & Iranks, 1975).
)
) )
+
-
+ T/2
*
- -T/2
T
T +
-j2f
x x
-j2l -j2f
xT
S (f) = R () e d
1
= Iin x(l + ) x (l - ) e e dld
T 2 2
= Iin S (l, f)
(13)
Cognitive Radio Systems 58
Where o is lhe cycIe frequency, f is lhe speclraI frequency and
xT
S (l, f) is lhe cycIic
periodogran of
x
S (f)
| |
<
*
xT T T
S (l, f) = X (l, f + 2) X (l, f - 2) T (14)
vhere lhe Iourier lransforn of lhe funclion x(u) on lhe lounded line inlervaI | l - T/2, l +
T/2j is definedas
)
l +T/2
l - T/2
-j2fu
T
X (l, f) = x(u) e du (15)
The correIalion coefficienl for lhe SCI lelveen frequency conponenls f /2 , vhich is
knovn as speclraI coherence coefficienl (SCC), can le caIcuIaled ly
x
x
O O
x x
S (f)
C (f) =
S (f + 2) S (f - 2) <
(16)
The nagnilude of lhe SCC ranges fron O lo 1 vilh a = O for aII f. Differenl signaI cIasses (i.c.
AM, ASK, ISK, ISK, MSK, QISK) can le dislinguished lased on severaI characlerislic
paranelers of SCI and SCC.
In praclicaI silualions, hovever, lhe nunler of olservalion sanpIes al lhe sensor is Iiniled.
Therefore, lhe speclraI correIalion funclion needs lo le eslinaled fron a finile sel of
sanpIes. In generaI, lvo nelhods are used for speclraI correIalion eslinalion incIuding
line-donain averaging and frequency-donain snoolhing (Cardner & Spooner, 1988). In
lhis seclion, lhe frequency-snoolhing nelhod is used for speclraI correIalion eslinalion,
vhich can le expressed as foIIovs.
_
_
(M+1) 2
n=(M-1) 2
N-1
k=O
*
x l S l S
-j2f(l -kT )
S
l S S
f
l
1 1
S (f) = X (l, f + + nI ) X (l, f - + nI )
M l 2 2
X (l, f) = W (kT ) X(l - kT )e
<
<
(17)
vhere
S S
I = 1/(N - 1)T T
S
is lhe frequency increnenl,
S
T is lhe cycIic sanpIing inlervaI and
lhe Ienglh of lhe sanpIe is
S
N = l T . Thus, lhe dala-lapering vindov
l S
W (kT ) is of lhe
vidlh <
S
f = M I . The SpeclraI correIalion funclions of sone lypicaI signaIs can le ollained
ly frequency-snoolhing nelhod, vhich are shovn in Iig. 4 (Curnan al eI., 2OO8).
Cyclostationary Approach to Signal Detection and Classication in CognitiveRadio Systems 59
Iig. 4. SpeclraI correIalion funclions of sone lypicaI signaI cIasses.
Lven visuaIIy in lhe alove figures, lhe speclraI correIalion funclions of lhe differenl
noduIalion lypes possess dislincl characlerislics. Il is lhis facl lhal aIIovs lhe successfuI
appIicalion of lhe pallern recognilion lechniques lo achieve prinary user signaI deleclion
and recognilion. In order lo ollain leller roluslness of lhe proposed aIgorilhn, sone
fealures Iess sensilive vilh SNR shouId le chosen for lhe cIassifier. Assuned lhal lhe
Cognitive Radio Systems 60
received signaI s = s + n , vhere s , n are lhe lransnilled signaI and addilionaI vhile
Caussian noise. The fealure paraneler of lhe received signaI has a leller cIassificalion vhere
perfornance vhich is insensilive vilh SNR varialion, if il salisfies
s
2
- x x n (18)
X, x, n is lhe fealure veclors of s, s, n .
ased on lhe caIcuIalion of lhe speclraI correIalion funclion, ve can ollain lhe speclraI
correIalion nagnilude surface of differenl lypes of signaI. According lo alove anaIysis,
severaI speclraI correIalion fealures can le exlracled for dislinclion of differenl noduIalion
lypes. TypicaIIy, four key fealures
1 2 3 4
x , x , x , x vhich are sensilive vilh noduIalion lypes
and insensilive vilh SNR varialion are Iisled in TalIe. 1.
TalIe 1. TypicaI vaIue of speclraI correIalion fealures. Iour key fealures x
1
,x
2
,x
3
,x
4
are
descriled as foIIovs.
- x
1
: Nunler of 5 puIse on f - donain of SCI
Lel a = O in Lqualion (17), lhe SCI is lransforned inlo S"(f), lhus x
1
can le ollained
fron lhe ichnography of S
O
x
(f).
- x
2
: Nunler of cycIic speclraI Iine on a -donain of SCI
Lel f = O in Lqualion (17), lhe SCI is lransforned inlo S
a
(O), and x
2
can le ollained
fron lhe ichnography of S
a
(O).
- x
3
: Average energy of cycIic speclraI Iine on a - donain of SCI
The Average energy of cycIic speclraI Iine on a - donain of SCI can le conpuled ly
lhe equalion as foIIovs:
)
+ 2
O
3 x
x = S (f) d (19)
- x
4
: Maxinun vaIue of SCC
The speclraI coherence coefficienl can le ollained via Lqualion (16) and Lqualion (17).
Then, lhe naxinun vaIue of SCC is conpuled as key fealure x
4
.
In lhe sinuIalion experinenls, 4OOO fealures are exlracled fron lhe signaI for every lriaI. In
order lo prevenl nunericaI conpulalionaI errors, lhe fealures need lo le nornaIized ly
Cyclostationary Approach to Signal Detection and Classication in CognitiveRadio Systems 61
sullracling nean of each fealure fron lhe originaI fealure and dividing lhe resuIl ly lhe
slandard devialion of lhe sane fealure.
'
i
i i i x
x = (x - x ) i = 1, 2, 3, 4 (2O)
Afler nornaIizalion, lhe fealure veclor ' ' ' '
1 2 3 4
x = (x , x , x , x ) can le generaled as lhe inpul of
lhe signaI cIassifier.
3.3 Support Vector Machine
The lradilionaI slalislicaI lheory is prinariIy lased on lhe asynplolic principIe, vhich
provides concIusion onIy for lhe silualion vhere lhe sanpIe size is lending lo infinily.
Hovever, in nosl praclicaI appIicalions, lhe sanpIes are usuaIIy Iiniled so lhal il is difficuIl
lo achieve lhe desired resuIls via exisling nelhods. SlalislicaI Learning Theory is a noveI
slalislicaI lheory lased on snaII sanpIe slalislics ly Vapnik (Vapnik, 1995). Conpared lo
lhe convenlionaI slalislicaI lheory, slalislicaI Iearning lheory nainIy concerns lhe slalislic
principIes vhen sanpIes are Iiniled, especiaIIy lhe properlies of Iearning procedure in such
cases. SlalislicaI Iearning lheory provides us a nev franevork for lhe generaI Iearning
prolIen, vhich nol onIy considers lhe asynplolic perfornance lul ollains lhe oplinaI
resuIls under lhe condilion of Iiniled infornalion. In order lo sludy lhe generaIizalion
perfornance and lhe speed of uniforn convergence, a series of indicalors used lo evaIuale
lhe Iearning perfornance of funclion sels are defined in slalislicaI Iearning lheory. One of
lhe nosl inporlanl concepls is Vapnik-Chervonenkis(VC) dinension vhich vas originaIIy
defined ly VIadinir Vapnik and AIexey Chervonenkis in 1971. VC-dinension is a neasure
of Iearning nachine conpIexily or lhe capacily of a slalislicaI Iearning aIgorilhn, vhich is
lhe cardinaIily of lhe Iargesl sel of poinls lhal lhe aIgorilhn can shaller. The Iearning
nachine is nore conpIex vilh a grealer VC-dinension. SlalislicaI Iearning lheory provides
a noveI slralegy lhal laIances lhe enpiricaI risk and confidence inlervaI. A nesled sulsel
sequence is chosen fron lhe given sel of funclions according lo lhe size of lhe VC
dinension. Ior a given sulsel, lhe nininaI vaIue of lhe enpiricaI risk can le ollained as lhe
nininaI lrue risk, vhich is iIIuslraled in Iig. 5. This nelhod is naned as SlrucluraI risk
nininizalion (SRM) vhich vas aIso coined ly Vapnik and Chervonekis in 1974. The
principIe of SRM is lo provide a nelhod lo reach lhe lrade-off lelveen hypolhesis space
conpIexily (lhe VC dinension of approxinaling funclions) and lhe quaIily of filling lhe
lraining dala (Wang, 2OO7). The procedure is descriled in delaiI as foIIovs.
Assuned a funclion sel e Q(x, ) , has a sel S, vhich has a slruclure shovn in Iig. 5. The
slruclure is defined ly a nesled sulsel sequence "
1 2 n
S , S , , S , vhich salisfies
c c c " "
1 2 n
S S S (21)
The eIenenls of lhe alove slruclure have lvo properlies as foIIovs.
(1) The VC dinension of each sulsel n
|
is Iiniled and salisfies
Cognitive Radio Systems 62
s s s " "
1 2 n
h h h (22)
(2) Any eIenenl in lhe slruclure S
|
conlains a sel of lolaIIy lounded funclion
s s c
k k
O Q(z, ) , (23)
or conlains a funclion sel vhich salisfies lhe foIIoving inequaIily for sone (p, T
K
)
( )
c
s
)
)
k
1/p
k
p
Q (z, )dI(z)
, p > 2
Q(z, )dI(z)
sup (24)
Ior a given sel of olservalion sel "
1 2 I
z , z , , z , SRM ains lo choose lhe proper funclion
k
I
Q(z, ) vho nakes lhe enpiricaI risk nininaI in sulsel
N
6 vilh snaIIesl guaranleed risk.
Afler perforning enpiricaI risk nininizalion on each sulsel, lhe sulsel vhose sun of
enpiricaI risk and VC confidence is seIecled. The oplinaI funclion
k
I
Q(z, ) lhal nakes lhe
enpiricaI risk nininaI in seIecled sulsel is lhe oplinaI soIulion.
Iig. 5. The principIe of SlrucluraI Risk Mininizalion.
SlalislicaI Iearning lheory aIso gives lhe required condilions for reasonalIe slruclure of
funclion sulsel and lhe convergence properly of acluaI risk in SRM principIe. The acluaI
risk is lhe sun of enpiricaI risk and confidence inlervaI. As lhe index of lhe eIenenls in lhe
slruclure increases, lhe enpiricaI risk viII le reduced vilh exlended confidence inlervaI.
The snaIIesl upper lound of lhe acluaI risk can le derived fron a cerlain eIenenl in lhe
slruclure. Supporl veclor nachine is a noveI universaI Iearning nachine, vhich is videIy
used in lhe fieIds of pallern recognilion, regression eslinalion and prolaliIily densily. Il is
lased on VC-dinension lheory and SRM principIe, vhich has a leller generaIizalion
Cyclostationary Approach to Signal Detection and Classication in CognitiveRadio Systems 63
perfornance ly reaching a lrade-off lelveen nodeI conpIexily vilh Iiniled sanpIe dala
and capacily of lhe Iearning aIgorilhn. The supporl veclor nachine vas coined ly Vapnik
in lhe Iale 196Os on lhe foundalion of slalislicaI Iearning lheory. Il vas originaIIy deveIoped
for linary cIassificalion prolIen. The oplinaI soIulion of SVM for a IinearIy separalIe case
vas inlroduced ly Vapnik. Laler lhis vas exlended lo non-separalIe cases. In lhe previous
research, a connon soIulion lo cIassificalion prolIen of connunicalion signaIs is arlificiaI
neuraI nelvork (ANN), such as nuIliIayer Iinear perceplron nelvork. Afler lhe firsl
preIininary sludies, SVM have shovn a renarkalIe efficiency, especiaIIy vhen conpared
vilh lradilionaI arlificiaI neuraI nelvorks. The nain advanlage of SVM, vilh respecl lo
ANN, consisls in lhe slruclure of lhe Iearning aIgorilhn, characlerized ly lhe resoIulion of a
conslrained quadralic progranning prolIen (CQI), vhere lhe dravlack of IocaI ninina is
conpIeleIy avoided (oser al eI., 1992, Corles & Vapnik, 1995, SchoIkopf, 1995). Since lhe
cIassificalion of connunicalion signaIs is olvious lo le a IinearIy non-separalIe prolIen,
ve viII onIy discuss lhe conpulalion of lhis oplinizalion prolIen in lhis chapler. Civen
IinearIy non-separalIe cIassificalion prolIen, ve suppose a lraining sel is |(x
i
, y
i
) ,
vhere { }
1
[ 5 \ L e e + = . Assuned lhal lhe signaI group can le cIassified ly a
hyperpIane vhich is defined ly
T
( ) + l = O w x (25)
vhere lhe veclor w defines lhe loundary of differenl cIasses of dala, l is a scaIar lhreshoId
and
2
( ) = /2 x x .
In order lo soIve lhis non-separalIe prolIen, lhe non-ninus sIack varialIes
i
are
inlroduced, and lhen lhe lraining veclors nusl salisfy
> "
T
i i i i
y ( + l ) - 1 1 - , i = 1, 2, , I w x (26)
The hyperpIane, vhich nakes O(v) = ||v|| /2 lo le nininun, is naned as lhe oplinaI
hyperpIane. AII of lhe lraining veclors are correclIy cIassified ly il and lhe veclors of each
cIass are separaled vilh a naxinun nargin (urges, 1997).
UsuaIIy, slrucluring a hyperpIane is soIved as a quadralic oplinizalion prolIen lhal can le
fornuIaled as
>
>
_
"
i
I
v, l,
i =1
T
i
T
i i i
i
1
nin + C
2
s. l. y ( ( ) + l) 1 -
O, i = 1, 2, , I
w w
w x (27)
vhere C is lhe penaIly paraneler, vhich is used lo conlroI lhe lraining error rale ly
differenl vaIues.
Using a Lagrange nuIlipIier lechnique, lhe oplinizalion prolIen can le converled inlo
Cognitive Radio Systems 64
_ _ _
I I I
i =1 i =1 i =1
2
T
i i i i i i i
1
I = + C |y ( ( ) + l) - 1 + j -
2
- w w x (28)
vhere
ai, (i > O are Lagrange nuIlipIier faclors.
Civen IinearIy non-separalIe cIassificalion prolIen, ve can nap lhe inpul dala inlo a high
dinensionaI fealure space lhrough sone non-Iinear lransfornalion vhich nakes lhe dala
IinearIy separalIe (Devroye, 1996). Noled lhe alove soIulion lo IinearIy non-separalIe
cIassificalion prolIen, onIy lhe inner producl operalion of lhe lraining sanpIes is invoIved
in lhe decision funclion. WhiIe slrucluring high dinensionaI fealure space, lhe aIgorilhn
onIy use lhe inner producl O (xi )O (x) in lhe space vilhoul separaled O (x) or O (x
I
) . If ve
can find a funclion K salisfying Mercer condilion (DanieI & }anes, 2OOO), vhich can le
denoled as
( ) ( ) <
i i
K( , ) = x x x x (29)
vhere K(x
I
, x) is lhe kerneI funclion, vhich is uliIized for napping lhe inpul dala lo higher
dinensionaI space in order lo reduce lhe conpulalionaI Ioad. There are differenl kerneI
funclions Iike poIynoniaI, signoid and radiaI lasis funclion (RI) used in SVM, vhich are
defined as foIIovs.
1. IoIynoniaI KerneI
( ) | |
k
i i
K( , ) = x x + 1 x x (3O)
A k-order poIynoniaI cIassifier can le defined ly Lqualion (3O).
2. RadiaI asis Iunclion (RI) KerneI
2
2
i i
K( , ) = exp|- x - x / x x (31)
The vidlh of lhe RI kerneI paraneler o can le delernined in generaI ly an ileralive
process seIecling an oplinun vaIue lased on lhe fuII fealure sel. The nain difference
lelveen RI cIassifier and lradilionaI RI nelhod is lhal each lasis funclion in lhe RI
cIassifier corresponds lo a supporl veclor, vhich is aulonalicaIIy idenlified ly lhe aIgorilhn
vhere lhe dravlack of IocaI ninina is conpIeleIy avoided.
3. Signoid KerneI
( ) ( )
i i
K( , ) = lanh v x x + c x x (32)
This kerneI uses signoid funclion as inner producl, vhich is equivaIenl lo a nuIliIayer
perceplron vilh onIy one hidden Iayer. The nunler of node in hidden Iayer is aulonalicaIIy
delernined ly aIgorilhn.
TiII nov, lhe choice of lhe kerneI funclions vas oflen used enpiricaIIy, and lhis aIso lecane
a lheorelicaI dravlack of SVM. A proper kerneI funclion for a specific prolIen is
dependenl on lhe specific lraining sanpIe dala. In lhe praclicaI appIicalions, hov lo choose
lhe proper nodeI according lo lraining sanpIe sel vilh leller generaIizalion aliIily is
currenlIy a research direclion in lhe fieId of SVM. Ior a signaI cIassificalion prolIen using
cycIoslalionary fealures, ve use an inproved nelhod of nodeI seIeclion lased on kerneI
aIignnenl, vhich viII le descriled in Seclion 4.1 in delaiI. The choice of lhe kerneI funclions
is sludied via conpuler sinuIalions and oplinaI resuIls are achieved using radiaI-lasis
Cyclostationary Approach to Signal Detection and Classication in CognitiveRadio Systems 65
funclion (RI) kerneI funclion. A lypicaI cIassificalion experinenl using RI kerneI
funclion lased SVM is iIIuslraled as foIIovs
Iig. 6. A lypicaI cIassificalion experinenl using RI kerneI funclion (Sherrod, 2OO8).
Afler choosing lhe lesl kerneI funclion, lhe duaI represenlalion of lhe oplinizalion prolIen
can le ollained ly conpuling lhe derivalives vilh respecl lo v, l,
i
, vhich is descriled as
s s
_ _
"
I I
i =1 i, j=1
i i j i j i j
i
T
1
nax y y K( , )
2
s. l. O C , i = 1, 2, , I
y = O
- x x
(33)
The resuIling decision funclion is ollained as foIIovs:
{ }
_
I
i i i
i =1
f(x) = sgn y K( , ) + l x x (34)
The archileclure of lhe SVM cIassifier conlining speclraI correIalion anaIysis is shovn in
Iig. 7.
Cognitive Radio Systems 66
1
x
2
x
4
x
1
K(x , x)
2
K(x , x)
4
K(x , x)
1 1
y
2 2
y
4 4
y
f(x)
3
K(x , x)
3
x
3 3
y
l
_
sgn <
Iig. 7. Archileclure of lhe SVM cIassifier conlining speclraI correIalion anaIysis.
4. Performance EvaIuation and AnaIysis 4.1 KerneI Function and Parameters
SeIection
According lo lhe definilion of kerneI funclion in lhe previous seclion, lhe kerneI nalrix can
le defined as foIIovs (Lanckriel al eI., 2OO2)
( ) ( )
(
(
(
(
(
(
(
"
"
# # % # #
"
"
1, 1 1, 2 1, I - 1 1, I
2, 1 2, 2 2, I - 1 2, I
n
i j
i, j =1
I - 1, 1 I - 1, 2 I - 1, I - 1 I - 1, I
I, 1 I, 2 I, I - 1 I, I
K K K K
K K K K
= k x , x =
K K K K
K K K K
K (35)
vhere n is lhe nunler of lhe sanpIes. Il is a synnelric posilive definile nalrix, and since il
specifies lhe inner producls lelveen aII pairs of inpul eIenenls, il conpIeleIy delernines
lhe reIalive posilions lelveen lhose poinls in lhe enledding space.
In lhis seclion, ve use an inproved nelhod of kerneI seIeclion lased on kerneI aIignnenl lo
choose proper kerneI funclion for our schene (Crislianini al eI., 2OO2). Assuned lhal K
1
and
K
2
are kerneI nalrix of lhe kerneI funclion k
1
and k
2
, respecliveIy. The (enpiricaI)
aIignnenl of a kerneI k
1
vilh a kerneI k
2
vilh respecl lo lhe sanpIe S is lhe quanlily, vhich
can le defined ly
( )
1 2
1 2
1 1 2 2
K , K
A S, k , k =
K , K K , K
(36)
Civen a sanpIe sel { } e "
i i
S = x x S , i = 1, 2, , I for a specific signaI cIassificalion prolIen,
lhe sanpIe can le divided inlo lvo lypes vhich are idenlified ly +1 and -1. The signaI lype
Cyclostationary Approach to Signal Detection and Classication in CognitiveRadio Systems 67
sel is denoled as { } e "
i i
Y = y y 1 , i = 1, 2, , I vilh lhe veclor forn { } "
T
1 1 I
Y = y , y , , y ,
and lhen aIignnenl nalrix can le defined ly
(
(
(
(
(
(
(
"
"
# # % # #
"
"
1 1 1 2 1 I - 1 1 I
2 1 2 2 2 I - 1 2 I
T
I - 1 1 I - 1 2 I - 1 I - 1 I - 1 I
I 1 I 2 I I - 1 I I
ad
y y y y y y y y
y y y y y y y y
= YY =
y y y y y y y y
y y y y y y y y
K (37)
This kerneI seIeclion nelhod using kerneI aIignnenl is lased on an inporlanl assunplion
lhal lhe kerneI funclion has leller perfornance if lhe kerneI aIignnenl of lhe kerneI nalrix
and lhe aIignnenl nalrix is higher. Thus, if ve consider K = K
1
, K
a d
=YY =K
2
, lhen
( )
T T
T
T T
, YY , YY
A S, , YY = =
I ,
, YY , YY
K K
K
K K
K K
(38)
According lo lhe alove derivalion, lhe oplinaI kerneI funclion prolIen can le lransforned
inlo kerneI aIignnenl naxinizing prolIen. In lhis seclion, lhe kerneI aIignnenl vaIues of
differenl kerneI funclions are conpared via conpuler sinuIalion ly MATLA 7.O. Ior lhe
sinuIalions, ve define a signaI sel as |AM, ASK, ISK, ISK, MSK, QISK. To ollain lhe
kerneI aIignnenl al differenl SNR, sinuIalions are carried oul vilh 1O24 sanpIes al SNR
ranging fron O d lo 2O d. SinuIalion resuIls shov lhal lhe kerneI aIignnenl of lhe RI
kerneI is lhe grealer lhan lhal of olher kerneIs, vhich is shovn in Iig. 8. According lo lhe
sinuIalion resuIls, ve choose RI kerneI as lhe kerneI funclion of lhe SVM in our schene.
Afler lhe kerneI funclion is seIecled, lvo key paranelers of lhe SVW shouId le considered
nexl. The firsl paraneler, penaIly paraneler C of lhe SVM, is used for adjusling lhe range of
lhe confidence inlervaI lo conlroI lhe lraining error rale ly differenl vaIues. The second one,
lhe vidlh of lhe RI kerneI paraneler o , can conlroI lhe cIassificalion error ly changing lhe
Iargesl VC dinension of Iinear cIassificalion pIane. Therefore, lhese lvo paranelers have a
greal inpacl on lhe cIassificalion perfornance (ChapeIIe al eI., 2OO2). In lhis seclion, ve use
a sinpIe cross-vaIidalion nelhod lo search lhe lesl paranelers (C, o) .
In n-foId cross-vaIidalion, ve firsl divide lhe lraining sel inlo n sulsels of equaI size.
SequenliaIIy one sulsel is lesled using lhe cIassifier lrained on lhe renaining n-1 sulsels.
Thus, each inslance of lhe vhoIe lraining sel is predicled once so lhe cross-vaIidalion
accuracy is lhe percenlage of dala lhal are correclIy cIassified. The process of cross-
vaIidalion is descriled as foIIovs.
Cognitive Radio Systems 68
Iig. 8. Ierfornance conparison of differenl kerneI funclions.
1. The lraining sel is divided inlo n sulsels ( )
O O
, of equaI size, and lhe eIenenls of
lhe sulsel are { } "
O O,1 O, 2 O, n
= C , C , , C , { } "
O O,1 O, 2 O, n
= , , , n is lypicaIIy fron 4
lo 1O.
2. Afler lraining each ( )
i, j i, j
C , using lhe cIassifier, lhe cIassificalion perfornance is
lesled.
3. The ( )
i, j i, j
C , vilh lesl cIassificalion perfornance is used lo forn lhe paraneler sel
{ } "
1 1,1 1, 2 1, n
= C , C , , C and { } "
1 1,1 1, 2 1, n
= , , , ,
1, n 1,1 O, n O,1
- -
4. Repeal slep 3 unliI lhe nunler of
i
and
i
reach lo a preconcerled lhreshoId. The
( )
i, j i, j
C , viII le lhe oplinaI choice for lhe specific SVM afler ileralions.
Afler perforning cross-vaIidalion nelhod for our schene ly MATLA, ve can ollain lhe
lesl kerneI paranelers