'DWD0LQLQJDQG9LVXDOL]DWLRQIRU3UHGLFWLRQRI0XOWLSOH
'LVHDVHVLQ+HDOWKFDUH
$MLQN\D.XQMLU+DUVKDO6DZDQW1X]KDW)6KDLNK
 0RGHUQ(GXFDWLRQ6RFLHW\¶V&ROOHJHRI(QJLQHHULQJ3XQH



$EVWUDFW $ YDVW DPRXQW RI GDWD LV JHQHUDWHG LQ WKH
ILHOGV RI KHDOWKFDUH DQG GLDJQRVWLFV GRFWRUV KDYH WR
PDNH D GLUHFW FRQWDFW ZLWK SDWLHQWV WR GHWHUPLQH WKH
ZRXQGV LQMXULHV DQG GLVHDVHV E\ ZKLFK WKH SDWLHQW LV
DIIHFWHG 7KLV SDSHU KLJKOLJKWV WKH DSSOLFDWLRQ RI
FODVVLI\LQJ DQG SUHGLFWLQJ D VSHFLILF GLVHDVH E\
LPSOHPHQWLQJWKHRSHUDWLRQVRQPHGLFDOGDWDJHQHUDWHG
LQWKHILHOGRIPHGLFDODQGKHDOWKFDUH,QWKLVSURMHFWDQ
efficLHQW PXOWLFODVV 1DwYH %D\HV DOJRULWKP LV XVHG IRU
SUHGLFWLRQRIDSDUWLFXODUGLVHDVHE\WUDLQLQJLWRQDVHW
RIGDWDEHIRUHLPSOHPHQWDWLRQ:URQJFOLQLFDOGHFLVLRQV
WDNHQ E\ PHGLFDO SUDFWLWLRQHUV FDQ FDXVH DQ\ KDUP RU
UHVXOWLQVHULRXVORVVRIOLIHRIDSDWLHQWZKLFKLVKDUGWR
DIIRUG E\ DQ\ KRVSLWDO 7R DFTXLUH D SUHFLVH DQG FRVW
effective WUHDWPHQW WHFKQRORJ\ EDVHG 'DWD 0LQLQJ
6\VWHPV FDQ EH FRQVWUXFWHG WR PDNH ZRUWK\ GHFLVLRQV
7KHPDLQDLPRIWKLVSURMHFWLVWREXLOGDEDVLFGHFLVLRQ
VXSSRUW V\VWHP ZKLFK FDQ GHWHUPLQH DQG H[WUDFW
SUHYLRXVO\ XQVHHQ SDWWHUQV UHODWLRQV DQG FRQFHSWV
UHODWHGZLWKPXOWLSOHGLVHDVHIURPDKLVWRULFDOGDWDEDVH
UHFRUGV RI VSHFLfied PXOWLSOH GLVHDVHV 7KH SURSRVHG
V\VWHP FDQ VROYH GLIILFXOW TXHULHV IRU GHWHFWLQJ D
SDUWLFXODU GLVHDVH DQG DOVR FDQ DVVLVW PHGLFDO
SUDFWLWLRQHUV WR PDNH VPDUW FOLQLFDO GHFLVLRQV ZKLFK
WUDGLWLRQDO GHFLVLRQ VXSSRUW V\VWHPV ZHUH QRW DEOH WR
7KH GHFLVLRQV WDNHQ E\ PHGLFDO SUDFWLWLRQHUV ZLWK WKH
KHOS RI WHFKQRORJ\ FDQ UHVXOW LQ HIIHFWLYH DQG ORZ FRVW
WUHDWPHQWV7KHUHLVDQLQVufficiHQF\RIWHFKQRORJ\DQG
DQDO\VLV V\VWHP DQG PHWKRGV WR GLVFRYHU FRQQHFWLRQV
FRQFHSWVDQGSDWWHUQVLQWKHPHGLFDOGDWD'DWDPLQLQJ
LV DQ HQJLQHHULQJ VWXG\ RI H[WUDFWLQJ SUHYLRXVO\
XQGLVFRYHUHG SDWWHUQV IURP D VHOHFWHG VHW RI GDWD ,Q
WKLV SDSHU GDWD PLQLQJ PHWKRGV QDPHO\ 1DLYH %D\HV
DQG - DOJRULWKPV DUH FRPSDUHG IRU WHVWLQJ WKHLU
DFFXUDF\ DQG SHUIRUPDQFH RQ WKH WUDLQLQJ PHGLFDO
GDWDVHWV 7KH PHGLFDO GDWDVHWV ZLOO EH YLVXDOL]HG E\
GLIIHUHQW YLVXDOL]DWLRQ WHFKQLTXHV OLNH '' JUDSKV
SLH FKDUWV DQG RWKHU PHWKRGV 7KH DOJRULWKPV
PHQWLRQHGDERYHDUHFRPSDUHGDQGHYDOXDWHGRQEDVLV
RI WKHLU DFFXUDF\ DQG WLPH FRQVXPSWLRQ IDFWRUV 7KH
DOJRULWKP ZKLFK JLYHV RXW KLJK DFFXUDF\ LQ WKH
FRPSDUDWLYH VWXG\ LV VHOHFWHG IRU LPSOHPHQWDWLRQ IRU
GHYHORSLQJWKHV\VWHP
 GLVHDVH LQ WKH 8QLWHG 6WDWHV>@ $ ZHE LQWHUIDFH QDPHG
.H\ :RUGV  3UHGLFWLRQ &ODVsificDWLRQ *HQHWLF
$OJRULWKP1DwYH%D\HV'HFLVLRQWUHH'DWDVHWV
 IRRG LOOQHVV E\ VKRZLQJ WKH UHVXOWV DQG IRRG ELWPDSV LQ WKH
,,1752'8&7,21
&RPSXWHU VFLHQFH LV D ILHOG FRPSULVLQJ RI YDULRXV
WHFKQRORJLHV DQG WHFKQLTXHV UHODWHG WR GDWD VFLHQFH
978-1-5090-6399-4/17/$31.00 2017
c IEEE

DUWLILFLDOLQWHOOLJHQFHDQGJUDSKLFDOYLVXDOL]DWLRQ2QHRIWKH
QHZ DQG WUHQGLQJ WHFKQRORJ\ LQ ILHOGV RI FRPSXWHU DQG GDWD
VFLHQFH 'DWD 0LQLQJ SOD\V DQ LPSRUWDQW UROH LQ ILHOGV RI
FRPSXWHU VFLHQFH IRU PDQ\ UHDVRQV ,Q WKLV GRPDLQ
.QRZOHGJH 'LVFRYHU\ IURP 'DWD DOVR FDOOHG DV ³.''
3URFHVV´ LV GHILQHG DV H[WUDFWLQJ SUHYLRXVO\ XQGLVFRYHUHG
NQRZOHGJH IURP WKH VHOHFWHG WDUJHW GDWD IURP H[WHUQDO
VRXUFHV 'DWD PLQLQJ LV D VWHS LQ WKH .'' 3URFHVV LW LV DQ
DQDO\VLVWHFKQLTXHLQZKLFKSUHYLRXVO\XQGLVFRYHUHGSDWWHUQV
UHODWLRQVDQGLQWHUHVWLQJFRQFHSWVDUHPLQHGRUH[WUDFWHGIURP
WKH VHW RI GDWD 7KH SDWWHUQV H[WUDFWHG DUH VXSSRVHG WR EH
SRWHQWLDOYLYLGDQGQREHO'DWDPLQLQJFDQEHVSOLWWHGXSLQWR
WZR SDUWV ZKLFK LV SUHGLFWLYH DQG GHVFULSWLYH GDWD PLQLQJ
3UHGLFWLYH GDWD PLQLQJ LQFOXGHV WHFKQLTXHV XVHG IRU
SUHGLFWLRQ SXUSRVHV OLNH FODVVLILFDWLRQ DQG UHJUHVVLRQ
PHWKRGV 'HVFULSWLYH GDWD PLQLQJ LQFOXGH WHFKQLTXHV OLNH
FOXVWHULQJDQGDVVRFLDWLRQUXOHV $QNLWD'HZDQHWDOLQ
GHVFULEHGWKHDSSOLFDWLRQVRIGDWDPLQLQJLQfielGVOLNHKRPH
DXWRPDWLRQ,R7$UWLILFLDO,QWHOOLJHQFH%DQNLQJDQGILQDQFH
0HGLFDO DQG +HDOWKFDUH HWF 'RFWRUV DQG PHGLFDO SHRSOH LQ
GLDJQRVLVJHQHUDWHGDWDZLWKDOHVVDPRXQWRIKLGGHQWH[WXDO
LQIRUPDWLRQ SUHVHQW WKLV LQIRUPDWLRQ LV QRW XVHG effectLYHO\
DQG HIILFLHQWO\ IRU SUHGLFWLRQ RI GLVHDVH>@ 7R DYRLG WKLV
LVVXHWKHXQXVHGGDWDLVFRQYHUWHGLQWRDWH[WXDODQGWDEXODU
GDWDVHW IRU PRGHOOLQJ RI GDWD XVLQJ YDULRXV GDWD PLQLQJ
PHWKRGV DQG DOJRULWKPV %HFDXVH RI LQHIILFLHQW UHVXOWV DQG
LVVXHV WKDW ZHUH QRW WDNHQ LQWR FRQVLGHUDWLRQ DW WKH WLPH RI
WUHDWPHQW D SHUVRQ FDQ GLH 7KHUH LV D VHULRXV QHHG IRU
SUDFWLWLRQHUV WR DQDO\VH DQG VKDSH DQG PRGHOOHG GDWD DQG
LGHQWLI\WKHGLVHDVHFDXVHRIDSDWLHQWDQGSUHGLFWWKHGLVHDVH
EHIRUH LW RFFXUV 7KH SUHGLFWLRQV DQG FOassificaWLRQV
WHFKQLTXHV LQ GDWD PLQLQJ KHOS GLVFRYHU QHZ WUHQGV DQG
SDWWHUQV LQ PHGLFDO GDWD LQ RUGHU WR LPSURYH WKHLU KHDOWK>@
7KH LVVXHV RI GDWD PLQLQJ UHSUHVHQW JUHDW FKDOOHQJHV IRU
QHWZRUNLQJ DQG GLVWULEXWHG FRPSXWLQJ 9DULRXV VFLHQWLILF
UHVHDUFKHUV KDG VXJJHVWHG VHYHUDO PHWKRGV WR GHDO ZLWK WKH
SUREOHPV RI GDWD PLQLQJ 'DWD PLQLQJ KDYH DFKLHYHG
H[FHOOHQFH LQ ILHOGV RI ZHE WHFKQRORJ\ DQG LQWHUIDFLQJ E\
GHSOR\LQJ QHZ FRQFHSWV DQG OLQNLQJ WKHP ZLWK ZHE
WHFKQRORJ\WRVHFXUHKXPDQOLYHV$GDP6DGLOHNHWDOLQWKHLU
DUWLFOH ZKLFK ZDV SXEOLVKHG LQ 1HZ<RUN GHVFULEHG WKH XVH
DQGOLQNLQJRIGDWDPLQLQJWRZHEWHFKQRORJ\7KH\ZRUNHG
RQSUHYHQWLQJIRRGLOOQHVVZKLFKLVDOVRWKHGDPDJHFDXVLQJ
³Q(PHVLV´ZDVGHYHORSHGE\WKHVHUHVHDUFKHUVDQGLWXVHGWR
PLQHGVRFLDOPHGLDFRQWHQWDQGKHOSWKRVHSDWWHUQVWRSUHYHQW
FRUQHUV RI 86 -\RWL 6RQL HWDO LQ WKHLU DUWLFOH SDSHU SURYHG
WKDW WKH RSHUDWLRQV RQ WKH PHGLFDO GDWDVHWV ZHUH FRQGXFWHG
XVLQJGDWDPLQLQJDOJRULWKPVOLNH.11'HFLVLRQWUHHVDQG
1DLYH %D\HV DQG WKH UHVXOWV SURYHG WKDW 1DLYH %D\HV
329
 WHFKQLTXHRXWFODVVHGWKHDFFXUDF\WHVW>@7KHFODVVLILFDWLRQ
DQG SUHGLFWLRQ WHFKQLTXHV FDQ EH LPSURYHG E\
FRQFDWHQDWLQJ DVVRFLDWLRQ UXOHV ZLWK LW WR fiQG RXW WKH
IUHTXHQWO\XVHGHOHPHQWV7KHDOJRULWKPVVXFKDVG\QDPLF
$SULRUL DOJRULWKP DQG )3*URZWK DUH XVHG WR PLQH
IUHTXHQWLWHPVHWVIURPDGDWDEDVH,QWKHSUHYLRXVUHVHDUFK
ZRUNV WKH LPSOHPHQWDWLRQ DQG WKH DFFXUDF\ WHVWLQJ RI
DOJRULWKPVVXFKDVGHFLVLRQWUHHEDFNSURSDJDWLRQ1HXUDO
,,,027,9$7,21
,Q WKH KHDOWKFDUH RUJDQL]DWLRQV DQG PHGLFDO GLDJQRVLV
DUWLILFLDO LQWHOOLJHQFH DQG PDFKLQH OHDUQLQJ WHFKQLTXHV DQG
DOJRULWKPV FDQ EH LPSOHPHQWHG WR WUHDW VRPH KD]DUGRXV
GLVHDVHV %HVLGHV DOO WKH RWKHU GLVHDVHV FDUGLDF DUUK\WKPLD
DUWKULWLV ,VFKHPLF +HDUW GLVHDVH +HSDWLWLV 0DUDVPXV DUH
UHVSRQVLEOHWRWDNHPRUHOLYHVWKDQDQ\RWKHUGLVHDVHVVXFKDV
FDQFHU DQG +,9 7KXV WKHUH LV D QHHG WR SUHGLFW WKHVH
1HWZRUNV 1DwYH %D\HV DQG .11 ZDV FDUULHG RXW LQ
ZKLFK WKH 1HXUDO 1HWZRUN¶V EDFN SURSDJDWLRQ PRGHO
DFKLHYHGWKHKLJKHVWDFFXUDF\RIWKHPDOO
,,5(/$7(':25.
9DULRXVGDWDPLQLQJDOJRULWKPVDQGWHFKQLTXHVKDYHEHHQ
XVHGIRUVWXG\DQGDQDO\VLVRIYDULRXVGLVHDVHVOLNHFDUGLDF
DUU\WKPLD +HSDWLWLV 'LDEHWHV &DQFHU HWF 5HFHQW VXUYH\
VKRZV WKDW KHDUW GLVHDVH LV RQH RI WKH ELJJHVW FDXVH RI
GHDWK LQ WKH FRXQWULHV OLNH 8. &DQDGD )UDQFH DQG
6LQJDSRUH 9DULRXV FODVVLILFDWLRQ PRGHOV OLNH 'HFLVLRQ
7UHH1DwYH%D\HVDQG1HXUDO1HWZRUNV.11KDYHEHHQ
XVHGWRGLDJQRVHWKHSUHVHQFHGLVHDVHVLQSDWLHQWV3DWWHUQ
UHFRJQLWLRQ DQG GDWD PLQLQJ PHWKRGV KDYH EHHQ XVHG
SUHYLRXVO\ E\ WKH SUDFWLWLRQHUV DQG UHVHDUFKHUV IRU
SUHGLFWLRQSXUSRVHLQWKHILHOGRIGLDJQRVLVDQGKHDOWKFDUH
7KH H[SHULPHQWV ZHUH FDUULHG RXW XVLQJ GDWD PLQLQJ
DOJRULWKPV OLNH 1DwYH %D\HV 'HFLVLRQ 7UHH .11 DQG
1HXUDO 1HWZRUN RXW RI ZKLFK 1DwYH %D\HV JDYH EHWWHU
UHVXOWV$QH[SHULPHQWFDUULHGRXWE\WKHUHVHDUFKHUVXVLQJ
QHXUDO QHWZRUNV DQG K\EULG LQWHOOLJHQW DOJRULWKP RQ D
GDWDVHW SURGXFHG D PRGHO DQG WKH UHVXOWV VKRZV WKDW WKH
FRPELQHG K\EULG DQG LQWHOOLJHQW WHFKQLTXH LPSURYHG
DFFXUDF\RIWKHSUHGLFWLRQ7KHWHFKQLTXHZKLFKLVXVHGWR
ILQG RXW WKH LQWHUHVWLQJ SDWWHUQV DQG UHODWLRQVKLS EHWZHHQ
WZRLWHPVLVFDOOHGDVDVVRFLDWLRQUXOH7KHWZRLWHPVLQD
WUDQVDFWLRQDO GDWDEDVH FDQ VKDUH D GHSHQGHQW UHODWLRQVKLS
$EKLVKHN 7DQHMD LQ KLV SDSHU PHQWLRQHG WKDW WKH
DOJRULWKPVZLWKVHDUFKOLPLWDWLRQVDQGFRQVWUDLQWVDUHDOVR
LQWURGXFHGWRUHGXFHWKHFRXQWRIDVVRFLDWLRQUXOHVDQGDOVR
IRU YDOLGDWLRQ SXUSRVH>@ 75HYDWKL HWDO LQ WKHLU ,-65¶V
YRO >@ H[SODLQHG DERXW WKH LPSOHPHQWDWLRQ RI
FOassifier PRGHOV DQG WKHLU DFFXUDF\ DQG ODWHQF\
DQDO\VLV>@ 3UDFWLWLRQHUV XVHG SRSXODU GDWD PLQLQJ
WHFKQLTXHV VXFK DV GHFLVLRQ WUHH .11 QDLYH ED\HV WR
GHYHORS D PRGHO ZKLFK FDQ EH XVHG IRU SUHGLFWLRQ DQG
DQD\VLV RI YDULRXV GLVHDVHV 7KH DXWKRUV LQ WKHLU VXUYH\
SDSHU GHVFULEHG WKH SUHYLRXVO\ HYDOXDWHG UHVXOWV RI
DOJRULWKP FRPSDULVRQ DQG SUHGLFWLRQ DFFXUDF\ RQ WKH
PHGLFDO GDWDVHWV 7KH DOJRULWKPV XVHG IRU FRPSDUDWLYH
VWXG\ ZHUH 1DwYH %D\HV GHFLVLRQ WUHH .11 DQG EDFN
SURSDJDWLRQ PHWKRG>@ &ODVVLILFDWLRQ LV D VXSHUYLVHG
OHDUQLQJPHWKRGXVHGIRUHODERUDWLQJWKHIDPRXVFODVVHVRI
GDWD&ODVVLILHUVOLNH1DwYH%D\HV'HFLVLRQ7UHHDQGDOVR
FOXVWHULQJKDYHEHHQXVHGWRGLDJQRVHDQGSUHGLFWWKHKHDUW
GLVHDVH LQ SDWLHQW 7KH FKDOOHQJH RI SRVLWLRQLQJ DQG
WRJHWKHU JURXSLQJ RI VLPLODU HOHPHQWV ZDV VRUWHG E\ +XL
;LRQJHWDOLQWKHLUDUWLFOHEDVHGRQFOXVWHULQJLQ>@
7KHUH DUH YDULRXV DSSOLFDWLRQV RI FOassifiFDWLRQ VXFK DV
PHGLFDOGLDJQRVLVVWXGHQWWUDFNXSV\VWHPDQGDOVRFDQEH
XVHG LQ ILHOG RI ELRORJ\ IRU JHQHWLF LGHQWLILFDWLRQ 1X]KDW
)6KDLNKHWDOLQWKHLUSDSHUGHVFULEHGWKHLPSOHPHQWDWLRQ
RIQHXUDOQHWZRUNVDQGDUWLILFLDOLQWHOOLJHQFHWHFKQLTXHVWR
LPSURYH WKH DFFXUDF\ RI LULV UHFRJQLWLRQ V\VWHP DQG
PDNLQJLWXVHUFRQYHQLHQW>@
GLVHDVHV LQ UHDO WLPH WR SUHYHQW IXWXUH KD]DUGV DQG WR DYRLG
IXUWKHULVVXHVDQGSUREOHPV$WDEXODUGDWDVHWLVFRQVWUXFWHG
E\HQFDSVXODWLQJDOORIWKHPHGLFDOGLJLWDOGDWDDQGLVXVHGIRU
IXUWKHUH[SHULPHQWVRISUHGLFWLRQDQDO\VLV7KHVHOHFWHGWDUJHW
DOJRULWKPV DUH ZHLJKHG E\ FRQVLGHULQJ IDFWRUV OLNH
FODVVLILFDWLRQ DQG ODWHQF\ DFFXUDF\ DQG WKH DOJRULWKP WKDW
JLYHV RXW KLJKHVW DFFXUDF\ LV VHOHFWHG WR FODVVLI\ WKH
SUHYLRXVO\ XQNQRZQ DQG XQVHHQ GDWD WXSOH ZLWK H[DPSOHV
DFFRUGLQJWRLWVFODVV
$ ([LVWLQJ6\VWHP
,Q WKH SUHYLRXV \HDUV UHVHDUFKHUV DQG SUDFWLWLRQHUV LQ WKH
ILHOG RI PHGLFDO DQG KHDOWKFDUH KDYH DFKLHYHG VXFFHVV LQ
SUHGLFWLQJ D VSHFLILF GLVHDVH XVLQJ GDWD PLQLQJ DOJRULWKPV
DQG WHFKQLTXHV ,W ZDV VWDWHG WKDW WKH XVH RI FODVVLILFDWLRQ
DOJRULWKPVOLNHGHFLVLRQWUHHDQGEDFNSURSDJDWLRQPHWKRGWR
SUHGLFW KHDUW GLVHDVH XVLQJ WUDLQLQJ GDWDVHWV ZKLFK ZHUH
GRZQORDGHG IURP WKH RIILFLDO 8&, UHSRVLWRU\ ZKLFK LV
GHSOR\HG RQ WKH LQWHUQHW 2QH RI WKH GUDZEDFNV RI WKH
SUHYLRXV DQG H[LVWLQJ V\VWHPV DUH WKDW WKH\ ZHUH UHODWHG WR
FODVVLILFDWLRQ DOJRULWKPV DQG PHGLFDO GDWDVHWV ZHUH
LPSOHPHQWHGE\FRQVLGHULQJRQO\RQHPHGLFDOGDWDVHWRQO\
% 3URSRVHG:RUN
7KH DEVWUDFW DQG VHFWLRQV PHQWLRQHG DERYH SURSRVHV DQ
DGYDQFHG DQGHIILFLHQW SUHGLFWLRQ RI PXOWLSOH GLVHDVHVEDVHG
RQ SDVW KLVWRULFDO WUDLQLQJ GDWD 7KH LGHDO VWUDWHJ\ LV WR
DQDO\VH DQG WHVW YDULRXV GDWDPLQLQJ DOJRULWKPV DQG WR
LPSOHPHQW WKH DOJRULWKP ZKLFK JLYHV RXW KLJKHVW GHJUHH RI
DFFXUDF\ 7KH 'DWDVHWV VHOHFWHG IRU LPSOHPHQWDWLRQ SXUSRVH
FRQWDLQV PRUH WKDQ  PHGLFDO UHODWHG DWWULEXWHV IRU HDFK
GLVHDVH DQG PD[LPXP XSWR  DOJRULWKPV WUDLQLQJ GDWD
H[DPSOHV 7KH PHGLFDO GDWDVHWV VHOHFWHG IRU WKH SURMHFW DUH
KHDUW GLVHDVH EUHDVW FDQFHU $UWKULWLV DQG GLDEHWHV 7KH
DOJRULWKP XVHG WR LPSOHPHQW LQ WKLV SURMHFW LV 1DLYH %D\HV
ZKLFK LV VHOHFWHG E\ HYDOXDWLQJ WKH SUHGLFWLYH DFFXUDF\ DQG
ODWHQF\ DQDO\VLV UHVXOWV 7KH SURMHFW DOVR FRQVLVWV RI D
YLVXDOL]DWLRQ PRGXOH LQ ZKLFK WKH PHGLFDO GDWDVHWV DUH
GLVSOD\HG LQ D GLDJUDPPDWLF UHSUHVHQWDWLRQ XVLQJ diffeUHQW
GDWDYLVXDOL]DWLRQWHFKQLTXHVIRUXVHUFRQYHQLHQFHDQGEHWWHU
XQGHUVWDQGLQJ

,9'$7$0,1,1*7(&+1,48(6

$'DWD0LQLQJ$OJRULWKPV
 'HFLVLRQWUHH,QGXFWLRQ
$GHFLVLRQWUHHLVDGDWDPLQLQJVWUXFWXUHZKLFKUHVHPEOHVD
WUHH OLNH GLDJUDP FRQVLVWLQJ RI QXPEHU RI QRGHV DQG HGJHV
7KH QRGHV UHSUHVHQW WKH WHVW RQ WKH DWWULEXWHV DQG WKH HGJHV
UHSUHVHQWV WKH RXWFRPH RI WKH WHVW RQ WKH DWWULEXWH 7KH ,)
7+(1UXOHVDUHXVHGWREXLOGXSUXOHVRQDQ\GHFLVLRQWUHH
7KH OHDUQLQJ RI GHFLVLRQ WUHH LV FDOOHG DV GHFLVLRQ WUHH
LQGXFWLRQ7KHDOJRULWKPVXVHGIRUGHFLVLRQWUHHFRQVWUXFWLRQ
DUH & &+$,' &$57 DQG WKH PRVW FRPPRQO\ XVHG
 DOJRULWKP LV ,' ,QWHUDFWLYH 'LFKRWRPLVHU  7KH GHFLVLRQ

330 2017 International Conference On Big Data Analytics and computational Intelligence (ICBDACI)
WUHHDOJRULWKPKDVWKHEHVWDGYDQWDJHRIDOOWKHWLPHWKDWLV
LWFDQKDQGOHQXPHULFDODVZHOODVFDWHJRULFDOGDWDZLWKRXW
DQ\LQWHUIHUHQFH0RQLND*DQGKLHWDOLQWKHLUDUWLFOHZKLFK
ZDV SXEOLVKHG LQ ,1',$&RP FRQIHUHQFH LQ  JDYH D
EDVLF RYHUYLHZ DERXW GHFLVLRQ WUHH LQGXFWLRQ WKLV GDWD
PLQLQJ DOJRULWKP FDQ KDQGOH ERWK QXPHULFDO GDWD DQG
FDWHJRULFDOGDWD>@7KHPRVWFRPPRQO\XVHGDOJRULWKPWR
%D\HVLDQ /DE HWF DUH VRPH RI WKH RSHQ VRXUFH GDWD PLQLQJ
SODWIRUPV DYDLODEOH RQ WKH LQWHUQHW PDUNHWV 7KH SODWIRUP
XVHG LQ WKLVSURMHFW LV³:(.$´ ZKLFK LVDOVRWKH ODWHVW
YHUVLRQ RI :(.$ WRRO VRIWZDUH DYDLODEOH SUHVHQWO\ 7KH
VRXUFHV IURP WKH LQWHUQHW VD\V WKDW :(.$ DV WKH QDPH
VRXQGV VWDQGV IRU :DLNDWR (QYLURQPHQW IRU .QRZOHGJH
DQDO\VLV WKLV VRIWZDUH ZDV FRGHG LQ MDYD LQ LWV HDUO\ VWDJHV
EXLOGDGHFLVLRQWUHHLV,',QWHUDFWLYHGLFKRWRPL]HG$
GHFLVLRQ WUHH LV D VWUXFWXUH FRQVLVWLQJ RI OHDI URRWV DQG
EUDQFKHV7KHOHDYHVLQWKHWUHHUHSUHVHQWVWKHFODVVODEHO
ZKHUHWKHUXOHVFRQVWUXFWHGXSRQWKHWUHHDUHXVHGWRILQG
RXWWKHFODVVODEHORIWKHSUHYLRXVO\XQVHHQH[DPSOHV
x -'HFLVLRQ7UHH
'HFLVLRQ 7UHH $OJRULWKP LV WR ILQG RXW WKH ZD\ WKH
DWWULEXWHVYHFWRU EHKDYHV IRU D QXPEHU RI LQVWDQFHV 7KH
FODVVHV IRU WKH QHZO\ JHQHUDWHG LQVWDQFHV DUH EHLQJ IRXQG
DQG ODWHU RQ ZDV HYROYHG IRU RSHUDWLQJ RQ GDWDVHWV :(.$
FRQWDLQV D SOHWKRUD RI JUDSKLFDO YLVXDOL]DWLRQ PHWKRGV DQG
DOJRULWKPV IRU GDWD DQDO\VLV DQG SUHGLFWLRQ SXUSRVHV>@
:(.$VXSSRUWVPDQ\GDWDPLQLQJWDVNVOLNHSUHSURFHVVLQJ
DVVRFLDWLRQFOXVWHULQJDQGFODVVLILFDWLRQ:(.$WDEFRQVLVWV
RI XVHU LQWHUIDFLQJ RSWLRQV VXFK DV H[SORUHU NQRZOHGJH
XWLOLW\ &/, DQG :RUNEHQFK RSWLRQV 7KH H[SORUHU RSWLRQ LQ
WKH WDE LV XVHG IRU VHOHFWLRQ RI DQ\ GDWDVHW ZKLFK LV LQ DUII
IRUP DQG WR SHUIRUP RSHUDWLRQV RQ LW VXFK DV FOXVWHULQJ
SUHGLFWLRQ DVVRFLDWLRQ DQG YLVXDOL]DWLRQ :(.$ SURYLGHV D
FRQQHFWLYLW\ EULGJH WR 64/ GDWDEDVHV XVLQJ -DYD 'DWDEDVH
RQWKHEDVLVRIWKHWUDLQLQJLQVWDQFHV7KLVDOJRULWKPFDQEH &RQQHFWLYLW\ RYHU 2'%& 2SHQ GDWDEDVH FRQQHFWLYLW\ DQG
XVHG WR FRQVWUXFW VRPH UXOHV WKDW FDQ EH XVHG IRU WKH FDQSURFHVVWKHUHVXOWUHWXUQHGE\DGDWDEDVHTXHU\JLYHQE\
SUHGLFWLRQRIWKH FODVVODEHORIWKHWHVWLQJGDWD7KHFULWLFDO WKH XVHU $UHDV OLNH VHTXHQFH PRGHOOLQJ DQG RWKHUV DUH QRW
GLVWULEXWLRQ RI WKH GDWD LV HDVLO\ XQGHUVWDQGDEOH ZLWK WKH FRYHUHG XQGHU :(.$ 'LVWULEXWLRQ 6RPH 6QDSVKRWV RI
KHOSRIWUHHFODVVLILFDWLRQDOJRULWKP-LVDQH[WHQVLRQRI :(.$ SURFHVVLQJ WKH DUWKULWLV GDWDVHW DUH EHHQ GHVFULEHG
,' 2WKHU IHDWXUHV RI - DOJRULWKP DUH WKDW LW VXSSRUWV EHORZ
WUHHSUXQLQJFDQKDQGOHPLVVLQJYDOXHVDQGDOVRJLYHVRXW 
HIILFLHQWRXWSXWLQSUHGLFWLRQDQDO\VLV,Q:(.$-LVDQ
RSHQ VRXUFH -DYD LPSOHPHQWDWLRQ RI WKH & DOJRULWKP
DQGGHYHORSHGE\:(.$¶VGHYHORSPHQWWHDP$FFRUGLQJ
WR WKH UHVXOWV ZKHQ - DQG 1DwYH %D\HV ZHUH FRPSDUHG
IRU DQDO\VLV SXUSRVH ERWK WKH DOJRULWKPV SHUIRUPHG
HIILFLHQWO\ EXW DV 1DwYH %D\HV ZRUNV JRRG ZLWK ODUJH
QXPEHU RI GDWD LQVWDQFHV LW RXWFODVVHG WKH SHUIRUPDQFH
WHVW

x 1DwYH%D\HV&ODVVLILHU
1DLYH %D\HV LV D WHFKQLTXH IRU FRQVWUXFWLQJ FODVVLILHUV 7KH
FODVVLILHU LV XVHG WR DVVLJQ FODVV ODEHOV WR YDULRXV SUREOHP
LQVWDQFHV XVLQJ WKH FRQFHSWV RI VWDWLVWLFV DQG FDOFXODWLRQV ,W LV
PRGHO ZKLFK UHTXLUHV RQO\ D ILQLWH QXPEHU RI WUDLQLQJ GDWD WR
HYDOXDWHWKHILHOGVUHTXLUHGIRUSUHGLFWLYHPLQLQJ%D\H¶VWKHRUHP
VHUYHV DV WKH EDVH IRU WKH QDwYH %D\HV DOJRULWKP LQ ZKLFK LW
H[SODLQV WKH UHODWLRQVKLS EHWZHHQ FRQGLWLRQDO RU GHSHQGHQW
SUREDELOLW\ DQG XQFRQGLWLRQDO RU LQGHSHQGHQW SUREDELOLW\ 7KH
HTXDWLRQJLYHQEHORZGHVFULEHVDQGRXWOLQHVWKHHQWLUH%D\H¶V 
WKHRUHP DQG WKH UHODWLRQVKLSV EHWZHHQ WKH SUREDELOLWLHV %D\HV
WKHRUHP ZDV LQYHQWHG WR GHGXFH WKH OLQNV DQG UHODWLRQVKLSV )LJ([SORUHU9LHZRIDWWULEXWHVRIGDWDVHWXVLQJ:(.$
EHWZHHQ WKH SUREDELOLWLHV 7KHUH DUH EDVLFDOO\ WZR W\SHV RI 
SUREDELOLWLHV RQH LV WKH FRQGLWLRQDO DQG RWKHU LV XQFRQGLWLRQDO
SUREDELOLW\ 7KH SUREDELOLW\ ZKLFK LV UXOHG RXW EHIRUH REWDLQLQJ
WKH HYLGHQFH LV FDOOHG DV XQFRQGLWLRQDO RU SULRU SUREDELOLW\ 7KH
SUREDELOLW\ZKLFKFRPHVLQWRSOD\DIWHUREWDLQLQJWKHHYLGHQFHLV
FDOOHG DV FRQGLWLRQDO RU SRVWHULRU SUREDELOLW\ ,Q WKH HTXDWLRQ
PHQWLRQHG EHORZ 3$ DQG 3% DUH WKH SULRU RU XQFRQGLWLRQDO
SUREDELOLWLHV DQG 3$_% DQG 3%_$ DUH WKH FRQGLWLRQDO
SUREDELOLWLHVZKHUHWKHILUVWHYHQWGHSHQGVRQWKHRFFXUULQJRIWKH
VHFRQGHYHQW

 (T


%'DWD0LQLQJ3ODWIRUPV
9DULRXV RSHQ VRXUFH GDWD PLQLQJ SODWIRUPV DUH DYDLODEOH 
RQOLQH RU RQ WKH LQWHUQHW PDUNHWV 7KHVH DSSOLFDWLRQV DUH )LJ9LVXDOL]DWLRQRIDOOWKHDWWULEXWHVRIWKHGDWDVHWLQ:(.$
IUHH OLFHQVHG DQG VPDOO LQ VL]H :(.$ 5DSLG 0LQHU


2017 International Conference On Big Data Analytics and computational Intelligence (ICBDACI) 331
 9'$7$9,68$/,=$7,21 WKHQ FDQ EH RULHQWHG KRUL]RQWDOO\  9DULRXV W\SHV RI EDU
JUDSKV DUH VLPSOH EDU JUDSK YHUWLFDO DQG KRUL]RQWDO EDU
'DWDLQWUHPHQGRXVDPRXQWLVYHU\GLIILFXOWWRXQGHUVWDQG JUDSKUDQJHEDUJUDSKDQGKLVWRJUDP
DQG LQWHUSUHW 7KH ELJ GDWD FDQ EH UHSUHVHQWHG LQ IRUP RI
LQWHUHVWLQJ VKDSHV LQ GLIIHUHQW VL]HV XVLQJ OLQHV DQG GRWV
7KHJUDSKLFDOYLVXDOL]DWLRQRIWKLVGDWDKHOSVWRGLVSOD\WKH
FRQFHSWVLQVLPSOHZD\DQGOHDGWRHDVHRIXQGHUVWDQGLQJ
9LVXDO GDWD PLQLQJ KHOSV WR GHDO ZLWK WKH KXJH GDWD DQG
IORRG RI LQIRUPDWLRQ LQWHJUDWLQJ WKH KXPDQ LQ GDWD
DQDO\WLFV SURFHVV ,W DOORZV XVHU WR DFTXLUH WKH LQVLJKWV RI
WKH GDWD DQG GHULYH FRQFOXVLRQV E\ LQWHUDFWLQJ ZLWK WKH
GDWD3URI3LHU/XFDHWDOLQWKHLUDUWLFOHRI³9LVXDOL]DWLRQ
LQ 'DWD 0LQLQJ´ PHQWLRQHG WKH DSSURDFKHV RI GDWD
YLVXDOL]DWLRQ LQ EULHI>@ 7KH DSSURDFKHV LQ GDWD
YLVXDOL]DWLRQDUHGHVFULEHGEHORZ
 3UHVHQWDWLRQ 9HU\ ILUVW VWDJH LQ ZKLFK GDWD LV
SUHVHQWHGXVLQJSUHVHQWDWLRQPHWKRGV
 &RQILUPDWLYH$QDO\VLV7KHK\SRWKHVLVRIWKHGDWD
LVHLWKHUFRQILUPHGRUUHMHFWHGLQWKLVSKDVH
 ([SORUDWLYH$QDO\VLV7KHWHVWVDUHFDUULHGRQWKH
GDWDZLWKRXWDQ\DQDO\VLV

$ 'DWD9LVXDOL]DWLRQ7HFKQLTXHV
'DWDYLVXDOL]DWLRQLVDWHFKQLTXHRISUHVHQWLQJWKHGDWDLQ
JUDSKLFDO IRUPDW *UDSKLFDO YLVXDOL]DWLRQ XVXDOO\ GHDOV
ZLWK QRGHV DQG OLQNV LQ ZKLFK WKH QRGHV RU WKH YHUWLFHV
UHSUHVHQWWKHDWWULEXWHVDQGWKHOLQNVRUWKHHGJHVUHSUHVHQW
WKH FRQQHFWLRQ EHWZHHQ WKH DWWULEXWHV *UDSKLFDO RU JUDSK 
YLVXDOL]DWLRQ LV WKH VLPSOHVW W\SH RI YLVXDOL]DWLRQ DQG )LJ%DUJUDSKYLVXDOL]DWLRQRI0HGLFDOGDWDVHW
ZKLFKSURYLGHDEHWWHUZD\RIH[SORULQJDQGXQGHUVWDQGLQJ
GDWD 6RPH WHFKQLTXHV RI WKH FKRVHQ YLVXDOL]DWLRQ 7KHDERYHJLYHQILJXUHGHVFULEHVWKHEDUJUDSKYLVXDOL]DWLRQ
WHFKQLTXHV ZKLFK DUH DOVR XVHG LQ WKH SURMHFW DUH HQOLVWHG RIWKHDWWULEXWHVVXFKDV$OFRKROFRQVXPSWLRQ(DUO\PRUQLQJ
EHORZ VWLIIQHVV DQG /RVV RI VOHHS 7KH FRORXUV UHG EOXH DQG IDLQW
JUHHQLQGLFDWHWKHFODVVHVVXFKDVQHJDWLYHSRVLWLYHDQGPD\
D/LQH*UDSKVE3LHFKDUWVF%DUJUDSKV
x ''/LQH*UDSKV
7KHGDWDLVYLVXDOL]HGLQIRUPRIOLQHVDQGGRWVLQPXOWLSOH
GLPHQVLRQV 7KH JUDSK FDQ KDYH PXOWLSOH D[HV DQG WKH
UHDGLQJV FDQ EH SORWWHG DW WKH FRRUGLQDWHV RQ WKH SODQH
7KH ILJXUH JLYHQ EHORZ GHSLFWV WKH GHWDLOV DERXW WKH OLQH
JUDSK
RFFXULQIXWXUH
x 3LH&KDUWV
$SLHFKDUWLVXVHGWRGHVFULEHDELJFKXQNRIGDWDLQWRVPDOO
VOLFHV RI GDWD ZKHUH HDFK VOLFH LQGLFDWHV WKH DPRXQW RI
HOHPHQWV LQ WKH FDWHJRU\ RI WKH GDWDVHW 0RVWO\ WKLV W\SH RI
YLVXDOL]DWLRQ LV XVHG LQ VWDWLVWLFV DQG PDWKHPDWLFDO
FRPSXWDWLRQV


)LJ'/LQHJUDSK 
 )LJ3LHFKDUWYLVXDOL]DWLRQ7HFKQLTXH
x %DU*UDSKV $V VKRZQ LQ ILJ  WKH SLH FKDUW VKRZV GLIIHUHQW FDWHJRULHV
VXFK DV VGRJV FDWV ILVK UDEELWV HWF LQ D PDWKHPDWLFDO
$ EDU JUDSK LV PDWKHPDWLFDO UHSUHVHQWDWLRQ RI GDWD %DU SHUFHQWDJHFRXQW
JUDSK VKRZV FRPSDULVRQ EHWZHHQ GLIIHUHQW FDWHJRULHV RI
WKH GDWD 7KH GHSHQGHQF\ DQG FRUUHODWLRQ EHWZHHQ WKH x $GYDQWDJHVRI'DWD9LVXDOL]DWLRQ
DWWULEXWHVLVUHSUHVHQWHGLQIRUPRIVROLGEDUVKDSHVRQWKH
'DWDYLVXDOL]DWLRQKDVPDQ\DGYDQWDJHVIHZRIWKHPDUH
JUDSK ,I WKH GHVFULSWLRQV DUH RQ WKH KRUL]RQWDO D[LV WKH
OLVWHGEHORZ
EDUVZLOOEHRULHQWHGYHUWLFDOO\DQGLIRQWKHYHUWLFDOD[LV

332 2017 International Conference On Big Data Analytics and computational Intelligence (ICBDACI)
  (DVHRIXQGHUVWDQGLQJDQGH[SORUDWLRQRIGDWD
 1R FRPSOH[ VWDWLVWLFDO DQG PDWKHPDWLFDO
FDOFXODWLRQVDUHUHTXLUHGIRUYLVXDOL]DWLRQ
 $ EHWWHU ZD\ RI NQRZOHGJH ILOWHULQJ DQG
NQRZOHGJHUHSUHVHQWDWLRQ
 XVHGIRULPSOHPHQWLQJRQWKHWUDLQLQJGDWDVHWV1DwYH%D\HV
9,(;3(5,0(17$/5(68/76
$VPHQWLRQHGLQWKHDERYHVHFWLRQWKHDOJRULWKPVXVHGIRU
FRPSDULVRQ ZHUH 1DwYH %D\HV DQG 'HFLVLRQ WUHH¶V -
7KHVHWZRDOJRULWKPVZHUHWHVWHGRQGDWDVHWVEXLOWLQDUII
DQG FVY IRUPDWV 'DWDVHWV RI IHZ GLVHDVHV ZHUH
GRZQORDGHGIURPWKH8&,UHSRVLWRU\ZKHUHDVIHZRIWKHP
ZHUH EHHQ FRQVWUXFWHG E\ FRQVXOWLQJ GRFWRUV DQG
UHVHDUFKLQJ DERXW WKH GLVHDVH 7KH GDWDVHWV RI GLVHDVH
VHOHFWHG ZHUH 3LPD ,QGLDQ GLDEHWHV EUHDVW FDQFHU KHDUW
GLVHDVHDQGDUWKULWLV(YHU\GDWDVHWFRQVLVWHGRIDERXW
WR  GDWD LQVWDQFHV DQG  DWWULEXWHV>@ 7KH
DOJRULWKPV VHOHFWHG IRU FRPSDULVRQ ZHUH MXGJHG RQ WKH
EDVLV RI DFFXUDF\ DQG WLPH WDNHQ IRU SUHGLFWLRQ RI FODVV
ODEHOV
7DEOH$FFXUDF\DQDO\VLVRIDOJRULWKPVRQWKHGDWDVHWV



7KH FOLQLFDO GDWD UHODWHG WR GLVHDVHV OLNH GLDEHWHV %UHDVW
FDQFHU+HDUWGLVHDVHDQGDUWKULWLVZHUHREWDLQHGPDQXDOO\
RU E\ GRZQORDGLQJ LW IURP WKH 8&, UHSRVLWRU\ 7KH
DOJRULWKPVOLNH1DwYH%D\HVDQG-ZHUHWHVWHGRQWKHVH
GDWDVHWV RQ WKH IDPRXV GDWD PLQLQJ SODWIRUP FDOOHG
³:(.$´ 7KH WUDLQLQJ VHWV RI WKH GDWD ZHUH GLVPDQWOHG
LQWR FURVV YDOLGDWLRQ DQG E\ XVLQJ VWUDWLILFDWLRQ
WHFKQLTXHV %\ FRQVLGHULQJ REVHUYDWLRQV VKRZQ LQ WKH
DERYH WDEOH  ZH FDQ FRQFOXGH WKDW WKH 1DLYH %D\HV
RXWFODVVHV WKH FRPSDUDWLYH WHVW ZLWK - DQG H[FHOV WKH
KLJKHVW SHUFHQWDJH RI DFFXUDF\ RQ DOO WKH GDWDVHWV WDNHQ
LQWRFRQVLGHUDWLRQ
7DEOH/DWHQF\$QDO\VLVRIDOJRULWKPVRQWKHGDWDVHWV


2017 International Conference On Big Data Analytics and computational Intelligence (ICBDACI)
$V VKRZQ LQ WKH DERYH WDEOH  WKH SHUIRUPDQFH VWXG\ RI
DOJRULWKPV RQWKH EDVLVRI WLPH WDNHQ WREXLOG WKHGDWDVHWRU
WKH ODWHQF\ GXUDWLRQ ZDV DOVR FRQGXFWHG LQ WKH SHUIRUPDQFH
DQDO\VLVSURFHVV:(.$ZDVWKHGDWDPLQLQJSODWIRUPXVHG
ZKHUH 0XOWLFODVV 1DLYH %D\HV DQG'HFLVLRQ WUHH¶V-ZHUH
RXWSHUIRUPHGWKLVWHVWE\JLYLQJRXWDPLQLPXPODWHQF\RI
VHFRQGV WR  VHFRQGV RQ HDFK WDUJHW GDWDVHW :KLOH -
UHVXOWHGLQJLYLQJDEXLOGLQJWLPHGRPDLQIURPVHFRQGVWR
VHFRQGV RQ WKH WDUJHW GDWDVHWV %\ FRQVLGHULQJ DOO WKH
SHUIRUPDQFH UHVXOWV DQG WHVWV FRQGXFWHG RQ WKH GDWDVHWV
1DwYH %D\HV DOJRULWKP ZDV VHOHFWHG IRU LPSOHPHQWDWLRQ LQ
IXUWKHUSURMHFWZRUNDQGDQDO\VLV
$ 'HVFULSWLRQRI'DWDVHWV
7KHGDWDVHWVXVHGLQWKHSURMHFWFRQVLVWVRIDWWULEXWHVDQGGDWD
LQVWDQFHV LQ ODUJH DPRXQW 7KH FRXQW RI DWWULEXWHV DQG
WUDLQLQJ GDWD LQVWDQFHV LQ HDFK GDWDVHW LV EHLQJ GHVFULEHG
EHORZ
 3LPD,QGLDQ'LDEHWHV'DWDVHW
$WWULEXWHV
'DWD,QVWDQFHV
 %UHDVW&DQFHU'DWDVHW
$WWULEXWHV
'DWD,QVWDQFHV
 +HDUW'LVHDVH'DWDVHW
$WWULEXWHV
'DWD,QVWDQFHV
 $UWKULWLV'DWDVHW
$WWULEXWHV
'DWD,QVWDQFHV

7DEOH$WWULEXWHVRIWDUJHWGDWDVHWV

$WWULEXWHVVXFKDVQDPHDJHDQGVH[ZHUHFRPPRQLQDOOWKH
WDUJHW GDWDVHWV 2WKHU DWWULEXWHV ZKLFK DUH FRQVLGHUHG IRU
SUHGLFWLRQ DUH IDPLO\ KLVWRU\ DQG REHVLW\ 7KH HQG SDWLHQW
XVHUV DUH VXSSRVHG WR HQWHU WKH IHZ SDUDPHWHUV DW WKH IURQW
HQG XVHU LQWHUIDFH 7KH FODVVLILFDWLRQ DOJRULWKP ZKLFK LV
UXQQLQJ DW WKH EDFN HQG RQ WKH GDWDVHWV FRPSDUH WKH WHVWLQJ
GDWD DOVR FDOOHG DV SUHYLRXVO\ XQVHHQ GDWD ZLWK WKH WUDLQLQJ
GDWD DOVR FDOOHG DV WKH GDWD LQ WKH GDWDVHW 7KH LQSXW GDWD
ZKRVHSURSHUWLHV PDWFK ZLWK WKH WUDLQLQJ GDWD LV UHWXUQHGDV
FODVVODEHORIWKDWLQVWDQFH,QFULWLFDOGLVHDVHGDWDVHWVXFKDV
EUHDVW FDQFHU DWWULEXWHV VXFK DV 0HQRSDXVH GHWDLOV WXPRXU
VL]H EUHDVW VL]H DQG VLGH SOD\V D PDMRU UROH LQ WKH
FODVVLILFDWLRQRIGLVHDVH$UWKULWLVLVDORQJVWDQGLQJFKURQLF
333
GLVHDVHZKLFKFDXVHVPDQ\GLVDELOLWLHV$UWKULWLVFDQRFFXU 9,,,5()(5(1&(6
DWDQ\DJHXVXDOO\VHHQLQ\RXQJZRPHQ7KHUHDUHPDQ\
@ $QNLWD 'HZDQ  0HJKQD 6KDUPD  ´3UHGLFWLRQ RI +HDUW 'LVHDVH
W\SHV RI DUWKULWLV WKDW FDQ RFFXU LQ VPDOO FKLOGUHQ DOVR ,I
8VLQJ D +\EULG 7HFKQLTXH LQ 'DWD 0LQLQJ &OassificatLRQ´  
QRW SURSHUO\ WUHDWHG DW WKH HDUO\ VWDJHV LW FDQ FDXVH
QG,QWHUQDWLRQDO&RQIHUHQFH RQ &RPSXWLQJ IRU 6XVWDLQDEOH *OREDO
GHIRUPLWLHV LQ WKH HDUO\ DJHV 7KH PDMRU IDFWRUV RU
SDUDPHWHUVZKLFKDUHVHHQDVWKHV\PSWRPVRIDUWKULWLVDUH
MRLQWSDLQMRLQWVZHOOLQJHDUO\PRUQLQJVWLIIQHVVREHVLW\
DOFRKRO DQG VPRNLQJ KDELWV ORVV RI VOHHS DQG ORVV RI
DSSHWLWH 7KHQ LQSXW IRU V\PSWRPV VXFK DV MRLQW SDLQ DQG
VZHOOLQJOHYHOLVWDNHQDVKLJKPHGLXPDQGORZIURPWKH
HQGXVHUV)RUREHVLW\DOFRKRODQGVPRNLQJKDELWLQSXWLV
WDNHQDV\HVRUQR7KHILQDOFODVVODEHORIWKHGDWDVHWFDQ
'HYHORSPHQW,1',$&RP,(((
@ $GDP 6DGLOHN +HQU\ .DXW] /DXUHQ 'L3UHWH %ULDQ/DEXV(ULF
3RUWPDQ-DFN7HLWHODQG9LQFHQW6LOHQ]LR³'HSOR\LQJQ(PHVLV
3UHYHQWLQJ )RRG ERUQH ,OOQHVVE\ 'DWD 0LQLQJ 6RFLDO
0HGLD´1HZ<RUN
@ -\RWL 6RQL 8MPD $QVDUL 'LSHVK 6KDUPD 6XQLWD 6RQL 
´3UHGLFWLYH 'DWD 0LQLQJ IRU 0HGLFDO 'LDJQRVLV $Q 2YHUYLHZ RI
+HDUW 'LVHDVH 3UHGLFWLRQ´  ,QWHUQDWLRQDO -RXUQDO RI &RPSXWHU
EHHLWKHURIWKHWKUHHWKDWLVSRVLWLYHQHJDWLYHRUFDQRFFXU $SSOLFDWLRQV9ROXPH1R0DUFK
LQIXWXUH
@$EKLVKHN7DQHMD´3UHGLFWLRQRIKHDUWGLVHDVHVXVLQJGDWDPLQLQJ
9,,&21&/86,21 WHFKQLTXHV´ 2ULHQWDO -RXUQDO RI FRPSXWHU VFLHQFH DQG WHFKQRORJ\
'HFHPEHU9RO1R3JV
7KH FXUUHQW DGYDQFHPHQW GHYHORSPHQW DQG LPSURYHPHQW @ 7 5HYDWKL 6 -HHYLWKD ´&RPSDUDWLYH 6WXG\ RQ +HDUW 'LVHDVH
LQ WKH GDWD PLQLQJ DOJRULWKPV KDYH DVVXUHG DQ HDVH LQ 3UHGLFWLRQ 6\VWHP 8VLQJ 'DWD 0LQLQJ 7HFKQLTXHV ´,QWHUQDWLRQDO
REWDLQLQJLQVLJKWVDQGSUHFLVHSUHGLFWLRQUHVXOWV7KHSDSHU -RXUQDORI6FLHQFHDQG5HVHDUFK,-65,6612QOLQH
HQOLJKWHQVDOOWKHFKDOOHQJHVLVVXHVDQGREVWDFOHVIDFHGE\ ,QGH[&RSHUQLFXV9DOXH
PHGLFDO SUDFWLWLRQHUV ZKLOH GHWHUPLQLQJ WKH GLVHDVH RI D @ $MLQN\D .XQMLU +DUVKDO 6DZDQW 1X]KDW 6KDLNK´ $ 6XUYH\ RQ
SDWLHQWZLWKRXWFRQVLGHULQJWKHPHGLFDOGDWDRIWKHSDWLHQW 3UHGLFWLRQ RI 0XOWLSOH 'LVHDVHV DQG 3HUIRUPDQFH $QDO\VLV XVLQJ
7KHFRQFOXVLRQGHULYHGIURPWKHHYDOXDWLRQUHVXOWVRI- 'DWD0LQLQJDQG9LVXDOL]DWLRQ7HFKQLTXHV´,QWHUQDWLRQDO-RXUQDORI
DQG1DwYH%D\HVLWZDVREVHUYHGWKDW1DwYH%D\HVUHVXOWV &RPSXWHU $SSOLFDWLRQV  ±  9ROXPH  ± 1R 
LQ EHVW DFFXUDF\ RI SUHGLFWLRQ DQG HYHQ RXWFODVVHV - LQ 'HFHPEHU
WKHODWHQF\DQDO\VLVRQWKHGDWDVHWV7KHSURSRVHGZRUNLV @ +,&$3+LHUDUFKLDO &OXVWHULQJ ZLWK 3DWWHUQ 3UHVHUYDWLRQ 
HIILFLHQWHQRXJKWREXLOGDQH[SHUWGHFLVLRQVXSSRUWV\VWHP +XL ;LRQJ 0LFKDHO 6WHLQEDFK 3DQJ1LQJ 7DQ DQG 9LSLQ .XPDU
ZKLFK FDQ EH XVHG E\ PHGLFDO SUDFWLWLRQHUV IRU HQKDQFHG ,Q 3URF RI WKH )RXUWK 6,$0 ,QWHUQDWLRQDO &RQI RQ 'DWD 0LQLQJ
GLDJQRVLV DQG DOVR FDQ EH XVHG E\ SDWLHQW XVHUV IRU
SUHGLFWLRQ RI GLVHDVH $OO WKH FRQILGHQWLDO PHGLFDO GDWD LV
JDWKHUHG IURP WKH KRVSLWDOV DQG 8&, UHSRVLWRU\ DQG
6'0¶)ORULGD86$
@ 1X]KDW)6KDLNK'KDUPSDO''R\H,PSURYLQJWKH$FFXUDF\
RI ,ULV 5HFRJQLWLRQ 6\VWHP XVLQJ 1HXUDO 1HWZRUN DQG 3DUWLFOH
6ZDUP 2SWLPL]DWLRQ ,QWHUQDWLRQDO -RXUQDO RI &RPSXWHU
DOJRULWKPV DUH DSSOLHG RQ WKHP IRU WKH EHVW SHUIRUPDQFH
DQDO\VLV7KHSDSHUDOVRRXWOLQHVWKHWHFKQLTXHVDQGW\SHV
RI GDWD YLVXDOL]DWLRQ WHFKQLTXHV ZKLFK DUH XVHG LQ WKLV
SURMHFW V\VWHP DQG LPSOHPHQWHG RQ WKH PHGLFDO GDWDVHWV
$SSOLFDWLRQV±9ROXPH±1R2FWREHU
@ 0RQLND *DQGKL 'U6KDLOHQGUD 1DUD\DQ 6LQJK ´3UHGLFWLRQV LQ
+HDUW 'LVHDVH 8VLQJ 7HFKQLTXHV RI 'DWD 0LQLQJ´   VW
,QWHUQDWLRQDO &RQIHUHQFH RQ )XWXULVWLF WUHQG LQ &RPSXWDWLRQDO
IRUHDVHRIGDWDXQGHUVWDQGLQJDQGH[SORUDWLRQRIGDWD7KH $QDO\VLV DQG .QRZOHGJH 0DQDJHPHQW $%/$=( ,(((
V\VWHPFDQDOVREHGHSOR\HGRQDQGURLGDQGZHESODWIRUPV 
IRU XVHU FRQYHQLHQFH E\ SRUWLQJ LW E\ YDULRXV FRQYHUVLRQ @ZZZFVZDLNDWRDFQ]POZHND
DSSOLFDWLRQV @ 3URI 3LHU /XFD /DQ]L ³ 9LVXDOL]DWLRQ 7HFKQLTXHV LQ 'DWD
 0LQLQJ´
@DUFKLYHLFVXFLHGXPO




334 2017 International Conference On Big Data Analytics and computational Intelligence (ICBDACI)