MỘT SỐ THUẬT TOÁN HỌC TRÊN BẢNG QUYẾT ĐỊNH
VŨ VĂN HỌC
Trang nhan đề
Mục lục
Lời nói đầu
Chương 1: Dẫn nhập.
Chương 2: Mạng Nơron - Perceptron.
Chương 3: Mạng Perceptron hai lớp.
Chương 4: Bảng quyết định.
Chương 5: Kết luận.
Phụ lục A
Phụ lục B
Phụ lục C
Tài liệu tham khảo
22 trang |
Chia sẻ: maiphuongtl | Lượt xem: 1778 | Lượt tải: 0
Bạn đang xem trước 20 trang tài liệu Luận văn Một số thuật toán học trên bảng quyết định, để xem tài liệu hoàn chỉnh bạn click vào nút DOWNLOAD ở trên
2
MANG N<1-RON.
PERCEPTRON
)
' tu'dngv~nhungmohinhm~ngno-randaulienkhdidautU
nhungDam1940.Vaoh1cd6,hainhaloanhQcMcCullochva
Pitts(19 3) g<;liY v~mQtno-rollnhu'mQtphdnIlt nguiJnglogic(logical
thresholdelement)c6haitr~ngthaikhiidi.MQtphantitngu'cJngnhu'the'
c6n kenhchoduli~unh~pva mQtkenhchoduli~uxu!t.Kenhchodu
li~unh~pdu'<;lccoiladQngne'udauvaola 1,ho~ccoila tinhne'udauvao
la O.Nhu'v~ythongtinnh~pdu'X2,U?
Xn.Thongthu'ongdaynhiphannaydu'<;lccoi la nhungthanhphancua
vecto
x =(Xi> X2, U?xn)
Tr~ngthaicuaphantitngu'cJngchobdi t6h<;lptuye'ntinhcuacae
tinhi~unh~pXidemsosanhvoi mQtgiatringu'cJngs.Tin hi~uxu!tcua
mQtno-rolldinhbdihamoutput:
y =o(L/w/x/-s) (1)
trongd6agQilahaml!y ngu'cJng:o(x)=1ne'uX>0va o(x)=0ne'uX<
0, va caeh~s6Wi=+1.
Qua d6, ngu'oitan6i no-randu'<;lckich ho~tne'ut6 h<;lpI;WiXi trQi
hon ngu'cJngs . Con trongtru'ongh<;lpngu'<;lcl~i, no-roll d6 du'<;lcgQi la
tinh.
Hai ongclingdachiraeachthucmamQtno-rollc6 th€ tht1chi~n
cacpheploanlogic.Chiingh~n,ho~tdQngcuacacc6ngAND trong19
thuye'tm~chlogicho~cvoicaebQchuy€nm~ch(inverter)thid~uc6th€
di~ntiidu'oimQthamtheod~ng(1).
Mllingno-ranperceptron 11
Tuynhien,c6haikhiac~nhquaDtrQngmamohlOOcuaMcCulloch
va Pittsdii khongghliquye'tdu'<;1c.Thanha't,mohlnhtrendiikhonggiiii
thichdu'<;1cca hiliacmacacnd-ronlien l~cvoiOOau-tie'cthay-d6 l~ila
mQtth1!cte'xiiy ra trongsuo'tquatrloohQccuamQtm~ngnd-ron.Tha
hai,nhii'ngm~ngnd-rondohaiongd~rakhongphiinanhdu'<;1ckhiiDang
chiu16i,nha'tlakhisosanhvoikhiiDanga'yndiOOii'ngnd-ronsinhhQc.
Saunay,nhovao Dang11!cuanhii'ngh~tho'ngtioo loanmoi,
nhii'ngnhaphattri€n dii c6 th€ mophongmQtcachchi tie'thdnv~khii
DanghQCcuaOOii'ngm~ngnd-ronvadiineudu'<;1cca liinhv1!cangd~ng
mamohlnhcuahQc6khiiDanggiiiiquye't.
Mo hlOOddngiiinxetdu'oidayla m~ngperceptrondoRosenblatt
d~ravaoDam1948.
2.1M~ngPerceptron:
M~ngperceptIonmQtlOpla mQtmohlnhddngiiinmachungtase
xettrongchu'dngnay.N6 chig6mN ddnvi nd-ron,trongd6m6ind-ron
c6chacDangcuatie'pnh~nthongtinquankeOO,dii'li~udiquam6ikenh
d~ctru'ngbdiXl .Thu'ongthu'ongdii'li~uquam6ikeOOmangmQtrong
haigiatri0 hay1.CungvoichacDanginput,nd-ronilia r trongm~ngc6
hamoutputdinhbdi:
Yr=O(LiWriXi- sr) (2)
voi {Wri}la t~pcactrQngso'xacdjnhchond-ronilia r vaSrlangu'ong.
Khongma'tinht6ngquat,congiliac(2)c6th€ vie'thaOO:
Yr = O(LiWriXi)
voi Wro= Srva Xo= -1.
(3)
Ne'um~ngperceptIonchi g6mmQtddnvi nd-ron,ta n6i d6 la
m~ngperceptIonddnnd-ron.
Kie'ntrUccuamQtm~ngperceptIonhu'motittrenchu'atriiloi cho
Callhoi v~cachiliacho~tdQng.Va'nd~d~tra la: voi mQt~p hii'uh~n
nhii'ngthongtinnh~px, vavoimQt~pconCrchos[n,ngu'oitamuo'ntlm
du'<;1Ct~pnhii'ngtrQngso'{Wri}saochoylx) =1voi mQix 6 Crvaylx) =
0 voix {l!Cr.
M~ngno-ranperceptron 12
Quatrinhxacdinhnhii'ngtrQngs6{Wri}du'<;fcgQila quatrinhhQc.
Va nhii'ngthu~tloanap dt}ngchoquatrinhhQcgQila thuq,thQc.N6i
chung,mQtquatrinhhQCdic3nranhu'san:ngu'CJitakhdit~omQt~ptrQng
s6{Wri}bandftunoino-rOllr, sand6chonhii'ngtrQngs6naylacdQngten
tUngvectoinputx IDeocongtht1'c(3).DI nhien,sec6nhii'ngvectdx e Cr
nhu'ngylx) =0 .Luc d6 ngu'CJita phiH di~uchinh trQngs6 {Wri}bhng s6
gia L1Wri. T~pnhii'ngtrQngs6cu6iclingdu'<;fcchQnkhichungphant1'ng
dungvdi mQix eCr . Trongchu'ongnay,chungtakhaosatnhii'ngthu~t
hQctrenm~ngperceptrondonno-roll.
2.2Tlnhkhatachcuakhonggiannhungvacta'hQc:
B€ c6th€ xacdjnhdu'<;fC~pnhii'ngtrQngs6 {Wri}cu6icling,di~u
d6mythuQcvaobancha'tciiabai loanva vaocachmah6amftunh~p.
B€ giai thich, chung ta hay xet y nghia hinh hQc ciia qua trinh hQc.
Nhii'ngmftuhQcx = (x],X2,"7XL) du'<;fcxemla nhii'ngvectdtrongkhong
gianL chi~u,trongd6, t~ph<;fpCr sedu'<;fctachkhoi nhii'ngvectdkhacbdi
sieuphiing:
WrlX]+Wr2X2+ ". +WrLXL= Wo
Ngu'CJitada neudu'<;fCnhii'ngphanvi dt}v~mQtkhonggiannhii'ngvectd
hQcmakhongt6nt~iba'tct1'sieuphiingnaod€ tachchung.
2.3Tlnhkhatachtuye'ntinh:
B6i vdihait~pmftuthll'C] vaC2 makhongth€ tachdu'<;fCbdimQt
si~uphiing,ngu'CJitasemdrQngs6chi~uciiaciiakhonggianvectdthll'
va anhx~t~pC] va C2 vaokhonggiannaysaochoc6 th€ tachchung
bhngmQtsieuphiing.
[JO
:>
M~ngnd-ronperceptran 13
TinhchathlnhhQCaydu'<JcgQila tinhkhatachtuytntinh.Nhu'v~y,
tinhkhatachtuye'ntinhnhhmbaodamluonluonc6th~chQndu'<Jct~p
cactrQngs6 {Wri}saochobai loanphanlo~icacvectdthax c6th~giiii
du'<Jc.
Trudckhitimhi~ucacthu~thQc,chungtahayxetquamQts61Inh
vl{capd~ngcoam~ngperceptron.
2.4. MOlso'linhvileapd~ng
D Vi dlf-1:Vdi mQtlOpc6giOih~nnhii'ngb~liloanvi ttr,chiingh~nOOu'
xetphatbi~u:"Loandiphffntu troindnghayntu troi l{lnhvagi6
thdihuangdong".TagQinhii'ngvi ttr:
Xl: "TroinAng"
X2:"Troi l~nh"
X3:"Gi6th6ihu'dngdong"
y: "Loandiph6"
va gQichantri cuachungHi1 ho~cO.The'thid~xacdinhh~illh
dQng"Loandiphff"la dunghaysaingu'oitac6 nhieueachthl{c
hi~n.N6ichung,ngu'oitasehmtrii'bangchantricoay:
Bang2.1..Bangchantrj...........................................................................
:.1::::::::::::::::::::::::.:::::::::::::::::::::::0::::::::::::::::::~::::::::-
0 0 0 0
0 0 1 0
0 1 0 0
0 1 1 1
1 0 0 1
1 0 1 1
1 1 0 1
1 1 1 1
va saud6,vdimQtth~hi~nnaod6coavectd (x],Xl,X3) ngu'oitased6i
sanhvectdnayvdido8 tru'ongh<Jptrongbangchantrid~rutramQtke't
lu~nvey.R6rangcachtie'pc~nnayc6dQphuc~p2£dod6khongthich
M\ingno-ranperceptran 14
hQpvoi nhfi'ngtruonghQpmakhonggiannhfi'ngvectdhQcco s6chi~u
khaIon.
Clingvoim1;1cdichthugQnbangchantri,nguoitathilydingBang
2.1.coth<3'rutgQnthanhBang2.2nhusauday
Bang2.2.a:Bangchiintrj dttqcthugQn
[::::::i::I::::::::::i:i:i:::::i:::ii:::::::::::::::::::::::5.li:::::i:i::::::::::::::::::I:::::::::I::::1
0 0 * 0
0 1 0 0
0 1 1 1
1 * * 1
(*) Chiintrj ia 1ho(ic0
Tac gia Celko trong[CELKO] d~nghimQtthu~toansa d1;1ng
Bang2.2.phatsinhmQtdo(;lnchuangtrinhcod(;lngnhu:
IFX1THENY
ELSE
IFX2THEN
IFX3THENY
ELSEERROR
ENDIF
ELSEERROR
ENDIF
ENDIF
Ca che't1;1'dQngphatsinhchuangtrinhIDeogQiy tren, ne'uth1;1'c
hi~nduQc,coynghHikhad~cbi~tvi dochinhla cache'phatsinhchuang
trinh,C1;1th<3'la no phatsinhdo(;lnchuangtrinhphucV1;1vi~cl~plu~ntie'n
trongdonvi maysuydi~ncuabiltcll'h~chuyengianao(Xem Chuang1).
va clingdocache'phatsinhchuangtrinhd1;1'av ocdsdtri thll'c,tathilyca
che'ily th1;1'cs1;1'dfft(;loduQcs1;1'dQcl~pgifi'adfi'li~uva chuangtrinh.Diiu
nay cung co mQtynghiiiquantrQngnhatia trangnhangh? chuyengiama
cosa tri thacthtti'lngco nhangbie'ndQngtheothi'ligian,chungtamu6nh~
Ml)ngno-ranperceptron 15
chuyengianayphiiic6 khananghQcnhanhch6ngnhatm6ikhi c6 stf
bie'ndQngv~cosdtrithuc.Thu~tloannaymdranhungungdI}ngthuvi
chiingh~ntrongvi~ct\f thie'tke'nhungh~CASE la nhungh~trQgiup
phftntichthie'tke'h~th6ngho~cl~ptrlnhchonhungthie'thi di~ukhi~nt\f
dQng.van d~conl~ila thu~tloanphatsinhchuongtrlnhay phaic6dQ
phuct~pchapnh~nduQC.
Cu6idIngla cachtie'pc~nno-rOll.Vdi phuongphapnay,ngucsita
khonghill tri'i'bangchftntri-haycongQila banghanhdQng-nhungse
duy~tquatUngth~hi~ncuavectdx d~cu6icungxftydtfngduQcham
output
y =a( -1 +2x]+X2+X3)
HamoutputnaykhilacdQngtrentUngvectddongcuaBangquye't
dinh2.2,tasethayn6phananhdungvi~cphftnlOpnhungvectdnaose
chooutputla 1haysechooutputla0nhutrongBang2.2.b.
DVf dl!-2: PerceptIonconc6 mQtungdI}ngkhactrongvi~cnh~nd~ng
mfiumanhungn6ltfcbandaDthuQcv~Rosenblatt(1962),Minsky
va Papert(1969).Vdi mQtmfiuchosan,ngucsita chie'ulen mQt
ludig6mnhi~u0 vuongnho,m6i0 vuongduQcgallchobie'nXi .
Bie'nXic6giatri i ne'umfiuthitc6baophu0 vuongvac6giatri0
trongtru'csnghQpnguQcl~i.M~ngperceptIonc6 Iihi~mVI} hQc
phftnlo~icacmfiuhQcbhngcachduy~tquatUngthitd~cu6icung
xftydtfngduQchamnguangy.Lay vi dI}tac6mQtludig6mb6n0
M~ngna-ronperceptron 16
vuongva 16mallhQcphanlo~ithanhhaiph~mtrU:Ph~mtrUfull'
nh!tg6mnhiingmallco it nh!thai0 t6ik~nhauva ph~mtrUfull'
hai g6mnhiingmauconl~i.C~thc3'k6tquaphanlo~ichatrang
Bang2.3.dudiday:
Bang2.3:Phanlo{limJug6m40 vuong
Dudiday,chungtasexetnhiingthu~thQcd6i vdi mohlobperceptIon
donno-roo.
2.5.Mil hinhperceptronilltn nit-ran:
Trudc h6t chungta dinh nghHiham y =f(x], X2, ..~ XL) la ham
nguongtuy6ndnhobiphanll'ngvdibi6nnhiphanx],X2,. . .,XL n6ut6n
~i mQts6th1;1'cTva day s6th1;1'c{w],W2,. . .,wd saochoy=1 n6u LW/X/
>T vabAng0 trongtru'onghQpnguQcl~i.
Trong th1;1'ct6, chungta se coi Wo=-T vab6 sungbi6nXo=1. Khi
dohamnguongtuy6ntmhselahamtheocacbi6nXo,X/,. . .,XLvacogia
triy =1 n6u.EWjXj>0 vay=0 n6u .EWjXj<-0 (t6nglay theoi =0,1, ...).
2.6.Thu~thOcreinforcementchom~ngperceptronilltnnltron
D6i vdi m~ngperceptIondonno-roo,co phuongphaphQcda tra
thanhc6dic3'ngQila lu~thQcreinforcement.NQidungcd~phuongphap
nhugall:
................................... .........................................................................................................................
::.:::::.:II:I!I!I:I:I
.................................... ...................................
11:ljl:111111111111:IIIIIIIIIIIIIIIIIIIIIII::!lj
................. ............... ..................
11111111111111111111111
....................................................................... ..................
I!IIIIIIIIIII!III!!!!I!IIIIII
.................................. .............. ..................
!IIIII!IIIII!IIIIIIII
................................. ..................
::!I!!!I!::II!I!I!I!I!!
................. ...............................................
:::::!!ii: :::::::::
. ... ... ...............
::::::::::B:::::::::::lil:::::: :::
0 0 0 0 0 1 0 0 0 0
0 0 0 1 0 1 0 0 1 0
0 0 1 0 0 1 0 1 0 1
0 0 1 1 1 1 0 1 1 1
0 1 0 0 1 1 1 0 0 1
0 1 0 1 1 1 1 0 1 1
0 1 1 0 0 1 1 1 0 1
0 1 1 1 1 1 1 1 1 1
M~ngno-ranperceptron 17
Gia Saco N m~uhQCHinhungvectd x =(x], X2,...,xn)E Rll va
chungthuQcmQttronghailopmachungtakyhi~uIanIu'<;1tIa G+va G-.
Mvc dichcuachungta Ia xaydl;l'ngmQtanhX(;lg xacdinhlIen nhung
m~uhQcvacomiengiatri Ia t~ph<;1p{a,I} saochokhichoanhX(;lnay
lacdQngIenm6ix thlg(x)=1 ne'ux E G+vag(x)=0 ne'ux E G-.AOOX(;l
gthu'ongIah0vaa(s)=0ne'us<0
voi mQtanhX(;ltuye'ntinhf xacdinhlIen x:
y =lex)=WoXo+WjXj +W2X2 + ...+WnXn
g(s)=a(f(x))
trongdoXo= 1 va cacs6thl;l'cWi( i = 0,1,2, ...,n ) du'<;1cgQiIa
trQngs6cuaanhX(;lf vavectdw= (wo,WI,W2,...,w,Jdu'<;1cgQiIa vectd
trQngs6.Di nhienvoimQtvectdtrQngs6w naodothlcoOOungvectdx
trongG+ nhu'nga(f(x))=0vangu'<;1cI(;li iingconhungx trongG- nhu'ng
a(f(x))=1.Trongnhungtru'ongh<;1pOOu'the',tanoico sl;l'khacbi~tgiua
outputhl;l'cte'va outputIy tu'dng.Nhi~mvv cuathu~thQcIa voi mQt
vectdtrQngs6wchQntuyybandati,sankhichohamg lacdQng!entung
m~uhQcx vaconhungdieuchinhtrQngs6thichh<;1pmachungtagQila
quatrlnhhQc,hamg sephanaOOdungsl;l'tachkhonggiancacm~uhQc
theonghHiIag(x)=1voimQix E G+vag(x)=0 voi mQix E G-
Vi dl1:
Xet nhungm~uhQctrongR2va outputIy tu'dngcuachungcho
trongBang2.4sanday
Bang2.4:CaemJu thitvaeaeoutputly tLlang
., "'"..,....................................,.........................................................................................-...".'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'...'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'...'.'.'.'.'.'.'.'.'.'.'".".'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.'.''.'.'.'.'.'.'.'.'.'.'.'.'.'.'
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
'""""""$:"""""""""""""""~:""""""""""""""""'V""""""'"
::r:r ¥.trrrrr r:xIi :r::::::::::r:t::::~Jrrr
0
0
0
1
0
0
1
1
0
1
0
1
M~ngno-ranperceptron 18
Voi mQivectdmftuhQcchotren,tab6 sungthemthanhphftnXo=
1.Va ne'unhfi'ngtrQngsachQnd lftndftulien la
w(O)=(0.5,1,-1)
thioutputhl1cte'cuanhfi'ngvectdmftuhQcchotrongbangsan:
Bang2.5:CacmJu thitmarQngXo,outputly tLlangvaputputthl!Cte
,---~H---,~'HH'~-- """" " ,.................................................,..., , , ," ,." , ,..................................." ",., " ,"""""""""","""""""""""""""'" ,..................................
::1:::;11111:1:::::::11:11111:1::11::1:1::::::::::::::::::::::;:::i~:::::::::::::I:llllliiliiiiil:~::ii:::::::i:::::::::I:iillii:i::ii:i
1
1
0
0
0
1
0
0
1
0
1
1
1
1
0
1
0
1
1
1
Co haivectdduQcphanlOpsai,dolahaivectd(1,0,0)va(1,1,0) .
Quyt~chQcthanh3.'tduQcgQila hQcdiaphLlongphatbienla chungtase
di€u chinhtrQngsangaykhiphathi~ncosl1phanlopsaiIDeoquyt~c:
Va quyt~chQcthahaila hQctoanc¥cduQcphatbienb~ngcong
thacdi€u chinhtrQngsa
w(k+1)=w(k)+ 8 (LXi -Lxj) voi mQiXi E r w va Xj E T"w
Trongcahaiquyt~c,tagQi8 la h~s8tdcdQhQc.Ta gQiquyt~c
thahailahQcloancl;lcvi anhx~tuye'ntinhf voivectdtrQngsaw sephai
lacdQngtrent3.'tcanhfi'ngvectdX trongtungbuochQc.Bdi cooouthe'
thit~ibuochQcthakchungtamoicothexacdinhduQchait~phQpr w
vaT-w.Trongvi dl;lchungtadangxet,cacbuocdi€u chinhtrQngsatrong
suatquatrlnhhQcloancl;lcduQcphanaOOquaBangsan:
w(k) neuphan lcJpdung
w(k+1)= w(k) + &Xi neuXi Erw
w(k) - &Xi neu Xi E T"w
M\lngno-ranperceptron
Bang2.6:Cac buochQc
*
0 w 0.5 1 -1 N/A (1,0,0)(1,1,0)
~w -2 -1 0
w -1.5 0 -1
~w 1 1 1
w -0.5 1 0
~w -1 -1 0
w -1.5 0 0
~w 1 1 1
w -0.5 1 1
~w -2 -1 -1
w -2.5 0 0
~w 1 1 1
6 w -1.5 1 1
tJ : khongc6
1
2
3
4
5
19
(1,1,1) N/A
N/A (1,1,0)
(1,1,1) N/A
N/A (1,1,0)(1,0,1)
(1,1,1) N/A
N/A N/A
QuatrinhhQCcha'mdti't~i badcthti'6VIkhi docact~ph<jpr va
T- cact~ph<jpr6ng,mcHikhongconvectOmfiuhQcnaobiphanIdpsai.
Theod5iquatrinhhQCcuamQtm~ngperceptronddnnd-ronnha
minhhQatren,mQtCallhoid~trala li~ucoxayratru'CJngh<jpsaumQts6
huuh~nbadcdi~uchinhtrQngs6,chungtal~iquaytrdv~dungvdimQt
tr~ngthainaodo makhongbaagiCJd~tde'ntinhtr~nghoanchinhv~
trQngs6?Tacodinhly sauday
BinhIV 2.1
TrongsudtquatrlnhhQccila mi)tm{lngperceptrondanna-ron,
nguiJitakhongbaagiiJ quaytrov~cungmi)ttr{lngthainhi~uhan
mi)ttanneubili loanc6liJi giai.
M~cdudinhly chobie'tdingtrongquatrinhhQc,m~ngkhongbaa
giCJquaytrdv~cungmQtr~ngthai,nhangdi~udokhongconghHilaqua
trinhhQcsecha'mdti'tsaumQts6huuh~nbadchQc.Tuynhien,chungta
co dinhly saudaykhiingdjnhstfhQitl}.cuaquatrinhhQccuam~ng
perceptronddnnd-ron.
M~ngno-ranperceptron 20
Blnh IV 2.2
Trong trulJnghf/phQctoimCf:lChayhQcdiq.phuong,cac trQngsd
w(k)sf!hQitf:lv~vectow ntu khonggian cac mt1uhQcia khd tach
tuytn tinhva ntu cac diiu ki~nsauvi h~sd tdcdQhQcdUf/cthod
man:
1.
2.
c:(k) >o.
limZZk=lc:(k)=co khim ~ co
3. limZZk=iCc:(k)l/(ZZk=lc:(k)l=0 khim~ co
[VLENTURF] conchirar~ng5t!hQin,.cuaquatrinhhQcvftncon
baodamne'uc:(k)=1 / k hay th~mchi c:(k)=k. Ne'ut~pcacmftuhQc
khongkhatachtuye'nHnhthi 5ieuph~ngtachkhonggianmftu5edao
dQngquanhmQtvai vi trid:Jcbi~tne'uh~56c:(k)dtt<;jcchQnla hAng56
hayla mQtday56tang.
2.7. PhU'o'ngphapbangch6t
Ke'tquachinhcuachttdngnayla vi~cungdl;lngphttdngphapbang
chdt,v6ndungchonhllngbai loanquyho~chtuye'ntiOO(Xemtai li~u
[SDGWICK]),nhAmtill cactrQng56chohamngtt5ngtuye'nHOOma
khongcftnquacacbttdcdi~uchinhtrQng56OOttronghaithu~thQcdi~
phttdnghayloancl;lCn6itrongtie'ttrUdc.Trudche'tchungtadinhnghia
the'naolamQtbangch6t.
Cho 5[n mQtmatr~nA =(aij)nhttdttdiday
aQl aO2 aOL
all al2 alL
aNI aN2 aNL
M~ngno-ranperceptron 21
Khi dobangch6tungvdiph~ntt1'a[p,q]Ia IDatr~nco duQcbhng
cachbie'nd6i IDatr~nA theodongsaochothuduQcIDatr~nIDaph~ntt1'
t~idongp thlbhng1vatatcacacph~ntt1'khaclIencQtqthlbhngo.
£)6rninhhQaphudngphapbangch6t,chungtaxetke'tquaphan
ldpcuab6nvectdchotrongbangsau:
ttttt:rr:Hft:rrrr:::tttt:I:trrrrr':'t::t::::::::ti
,:::IIiQ::::::::::::::::::::l~-:l:::::::::::::III~~:::l::::::::::::::l::oo::::l::::::
1
I
0
0
0
I
0
0
1
1
1
1
0
1
0
1
Chungtarnu6nurnrnQtanhx~tuye'ntinhf vdi cactrQngso'{Wi}
saochokhif lacdQngIentUngvectdthl:
f(1,0,0) =Wo
f(1, 0, 1)=Wo+Wz
f(1, 1,0) =Wo+WI
f(1,1,1)=Wo+WI +Wz
Chungtasexacdinhnhfi'ngtrQngso'{wo,Wj, wz}saocho:
Wo<0
Wo+Wz<0
Wo+WI <0
(1)
Wo+WI +Wz>0
VI tachic~nurnrnQtnghi~rncuah~batphudngtrlnh(1)nentaxeth~
batphudngtrlnhd~cbi~t:
M~ngna-ronperceptron 22
Wo< -1
Wo+ W2< -0.5 (2)
wo+wI<-0.5
Wo +WI +W2 >0.5
B~ dungphu'dngphapbangeh6t,taphatbi~ubai toan:"TImmQtgia trj
cothl!cua Wo+WI +W2 sao cho cac Wi thoabtitdangthac(2)".Be'ndfiy
bailoandu'Qegiaiquacaebu'de:
Bltoc1:TITh~bfttphu'dngtrlnh(2),tathftyr~ngt6nt~inhfi'ngiatriYo,
Yi>Y2,Y3 >0 saoeho:
wo+Yo=-1
Wo+W2+YI =-0.5 (3)
Wo+WI+Y2= -0.5
Wo+WI+W2- Y3=0.5
Bltoc2: L~pmatr~ntrQngso'g6mtftteanhfi'ngh~so'euah~phu'dng
trlnh(3)
-1 -1 -1 0 0 0 0 0
1 0 0 1 0 0 0 -1
1 0 1 0 1 0 0 -0.5
1 1 0 0 0 1 0 -0.5
1 1 1 0 0 0 -1 0.5
Mi;lngno-ranperceptron 23
Dongthnnha'tcuamatr~nchinhlacach~s6cuawo,Wj,Wztrongh~thnc
Wo+WI+WzduQCIa'ynguQcda'u.Trangcactinhloanti6ptheodongthn
nha'tcuamatr~nh~s6chico lacdvngki€m ITak6tqua.
Blloc3:L~pbangch6tchonhfi'ngphantii'manga[p,q]voip,qchQnthich
hQp.
- Bangch6tcuaa[2,1]
0 -1 0 0 1 0 0 -0.5
0 0 -1 1 -1 0 0 -0.5
1 0 1 0 1 0 0 -0.5
0 1 -1 0 -1 1 0 0.0
0 1 0 1 -1 0 -1 1.0
Ti6p theochungta Hmnghim WI trongvectcJcQtthnhai bhng
cachlily bangch6tchophantd'a[4,2]
0 0 0 1 0 0 -1 -0.5
0 0 -1 1 -1 0 0 -0.5
1 0 1 0 1 0 0 -0.5
0 0 -1 -1 0 0 1 -1.0
0 1 0 1 -1 0 -1 1.0
Nhutrongbuoctren,d6ivoi nghim thnba,talily bangch6tcho
phantd'a[1,3]vathuduQcmatrn sail:
0 0 0 1 0 0 -1 0.5
0 0 -1 1 -1 0 0 -0.5
1 0 0 1 0 0 0 -1.0
0 0 0 -2 1 0 0 -1.5
0 1 0 1 -1 0 -1 1.0
M~ngnO'-ronperceptron 24
Be'ndaytaco th~chQnnghi~mdin tlmHi (wo,Wj,wz)=(-1.0,1.0,
0.5)va nghi~mnay thoaHnhchill Wo+ WI + Wz=0.5. Ghi tri naydu<Jc
ki~mtrabhngphftntU'cu6itrongdongdftuliencuamatr~n.SaukhichQn
du<JcaetrQngso'Wi thlhamnguongcuall(j-ronsecod~ng:
Y = a(-1 +Xl +0.5xz)
D~dangki~mchungthilyhamnayphananhdungbangChaDtricuabai
loan.
Vi~ccaid~tthu~tloand~chQndu<Jcbangch6tcu6iclingkhong
khoHim.Viln d~Ia eachchQncaehhngso'd ve'phiiicuah~bittphuong
trlnh(2).KhongphaibittcueachchQnnaoclingd~uchoke'tquamong
mu6n.Chiingh~ntrongbittdiingthuccu6icuah~bittphuongtrlnh(2),ta
chohhngso'd ve'phaibhng1.Cl;lth~chungtacoh~bittphuongtrlnh:
Wo<-1
Wo +Wz <-0.5
Wo+WI <-0.5
Wo+WI +Wz>1
vaclingvoigiathuye'tt6nt~inhii'ngiatrikhongamYo,yj,Yz,Y3saocho
tacoh~:
Wo +Yo=-1
Wo +Wz+ YI =-0.5
Wo+WI +Yz=-0.5
Wo+ WI + Wz- Y3=1
thlchungtasecomatrn h s61a:
-1 -1 -1 0 0 0 0 0.0
1 0 0 1 0 0 0 -1.0
1 0 1 0 1 0 0 -0.5
1 1 0 0 0 1 0 -0.5
1 1 1 0 0 0 -1 1.0
M~ngnet-ranperceptran 25
Lftn luQtlily bangch6tchonhfi'ngphftntU'manga[2,l], a[4,2],a[1,3] thi
bangch6tcu6icling:
Cactn,mgso'chobdibangnayla (-1.0,1.5,0.5)nhunghamnguBngtuye'n
tinh
y =a( -1.0+1.5xj+0.5x2)
thikhongphananhdungbangChaDtrio
DI nhien,chungtaphiiidi~uchinhcachchQnve'phaicuah~biltphUelng
trinh(2).Biingcachnao?Nh~nxetriingcactrQngso'Wimu6nla nghi~m
duQcchQnthiphaithoabiltdiingthuc:
-Wo<Wj +W2< -2wo.
daDde'nvi~cchQnWoco mQtgia tri IonhelD.Chiingh~nco the'chQnWo<
-1.5.
0 0 0 0 0 0 -1 1.0
0 0 1 -1 1 0 0 0.5
1 0 0 1 0 0 0 -1.0
0 0 0 -1 1 1 1 -1.0
0 1 0 0 -1 0 -1 1.5
0 0 0 0 0 0 -1 1.0
0 0 1 -1 1 0 0 1.0
1 0 0 1 0 0 0 -1.5
0 0 0 -1 1 1 1 -0.5
0 1 0 0 -1 0 -1 1.5
M~ngno-ranperceptran 26
Luc nayhamnguongtuye'ntinhchQnduQc:
t =a( -1.5+ 1.5x]+X2)
chungta co th~ki~mchungd~danghamnguongnayphananhdung
bangchantrio
2.8.ChUfnhiQ'C I~pbangch6t:
£)~co cainhinmangtinhcachthu~tgiaidO'ivdiphuongphapneu
trongvi dl;llIen,chungtadungtrudcva'nd~din philitimmQtchie'nluQc
chovi~cxacdinhxemphantit alp, q] naGse duQcchQnd~l~pbang
chO't.Trentinhthanapdl;lngphuongphapdonhinhcuanhii'ngbai loan
quyho~chtuye'ntinh,chie'nluQcchQnphantitmangalp,q] d~l~pbang
chO'tphaichochungtanhii'ngtrQngsO'{Wi}saDchohamml;lclieu LWi
tangdande'ngiatri ldnnha't,noicachkhaccacthu~tgiaiphaichoduQc
gia tri {Wi}Ia tQadQdinhcuadonhinh.Theo [SDGWICK],co mQtsO'
chie'nluQcchQnphantitalp,q] d~l~pbangchO't,machungtasedung
mQtphuongphapnhumatadudiday:
CQtq duqcchr,mne'udduVaGtfli dong0 ia s6 am.Dongp duqcchQn
trongs6 nhangdongco dduVaGtfli cQtq ia s6 duangva ia pht1nt11
chothuangs6 wJi phdnt11cu6itrendAngmQtdongmanggicitrj nho
nhdt.
Chungtahayxeml~imatr~nh~sO',tatha'ycQt1 co datiVaGt~i
dong0 Ia -1.
-1 -1 -1 0 0 0 0 0
1 0 0 1 0 0 0 -1
I 0 1 0 1 0 0 -0.5
1 1 0 0 0 1 0 -0.5
1 1 1 0 0 0 -1 0.5
M~ngnd-ronperceptron 27
V~ycQt1dU<;1CchQn.Baygiod~chQnph~nhi'trendong,chungta
chQndong2 (tinhtu0)vi ph~ntUa{2][l]chothuongsavaiph~nhi'cuai
trenclingdongc6 ghl tri la 0.5la ghi tri nhonha't.Va thlJ'chi~nphep
bie'nd6itheodongd~trdthanhmatr~n
£)~till bangchatlingvai mQtph~nhi'naod6trencQt2, chungta
se chQnIlJ'agiuahai ph~nhi' la a{3,2]haya{4,2]?Ne'uchQnph~nhi'
a{3,2]d~l~pbangchatchungtatha'ydng vi ph~ntti'cuaitrendong3
b~ng0 chonenbangchatdU<;1cl~ptuph~nhi'a{3,2]thonglamchogia
tri cuaph~ntti'cuaicuadong0 tanglen.Trongkhi phuongphapbang
chatla till nhungbangchattheohuanglamchoph~nhi'cuaicuadong0
tangd~nlen de'ngiatri Iannha't.Do d6chungtase till bangchatcho
ph~ntti'a{4,2]
Va quatrinhchQnph~ntti'trongbangchatd buacthak d~l~p
bangchatchobuacthak +1tie'pl\!Cchode'nbangchatcuaila bangc6n
cQtd~uliendiidU<;1cchuiinhoa.
0 -1 0 0 1 0 0 -0.5
0 0 -1 1 -1 0 0 -0.5
1 0 1 0 1 0 0 -0.5
0 1 -1 0 -1 1 0 0.0
0 1 0 1 -1 0 -1 1.0
0 0 0 1 0 0 -1 -0.5
0 0 -1 1 -1 0 0 -0.5
1 0 1 0 1 0 0 -0.5
0 0 -1 -1 0 0 1 -1.0
0 1 0 1 -1 0 -1 1.0
M\tngno-ranperceptran 28
2.9. Nh~nlet
Trongphuongphapbangch6ttren,buoctimcachhngso'd~di€n
tacacrangbuQcnhutrongh~biltphuongtrinh(2)cuatie't2.7.du<;lcthV'c
hi~nbellngoaithu~tloanvaxemnhubuocphantichsobQ.H~nche'cua
phuongphaptrend ch6nochuachomQtthut1;1cnaogiupcaid~tcach~
so'cuah~biltphuongtrinh(2)mQtcachheuristic,makhi lingd1;1ngcho
cacmfiuhQccoso'chi~uIOnthibuocnaydatrdthanhmQthachthlicIOn.
Vi d1;1trongtie't2.7tu'ongd6idongianvi ch~ngquabangchantri
cuabailoanchinhIa dinhnghiacualoantitlOgicAND, so'chi~ucuacac
vectomfiuhQcquanhosovoi cacbai loanthV'cte',chonenvi~cdi~u
chinhcacgiatri cuacQtcu6iclingtrongmatr~nkhongt6ncongnhi~u
l~m(thu~tgiaimotatrenkhongh~noigi v~chie'nIU'<;lcdi~uchinhcac
hhngso'nay).D6ivoibailoansan,voi so'chi~ucuavectomfiuhQcbhng
3 chungtaco 8rangbuQcva truockhi ch~ythachuangtrinh,vi~cchQn
hhngso'trongdi~uki~nrangbuQcdoihoinhfi'ngdanhgiate'nhi
Vidl1:HaytimmQthamnguongtuye'ntinhth~hi~nbangchantri:
1.11111:1:11;111111111111111111111111111111.111.111111i.IIIII:III.i.III.:li.II..li:.:.:I:.II::~i::.:::I:..:
Chungtakhdit~omatr~nd~tll'dotimbangch6tla .
0 0 0 0
0 0 1 0
0 1 0 0
0 1 1 1
1 0 0 1
1 0 1 1
1 1 0 1
1 1 1 1
M~ngno-ranperceptron 29
Sankhich~ychn'ongtrlnhtrenmatr~nd6,tathudn'<;fcvectotrQng
s6w=(-2.5,4.0,1.5,1.5) vahamngn'ongtuy€ntinhc6d~ng:
y =0( -2.5+ 4x] + 1.5x2+ 1.5X3)
Va cho y lacd(>ngtencacvectomfiuhQcthitathudn'<;fcbangsan
d~sosanhvdibangchantrichotrongbailoan:
-1 -1 -1 -1 0 0 0 0 0 0 0 0 0.0
1 0 0 0 1 0 0 0 0 0 0 0 -2.5
1 0 0 1 0 1 0 0 0 0 0 0 -1.0
1 0 1 0 0 0 1 0 0 0 0 0 -1.0
1 0 1 1 0 0 0 -1 0 0 0 0 1.5
1 1 0 0 0 0 0 0 -1 0 0 0 1.5
1 1 0 1 0 0 0 0 0 -1 0 0 1.5
1 1 1 0 0 0 0 0 0 0 -1 0 1.5
1 1 1 1 0 0 0 0 0 0 0 -1 1.0
1 0 0 0 -2.5 0
1 0 0 1 -1.0 0
1 0 1 0 -1.0 0
1 0 1 1 0.5 1
1 1 0 0 1.5 1
1 1 0 1 3.0 1
1 1 1 0 3.0 1
1 1 1 1 4.5 1
Mj;lngno-ranperceptron 30
R6ranghamnguongtuye'ntinhthuduQcphananhdungbangchan
tricuabailoan.
Cuo'iclIngthivande conI~iIa voi nhungbai loanvi ill'naothi
bangchantrico th~duQcphananhnhomohinhperceptIondonno-roll
con nhungbai loannao thi khong?Voi nhungbai loan ma so'chien
khongIon Iitm,thi ve nguyentitc,co th~ITaIoi chocall hoi trenb~ng
nhungkhaosattrennhunghamrangbuQccuabai loan.Lay vi d1;lcho
tru'onghQpduoiday,ta sechungminhr~ngkhongth~phananhbang
chantrib~ngmQthamnguongtuye'ntinh,tlicIa mohinhperceptIondon
no-rollkhongapd1;lngduQc.
Vidl1:Ta xethamy =I(x],Xz,X3)du'QcxacdinhIa duQcxacdinhIa y=1
ne'utrongcacXico mQtso'Ie cacgia tri 1, va y =0 trongcac
truonghQpkhac.Bangchantricuabailoandu'Qcth~hi~nnhu'san:
... ............"""""""""""""""""""""",........................................................................................................................................................................................................................................................................................................................................................................................................."""""""""""""""""""""""""""...............................................................................................
:::::::::::~:l::::::::::::::::::::::]{g:::::::::::::::::::::::~a:::::::::::::::::::::::::::M::::::::::::::
Chungtasechungminhrhngkhongth~!lmmQthamngu'ongtuye'ntinh
chobangchantritrenne'udungmohinhperceptIondonno-roll.
Chung ta them mQt gia tri Xo=1 va gQi {Wi}( i > 0 ) Ia nhung
trQngso',the'thiquabangchantritren,taconhungbatdiingthuc:
0 0 0 0
0 0 1 1
0 I 0 1
0 1 1 0
1 0 0 1
1 0 1 0
1 1 0 0
1 1 1 1
M!,mgno-ranperceptron 31
(vii) Wo+Wi+ Wz<0
(viii) Wo+Wi +Wz+W3>0
C(>ngtheov€ hai ba'td!ng thuc(ii) va (iii) taduQC:2wo+ Wz+ W3
>0,k€t hQpvoiba'td!ngthuc(i) thlduQc:Wo+Wz+W3 >O. Mauthuftn
voiba'td!ngthuc(iv).Di~udochungtodingkhongth€ dungmohlnh
perceptIondonno-ronchobailoandiineu.
2.10.Cuoichuang
Trongchuongnay,chungtadiidi€m quahaiphuongphaphQccua
m~ngperceptIondonno-ronIDeonguyenly "thii'vasii'a".Chungtadiid~
ram(>tphuongphaphQcmak€t quavi~chQCduQchoanta'tngaysaukhi
duy(HquacacmftuhQc.Congcv chinhtrongphuongphapnayHiphep
giaim(>th~phuongtrlnhtuy€ntinhvoicach~sO'trong{a,1 },doclingla
m(>tcongcvmachungtasesii'dvngkhixetm(>tsO'thu~thQcdO'ivoiki€n
trUcm~ngperceptIonhi~ulOpbon.
(i) Wo<0
(ii) Wo+W3 >0
(iii) Wo+Wz>0
(iv) Wo+Wz+W3<0
(v) Wo+Wi>0
(vi) Wo+ Wi + W3< 0