資源描述:
《An_introduction_to_graphical_models》由會員上傳分享,免費(fèi)在線閱讀,更多相關(guān)內(nèi)容在學(xué)術(shù)論文-天天文庫。
1、AnintroductiontographicalmodelsKevinP.Murphy10May20011IntroductionThefollowingquotation,fromthePrefaceof[Jor99],providesaveryconciseintroductiontographicalmodels.Graphicalmodelsareamarriagebetweenprobabilitytheoryandgraphtheory.Theyprovideanaturaltoolfordealingwithtwoproblemstha
2、toccurthroughoutappliedmathematicsandengineering{uncertaintyandcomplexity{andinparticulartheyareplayinganincreasinglyimportantroleinthedesignandanalysisofmachinelearningalgorithms.Fundamentaltotheideaofagraphicalmodelisthenotionofmodularity{acomplexsystemisbuiltbycombiningsimple
3、rparts.Probabilitytheoryprovidesthegluewherebythepartsarecombined,ensuringthatthesystemasawholeisconsistent,andprovidingwaystointerfacemodelstodata.Thegraphtheoreticsideofgraphicalmodelsprovidesbothanintuitivelyappealinginterfacebywhichhumanscanmodelhighly-interactingsetsofvaria
4、blesaswellasadatastructurethatlendsitselfnaturallytothedesignofecientgeneral-purposealgorithms.Manyoftheclassicalmultivariateprobabalisticsystemsstudiedineldssuchasstatistics,systemsengineering,informationtheory,patternrecognitionandstatisticalmechanicsarespecialcasesofthegene
5、ralgraphicalmodelformalism{examplesincludemixturemodels,factoranalysis,hiddenMarkovmodels,KalmanltersandIsingmodels.Thegraphicalmodelframeworkprovidesawaytoviewallofthesesystemsasinstancesofacommonunderlyingformalism.Thisviewhasmanyadvantages{inparticular,specializedtechniquest
6、hathavebeendevelopedinoneeldcanbetransferredbetweenresearchcommunitiesandexploitedmorewidely.Moreover,thegraphicalmodelformalismprovidesanaturalframeworkforthedesignofnewsystems.Inthispaper,wewill
eshoutthisremarkbydiscussingthefollowingtopics:Representation:howcanagraphicalmo
7、delcompactlyrepresentajointprobabilitydistribution?Inference:howcanweecientlyinferthehiddenstatesofasystem,givenpartialandpossiblynoisyobservations?Learning:howdoweestimatetheparametersandstructureofthemodel?Decisiontheory:whathappenswhenitistimetoconvertbeliefsintoactions?
8、Applications:whathasthismachinerybeenusedfor?1P