資源描述：
《基于Authorware的交互課件的設(shè)計與制作.doc》由會員上傳分享，免費在線閱讀，更多相關(guān)內(nèi)容在學(xué)術(shù)論文-天天文庫。
1、TheHadoopDistributedFilesystemWhenadatasetoutgrowsthestoragecapacityofasinglephysicalmachine,itbecomesnecessarytopartitionitacrossanumberofseparatemachines.Filesystemsthatmanagethestorageacrossanetworkofmachinesarecalleddistributedfilesystems.Sincetheyarenetwork-based,allthec
2、omplicationsofnetworkprogrammingkickin,thusmakingdistributedfilesystemsmorecomplexthanregulardiskfilesystems.Forexample,oneofthebiggestchallengesismakingthefilesystemtoleratenodefailurewithoutsufferingdataloss.HadoopcomeswithadistributedfilesystemcalledHDFS,whichstandsforHado
3、opDistributedFilesystem.(Youmaysometimesseereferencesto“DFS”—informallyorinolderdocumentationorconfiguration—whichisthesamething.)HDFSisHadoop’sflagshipfilesystemandisthefocusofthischapter,butHadoopactuallyhasageneralpurposefilesystemabstraction,sowe’llseealongthewayhowHadoop
4、integrateswithotherstoragesystems(suchasthelocalfilesystemandAmazonS3).TheDesignofHDFSHDFSisafilesystemdesignedforstoringverylargefileswithstreamingdataaccesspatterns,runningonclustersoncommodityhardware.Let’sexaminethisstatementinmoredetail:Verylargefiles“Verylarge”inthiscon
5、textmeansfilesthatarehundredsofmegabytes,gigabytes,orterabytesinsize.ThereareHadoopclustersrunningtodaythatstorepetabytesofdata.*StreamingdataaccessHDFSisbuiltaroundtheideathatthemostefficientdataprocessingpatternisawrite-once,read-many-timespattern.Adatasetistypicallygenerat
6、edorcopiedfromsource,thenvariousanalysesareperformedonthatdatasetovertime.Eachanalysiswillinvolvealargeproportion,ifnotall,ofthedataset,sothetimetoreadthewholedatasetismoreimportantthanthelatencyinreadingthefirstrecord.CommodityhardwareHadoopdoesn’trequireexpensive,highlyreli
7、ablehardwaretorunon.It’sdesignedtorunonclustersofcommodityhardware(commonlyavailablehardwareavailablefrommultiplevendors?)forwhichthechanceofnodefailureacrosstheclusterishigh,atleastforlargeclusters.HDFSisdesignedtocarryonworkingwithoutanoticeableinterruptiontotheuserinthefac
8、eofsuchfailure.ItisalsoworthexaminingtheapplicationsforwhichusingHDF
