資源描述:
《data exploration and preparation》由會(huì)員上傳分享,免費(fèi)在線閱讀,更多相關(guān)內(nèi)容在工程資料-天天文庫。
1、3DataexplorationandpreparationThischapterstartswithabriefsurveyofthedifferenttypesofdata.Itthengoesontodetailthetasksofexploring,analysingandpreparingthedatacollected,usingunivariate,bivariateandmultivariatemethodsandstatisticaltests.Thesetasksarefundamental,asthequalityoftheresult
2、sgenerallydependsmoreonthecaretakenherethanonthemodellingmethodwhichusestheseinputdata.Thechapterconcludeswithadiscussionofsampling.3.1ThedifferenttypesofdataThedatamaybequantitative,qualitative,or,forsomespecialproblems,textual.Quantitative(ornumerical)datamaybecontinuousordiscret
3、e.Continuous(orscaleorinterval)dataarethosewhosevaluesbelongtoanin?nitesubsetofthesetRofrealnumbers(e.g.wages,amountofpurchases).Discretedataarethosewhosevaluesbelongtoa?niteorin?nitesubsetofthesetNofnaturalintegers(e.g.numberofchildren,numberofproductsbought).Whenthesetofvaluesisi
4、n?nite,orjustlarge(severaltens),discretedataareconsideredtobecontinuousdata(e.g.age).Qualitative(orcategorical)dataaredatawhosesetofvaluesis?nite.Thesevaluesarenumericaloralphanumeric,butwhentheyarenumericaltheyaremerelycodes,notquantities(e.g.socio-occupationalcategory,departmentn
5、umber).Thevaluesoftextdataareuncodedtexts,writteninnaturallanguage:examplesarelettersofcomplaint,reportsandpressdespatches.Whatdistinguishescontinuousanddiscretedatafromothertypesisthattheyareconcernedwithquantities,sowecanperformarithmeticaloperationsonthem;moreover,theyareordered
6、(wecancomparethembyanorderrelationship‘’).Qualitativedataarenotquantities,buttheymaybeordered;inthiscasewespeakofordinalqualitativedata(e.g.‘low,medium,high’).Non-orderedqualitativedataarecallednominal.Ordinaldatacanbeclassedinthefamilyofdiscretedataandtreatedinthesameway.Theanaly
7、sisoftextdatarequiresamixtureoflinguisticsandstatistics:thisistextmining,whichisdiscussedinChapter14.NotethattextdatainnaturallanguagemaycontainellipticalDataMiningandStatisticsforDecisionMaking,FirstEdition.Ste′phaneTuffe′ry.ó2011JohnWiley&Sons,Ltd.Published2011byJohnWiley&Sons,Lt
8、d.44DATAEXPLORATIONANDPREP