資源描述：
《基于lucene相似句子檢索系統(tǒng)論文英文翻譯原文》由會員上傳分享，免費在線閱讀，更多相關(guān)內(nèi)容在學(xué)術(shù)論文-天天文庫。
1、AnalysisAnalysis,inLucene，istheprocessofconvertingfieldtextintoitsmostfundamentalindexedrepresentation，terms.Thesetermsareusedtodeterminewhatdocumentsmatchaqueryduringsearches.Forexample，ifthissentencewereindexedintoafield(let’sassumetypeField.Text)，thet
2、ermsmightstartwith/^randexample,andsoon，asseparatetermsinsequence.Ananalyzerisanencapsulationoftheanalysisprocess.Ananalyzertokenizestextbyperforminganynumberofoperationsonit，whichcouldincludeextractingwords,discardingpunctuation,removingaccentsfromchara
3、cters,lowercasing(alsocallednormalizing),removingcommonwords,reducingwordstoarootform(stemming),orchangingwordsintothebasicform(lemmatization).Thisprocessisalsocalledtokenization,andthechunksoftextpulledfromastreamoftextarecalledtokens.Tokens,combinedwit
4、htheirassociatedfieldname,areterms.Lucene’sprimarygoalistofacilitateinformationretrieval.Theemphasisonretrievalisimportant.YouwanttothrowgobsoftextatLuceneandhavethemberichlysearchablebytheindividualwordswithinthattext.InorderforLucenetoknowwhat“words”ar
5、e，itanalyzesthetextduringindexing，extractingitintoterms.Thesetermsaretheprimitivebuildingblocksforsearching.ChoosingtherightanalyzerisacrucialdevelopmentdecisionwithLucene.Onesizedoesn’tfitallwhenitcomestochoosingananalyzer.Languageisonefactorinchoosinga
6、nanalyzer,becauseeachhasitsownuniquefeatures.Anotherfactortoconsiderinchoosingananalyzeristhedomainofthetextbeinganalyzed;differentindustrieshavedifferentterminology，acronyms，andabbreviationsthatmaydeserveattention.Althoughwepresentmanyoftheconsideration
7、sforchoosinganalyzers,nosingleanalyzerwillsufficeforallsituations.It’spossiblethatnoneofthebuilt-inanalysisoptionsareadequateforyourneeds,andyou’llneedtoinvestincreatingacustomanalysissolution;pleasantly，Lucene’sbuildingblocksmakethisquiteeasy.Oneofthebe
8、stquestionsyoucanaskasyoucontemplatetheanalysisprocessis，“WhatwouldGoogledo?”Google’sactualalgorithmsareproprietaryandkeptrelativelysecret，buttheresultsfromsearchesgivesomeinsight.Searchingforthephrase“tobeornottobe”withan
