資源描述:
《oozie工作流框架使用指南x》由會(huì)員上傳分享,免費(fèi)在線閱讀,更多相關(guān)內(nèi)容在教育資源-天天文庫。
1、工作流框架使用指南2013年10月SystemInstallationJobDesignOozieOverviewWorkFlowDesignCoordinatorDesignReferenceContentsRequirementsClouderaManagerCDHOozieInstallConfigHueInstallConfig(2items)BasicOperationSystemInstallationActionOverviewAnexecution/computationtask(Map-Red
2、ucejob,Pigjob,ashellcommand).Itcanalsobereferredastaskor'actionnode'.JobDesignerJobDesignExampleFsActionMapReduceActionJobDesignOozieAworkflowschedulersystemtomanageApacheHadoopjobsWorkFlowWorkflowjobsareDirectedAcyclicalGraphs(DAGs)ofactionsCoordinatorCoord
3、inatorjobsarerecurrentworkflowjobstriggeredbytime(frequency)anddataavailabilty.IntegratedMRFSEmailShellSshHivePigSqoopDistcpJavaScalableReliableExtensibleOozieOverviewDoesnotsupportcirclesWorkflowNodesControlFlowNodesWorkflowActionNodesWorkFlowRecov
4、eryoozie.wf.rerun.failnodesoozie.wf.rerun.skip.nodesWorkFlowDesignWorkflowdefinitionscanbeparameterizedWhenworkflownodeisexecutedbyOoziealltheELsareresolvedintoconcretevaluesELexpressionscanbeusedintheconfigurationvaluesofactionanddecisionnodesWorkflowJobPro
5、perties(orParameters)ExpressionLanguageFunctionsParameterizationofWorkflowsExampleStartMapReduce1輸出>500行MapReduce2End是Coordinatorexecuteworkflowjobs:RecurrentInterdependentCoordinatorBased:TimeintervalsDataavailabilityTimeintervalsand/ordataavailabilityCoord
6、inatorOverviewCoordinatorArchtechtureDatetime,FrequencyandTime-PeriodCoordinatorActionParameterizationofCoordinatorCoordinatorDesignCoordinatorDesign定期創(chuàng)建文件夾開始時(shí)間:結(jié)束時(shí)間:頻率:每3分鐘一次文件夾名字為標(biāo)定時(shí)間格式化yyyy-MM-ddTHH-mmExampleOozieHomepageDocumentsHueHomepageTutorialsExpre
7、ssionLanguageTutorialsReference