|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectcascading.flow.planner.FlowPlanner
public abstract class FlowPlanner
Class FlowPlanner is the base class for all planner implementations.
Field Summary | |
---|---|
protected AssertionLevel |
assertionLevel
Field assertionLevel |
protected DebugLevel |
debugLevel
Field debugLevel |
protected Map<Object,Object> |
properties
Field properties |
Constructor Summary | |
---|---|
FlowPlanner()
|
Method Summary | |
---|---|
abstract Flow |
buildFlow(FlowDef flowDef)
Method buildFlow renders the actual Flow instance. |
protected ElementGraph |
createElementGraph(FlowDef flowDef)
|
protected void |
failOnGroupEverySplit(ElementGraph elementGraph)
|
protected void |
failOnLoneGroupAssertion(ElementGraph elementGraph)
Verifies that there are not only GroupAssertions following any given Group instance. |
protected void |
failOnMissingGroup(ElementGraph elementGraph)
|
protected void |
failOnMisusedBuffer(ElementGraph elementGraph)
|
protected PlannerException |
handleExceptionDuringPlanning(Exception exception,
ElementGraph elementGraph)
|
protected void |
handleJobPartitioning(ElementGraph elementGraph)
Inserts a temporary Tap between logical MR jobs. |
protected void |
handleJoins(ElementGraph elementGraph)
Prevent leftmost sources from sourcing a downstream join on the rightmost side intra-task by inserting a temp tap between the left-sourced join and right-sourced join. |
protected void |
handleNonSafeOperations(ElementGraph elementGraph)
|
void |
initialize(FlowConnector flowConnector,
Map<Object,Object> properties)
|
protected void |
insertTempTapAfter(ElementGraph graph,
Pipe pipe)
Method insertTapAfter ... |
protected abstract Tap |
makeTempTap(String name)
Method makeTemp ... |
protected void |
verifyAssembly(FlowDef flowDef)
Must be called to determine if all elements of the base pipe assembly are available |
protected void |
verifyCheckpoints(FlowDef flowDef)
|
protected void |
verifyPipeAssemblyEndPoints(FlowDef flowDef)
Method verifyEndPoints verifies there aren't dupe names in heads or tails. |
protected void |
verifySourceNotSinks(Map<String,Tap> sources,
Map<String,Tap> sinks)
|
protected void |
verifyTaps(Map<String,Tap> taps,
boolean areSources,
boolean mayNotBeEmpty)
Method verifyTaps ... |
protected void |
verifyTraps(FlowDef flowDef)
|
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
protected Map<Object,Object> properties
protected AssertionLevel assertionLevel
protected DebugLevel debugLevel
Constructor Detail |
---|
public FlowPlanner()
Method Detail |
---|
public void initialize(FlowConnector flowConnector, Map<Object,Object> properties)
public abstract Flow buildFlow(FlowDef flowDef)
flowDef@return
- Flowprotected void verifyAssembly(FlowDef flowDef)
protected ElementGraph createElementGraph(FlowDef flowDef)
protected void verifySourceNotSinks(Map<String,Tap> sources, Map<String,Tap> sinks)
protected void verifyTaps(Map<String,Tap> taps, boolean areSources, boolean mayNotBeEmpty)
taps
- of type MapareSources
- of type booleanmayNotBeEmpty
- of type booleanprotected void verifyPipeAssemblyEndPoints(FlowDef flowDef)
protected void verifyTraps(FlowDef flowDef)
protected void verifyCheckpoints(FlowDef flowDef)
protected void failOnLoneGroupAssertion(ElementGraph elementGraph)
protected void failOnMissingGroup(ElementGraph elementGraph)
protected void failOnMisusedBuffer(ElementGraph elementGraph)
protected void failOnGroupEverySplit(ElementGraph elementGraph)
protected PlannerException handleExceptionDuringPlanning(Exception exception, ElementGraph elementGraph)
protected void handleNonSafeOperations(ElementGraph elementGraph)
protected void insertTempTapAfter(ElementGraph graph, Pipe pipe)
graph
- of type PipeGraphpipe
- of type Pipeprotected abstract Tap makeTempTap(String name)
name
-
protected void handleJobPartitioning(ElementGraph elementGraph)
elementGraph
- of type PipeGraphprotected void handleJoins(ElementGraph elementGraph)
elementGraph
-
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |