Re: Forwarding Strategies

2015-10-20 Thread Stephan Ewen
Hi! I am not sure what PARTITION_RANDOM is about, but FORWARD and PARTITION_FORCED_REBALANCE are the same to the output emitter, but look different to the Optimizer (PARTITION_FORCED_REBALANCE cannot be pushed down). Stephan On Tue, Oct 20, 2015 at 6:39 PM, Greg Hogan

Forwarding Strategies

2015-10-20 Thread Greg Hogan
Looking at org.apache.flink.runtime.operators.shipping.OutputEmitter, shipping strategies FORWARD, PARTITION_RANDOM, and PARTITION_FORCED_REBALANCE all call a local round-robin partitioning function. I'd like to patch this so that the round-robin count starts at the local task index, but shouldn't