Re: Flink ignoring -yn

2018-07-24 Thread Garrett Barton
I missed your reply, I'm using 1.5.0. Will be upgrading to 1.5.1 soon. On Tue, Jul 10, 2018, 10:15 PM Jeff Zhang wrote: > Which flink version do you use ? > > > Garrett Barton 于2018年7月11日周三 上午1:09写道: > > > Hey all, > > I am running flink in batch mode on yarn with independant jobs creating > >

Re: Flink ignoring -yn

2018-07-10 Thread Jeff Zhang
Which flink version do you use ? Garrett Barton 于2018年7月11日周三 上午1:09写道: > Hey all, > I am running flink in batch mode on yarn with independant jobs creating > their own clusters. > > I have a flow defined that scales parallelism based on input size (to keep > overall processing time somewhat

Flink ignoring -yn

2018-07-10 Thread Garrett Barton
Hey all, I am running flink in batch mode on yarn with independant jobs creating their own clusters. I have a flow defined that scales parallelism based on input size (to keep overall processing time somewhat constant). Right now the flow initializes with around ~22k tasks for a flow that sets