Re: How to verify what maxParallelism is set to?

2019-04-29 Thread Sean Bollin
Thanks! Do you know if it's possible somehow to verify the global
maxParallelism other than calling .getMaxParallelism? Either through
an API call or the UI?

On Mon, Apr 29, 2019 at 8:12 PM Guowei Ma  wrote:
>
> Hi,
> StreamExecutionEnvironment is used to set a default maxParallelism for 
> global. If a "operator"'s maxParallelism is -1 the operator will be set the 
> maxParallelism which is set by StreamExecutionEnvironment.
>
> >>>Any API or way I can verify?
> I can't find any easy way to do that. But you could use get the StreamGraph 
> from api StreamExecutionEnvironment.getStreamGraph and try to print the 
> StreamNode::maxParallelism.
> Best,
> Guowei
>
>
> Sean Bollin  于2019年4月30日周二 上午8:19写道:
>>
>> Hi all,
>>
>> How do you verify what max parallelism is set to on the job level? I do not 
>> see it in the 1.6 UI, for example.
>>
>> I’m setting maxParallelism to 4096 on the StreamExecutionEnvironment before 
>> execution but printing out the maxParallelism in an operator still displays 
>> -1. Since this is such an important setting I’d like some sanity check to 
>> verify it is the value I expect.
>>
>> Any API or way I can verify?


How to verify what maxParallelism is set to?

2019-04-29 Thread Sean Bollin
Hi all,

How do you verify what max parallelism is set to on the job level? I do not see 
it in the 1.6 UI, for example. 

I’m setting maxParallelism to 4096 on the StreamExecutionEnvironment before 
execution but printing out the maxParallelism in an operator still displays -1. 
Since this is such an important setting I’d like some sanity check to verify it 
is the value I expect.

Any API or way I can verify?