Hi Arnaud,
as long as you don't have HA activated for your batch jobs, HA shouldn't
have an influence on the batch execution. If it interferes, then you should
see additional task manager connected to the streaming cluster when you
execute the batch job. Could you check that? Furthermore, could yo
10:36
À : user@flink.apache.org
Objet : Re: HA Mode and standalone containers compatibility ?
Hi Arnaud,
as long as you don't have HA activated for your batch jobs, HA shouldn't have
an influence on the batch execution. If it interferes, then you should see
additional task manager co
-cluster option.
>
> De : Till Rohrmann [mailto:trohrm...@apache.org]
> Envoyé : jeudi 3 décembre 2015 10:36
> À : user@flink.apache.org
> Objet : Re: HA Mode and standalone containers compatibility ?
>
> Hi Arnaud,
>
> as long as you don't have HA activated for you
: user@flink.apache.org
Objet : RE: HA Mode and standalone containers compatibility ?
Yes, it does interfere, I do have additional task managers. My batch
application comes in my streaming cluster Flink’s GUI instead of creating its
own container with its own GUI despite the –m yarn-cluster option
embre 2015 11:11
À : user@flink.apache.org
Objet : Re: HA Mode and standalone containers compatibility ?
Hey Arnaud,
thanks for reporting this. I think Till’s suggestion will help to debug this
(checking whether a second YARN application has been started)…
You don’t want to run the batch applic
tating that I have only 24 slots on my 48 container cluster !
-Message d'origine-
De : LINZ, Arnaud
Envoyé : jeudi 3 décembre 2015 11:26
À : user@flink.apache.org
Objet : RE: HA Mode and standalone containers compatibility ?
Hi,
The batch job does not need to be HA.
I stopped everythin
> On 03 Dec 2015, at 11:47, LINZ, Arnaud wrote:
>
> Oopss... False joy.
OK, I think this is a bug in the YARN Client and the way it uses the
.properties files to submit jobs.
As a work around: Can you mv the /tmp/.yarn-properties-voyager file and submit
the batch job?
mv /tmp/.yarn-propert
e: HA Mode and standalone containers compatibility ?
> On 03 Dec 2015, at 11:47, LINZ, Arnaud wrote:
>
> Oopss... False joy.
OK, I think this is a bug in the YARN Client and the way it uses the
.properties files to submit jobs.
As a work around: Can you mv the /tmp/.yarn-properties-vo
specific execution to have a proper workaround ?
> Thanks,
> Arnaud
>
> -Message d'origine-
> De : Ufuk Celebi [mailto:u...@apache.org]
> Envoyé : jeudi 3 décembre 2015 11:53
> À : user@flink.apache.org
> Objet : Re: HA Mode and standalone containers compatibility ?
ify its path
>> for a specific execution to have a proper workaround ?
>> Thanks,
>> Arnaud
>>
>> -Message d'origine-
>> De : Ufuk Celebi [mailto:u...@apache.org]
>> Envoyé : jeudi 3 décembre 2015 11:53
>> À : user@flink.apache.org
>
und YARN properties file /tmp/.yarn-properties-voyager
Arnaud
De : Robert Metzger [mailto:rmetz...@apache.org]
Envoyé : jeudi 3 décembre 2015 14:03
À : user@flink.apache.org
Objet : Re: HA Mode and standalone containers compatibility ?
There is a configuration parameter called "yarn.pr
11 matches
Mail list logo
