Flink 1.12.1 example applications failing on a single node yarn cluster

I am trying out flink example as explained in flink docs in a single node yarn cluster

Re: Flink 1.12.1 example applications failing on a single node yarn cluster

The same has been asked in StackOverflow also. Any suggestions here? On Wed, Feb 24, 2021 at 10:25 PM Debraj Manna wrote: > I am trying out flink example as explained in flink do

Re: Flink 1.12.1 example applications failing on a single node yarn cluster

In my setup hadoop-yarn-nodemenager is running with yarn user. ubuntu@vrni-platform:/tmp/flink$ ps -ef | grep nodemanager yarn 4953 1 2 05:53 ?00:11:26 /usr/lib/jvm/java-8-openjdk/bin/java -Dproc_nodemanager -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/lib/heap-dumps/yar

Re: Flink 1.12.1 example applications failing on a single node yarn cluster

Hi Debraj, thanks for reaching out to the Flink community. Without knowing the details on how you've set up the Single-Node YARN cluster, I would still guess that it is a configuration issue on the YARN side. Flink does not know about a .flink folder. Hence, there is no configuration to set this fo

Re: Flink 1.12.1 example applications failing on a single node yarn cluster

Thanks Matthias for replying. Yes there was some yarn configuration issue on my side which I mentioned in my last email. I am starting on flink. So just for my understanding in few links (posted below) it is reported that flink needs to create a .flink directory in the users home folder. Even tho

Re: Flink 1.12.1 example applications failing on a single node yarn cluster

Hi Debrai, sorry for misleading you first. You're right. I looked through the code once more and found something: There's the yarn.staging-directory [1] that is set to the user's home folder by default. This parameter is used by the YarnApplicationFileUploader [2] to upload the application files.