System properties when submitting flink job to YARN Session

2017-07-08 Thread Jins George
Hello, I want to set the path of a properties file as System property in my application(something like -Dkey=value). Is there a way to set it while submitting a flink job to running YARN Session? I am using //bin/flink run/ to submit the job to a already running YARN session. Thanks, Jins

Re: Flink Jobs disappers

2017-07-08 Thread Chesnay Schepler
If a TaskManager ran out of memory there should be something in the JobManager logs about a unreachable TaskManager. That said, there should also be something in the JobManager logs about the job disappearing... Could you set the logging level to DEBUG, run the job again, and provide us (or

Re: Flink Jobs disappers

2017-07-08 Thread G.S.Vijay Raajaa
HI Chesnay, I am currently using Flink - 1.3 using docker containers. I am not using it in HA mode. I have 3 task managers and one job manager. This happens randomly and not every time. Does it mean the task manager ran out of memory etc? I am using slots more than the available core , I hope

Re: Flink Jobs disappers

2017-07-08 Thread Chesnay Schepler
Hello, could you tell us a bit more about your setup? Which Flink version you're using, whether HA is enabled, does this happen every time etc. . Regards, Chesnay On 06.07.2017 21:43, G.S.Vijay Raajaa wrote: HI, I am using Flink Task manager and Job Manager as docker containers. Strangely,