Question about jobmanager.web.upload.dir

2017-05-17 Thread Mauro Cortellazzi
Hi Flink comunity, is there a particular reason to delete the jobmanager.web.upload.dir content when the JobManager restart? Could it be interesting have the jar previously uploaded when JM restart? Could the jars be saved to HDFS for HA mode? Thank you for your support. Mauro

Re: Question about jobmanager.web.upload.dir

2017-05-17 Thread Timo Walther
Hey Mauro, I'm not aware of any reason for that. I loop in Chesnay, maybe he knows why. @Chesnay wouldn't it be helpful to also archive the jars using the HistoryServer? Timo Am 17.05.17 um 12:31 schrieb Mauro Cortellazzi: Hi Flink comunity, is there a particular reason to delete the jobm

Re: Question about jobmanager.web.upload.dir

2017-05-17 Thread Chesnay Schepler
I don't know why we delete it either, but my guess is that at one point this was a temporary directory that we properly cleaned up, and later allowed it to be configurable. Currently, this directory must be in the local file system. We could change it to also allow non-local paths, which shoul

Re: Question about jobmanager.web.upload.dir

2017-05-17 Thread Mauro Cortellazzi
Thank you Chesnay and Timo for your answers. Il 17/05/2017 16:49, Chesnay Schepler ha scritto: I don't know why we delete it either, but my guess is that at one point this was a temporary directory that we properly cleaned up, and later allowed it to be configurable. Currently, this director