Re: Run spark application in different clusters

2019-02-21 Thread Meisam Fathi
Currently this feature is not available in Livy. The values of HADOOP_CONF_DIR and YARN_CONF_DIR are read and set when Livy starts and never change. Thanks, Meisam On Thu, Feb 21, 2019, 12:47 AM Praveen Muthusamy wrote: > Hi, > > Currently HADOOP_CONF_DIR and YARN_CONF_DIR are used to find out

Run spark application in different clusters

2019-02-21 Thread Praveen Muthusamy
Hi, Currently HADOOP_CONF_DIR and YARN_CONF_DIR are used to find out the yarn on which the application will be run. Can a single instance of livy server interface multiple yarn/hadoop clusters? Is it possible to do spark submit to two different hadoop clusters from a single livy server? Regards,