Re: Running local and yarn using the same livy server

2020-02-06 Thread Ryan Skraba
Hello! We patched livy with this functionality -- to bypass the global config to permit the "occasional" job to run in local mode. We used an attribute in the REST URL query string to control it. It isn't very difficult to do, but (at the time) my impression was this isn't a particularly

Re: Running local and yarn using the same livy server

2020-02-01 Thread Saisai Shao
I don't think current Livy support such behavior, the cluster manager specified in the conf file is a global configuration which affects all the created sessions. Thanks Saisai Ravi Shankar 于2020年1月28日周二 上午4:02写道: > Hey guys, > Is there a way to start different kind of spark sessions using the

Running local and yarn using the same livy server

2020-01-27 Thread Ravi Shankar
Hey guys, Is there a way to start different kind of spark sessions using the same livy server ? For instance, i want my application to tell livy whether the new session being requested should be started as a "local" session or a "yarn" session on the cluster. Ravi