Re: Accessing Detailed Livy Session Information (session name?)

2019-04-15 Thread Marco Gaido
I think in general our website documentation is not complete and I think it would be great if we could improve it significantly. For instance, there is no place where all configurations are described properly (other than reading the code). I think that PRs and help in improving the doc would be

Re: Accessing Detailed Livy Session Information (session name?)

2019-04-15 Thread Meisam Fathi
Hi Peter, Are you using ZooKeeper for recovery store? If yes, in conf/livy.conf, is livy.server.recovery.zk-state-store.key-prefix set to different values in different Livy instances? If not, all of Livy instances will read/write the recovery data from/to the same path, which is default is

Re: Accessing Detailed Livy Session Information (session name?)

2019-04-12 Thread Meisam Fathi
Hi Peter, Livy 0.6 has a new feature to give each session a name: https://github.com/apache/incubator-livy/pull/48 Would this feature be useful in your usecase? Thanks, Meisam On Fri, Apr 12, 2019, 8:51 AM Peter Wicks (pwicks) wrote: > Greetings, > > > > I have a custom service that connects

Accessing Detailed Livy Session Information (session name?)

2019-04-12 Thread Peter Wicks (pwicks)
Greetings, I have a custom service that connects to Livy, v0.4 soon to be v0.5 once we go to HDP3. If sessions already exist it logs the session ID's and starts using them, if sessions don't exist it creates new ones. The problem is the account used to launch the Livy sessions is not unique to