Re: livy impersonation in kerberized cluster

Did you try restarting HDFS for updated core-site.xml to be effective? Thanks! Prabhu > On Apr 17, 2019, at 11:30 PM, rei sivan wrote: > > -- Forwarded message - > From: rei sivan > Date: Wed, 17 Apr 2019, 21:06 > Subject: livy impersonation in kerberized cluster > To: > > >

Re: resolve the scalability problem caused by app monitoring in livy with an actor-based design

As Meisam highlighted, in our case, we have Livy Multi-Node HA i.e livy running on 6 servers for each cluster, load-balanced, sharing livy metadata on zookeeper and running thousands of applications. With below changes, we are seeing good improvements due to batching the requests (one per livy node