Dear,

I am new to Livy but succeeded in setting it up for a Spark cluster.

It seems however it is not possible to process statements concurrently, even 
with the Livy session using Spark's fair scheduler.

For sql queries the Thriftserver integration of Livy appears to  allow 
concurrent processing from beeline. After running maven with Pthriftserver, it 
works fine.

However, to create a Thriftserver session a POST request to the 
thriftserver/sessions is not allowed (405 status code) in my running livy 
server.  Do I resolve this by means of enabling authentication?

Another plausible reason is that POST is not implemented for thrift server 
sessions. But then I don't understand how to create a session using Scala code.

The example code ( 
https://github.com/apache/incubator-livy/blob/4d8a912699683b973eee76d4e91447d769a0cb0d/thriftserver/server/src/test/scala/org/apache/livy/thriftserver/ThriftServerSuites.scala#L448)
 specified in a comment of the JIRA issue for the thriftserver issue, exceeds 
my knowledge of scala. How do I run this on the node with the livy server as a 
separate process?

Best

Eddy




Reply via email to