Re: Spark job via livy issue from a docker container

2017-10-20 Thread Meisam Fathi
Hi Sarjeet! Is livy.rsc.rpc.server.address set in the conf/livy-client.conf? Or in conf/livy.conf if you are using an older version of Livy? Thanks, Meisam 2017-10-19 12:44:59,688 WARN [Driver] rsc.RSCConf: Your hostname, node1.lab > (*valid hostname*), resolves to a loopback address, but we

Spark job via livy issue from a docker container

2017-10-19 Thread sarjeet singh
Hello, I have built a livy docker container and trying to connect it to a YARN cluster running outside of docker container host. When I am submitting a spark job via livy inside the container (yarn-cluster mode) from Zeppelin UI, I see the job is submitted (verified from RM UI and yarn container