spark thrift server transport protocol

2016-02-11 Thread Sanjeev Verma
I am running spark thrift server to run query over hive, how do I can know which transport protocol my client and server using currently. Thanks

spark yarn client mode

2016-01-19 Thread Sanjeev Verma
Hi Do I need to install spark on all the yarn cluster node if I want to submit the job to yarn client? is there any way exists in which I can spawn a spark job executors on the cluster nodes where I have not installed spark. Thanks Sanjeev

spark source Intellij

2016-01-15 Thread Sanjeev Verma
I want to configure spark source code into Intellij IDEA Is there any document available / known steps which can guide me to configure spark project in to the Intellij IDEA. Any help will be appreciated Thanks

strange behavior in spark yarn-client mode

2016-01-14 Thread Sanjeev Verma
I am seeing a strange behaviour while running spark in yarn client mode.I am observing this on the single node yarn cluster.in spark-default I have configured the executors memory as 2g and started the spark shell as follows bin/spark-shell --master yarn-client which trigger the 2 executors on