Re: Spark dev-setup

Thanks a lot for the guidelines. I could successfully configure and debug On Wed, Aug 24, 2016 at 7:05 PM, Jacek Laskowski wrote: > On Wed, Aug 24, 2016 at 2:32 PM, Steve Loughran > wrote: > > > no reason; the key thing is : not in cluster mode, as

Latest Release of Receiver based Kafka Consumer for Spark Streaming.

Hi , Released latest version of Receiver based Kafka Consumer for Spark Streaming. Receiver is compatible with Kafka versions 0.8.x, 0.9.x and 0.10.x and All Spark Versions Available at Spark Packages : https://spark-packages.org/package/dibbhatt/kafka-spark-consumer Also at github :

Spark Kerberos proxy user

Hi devs, I'm working (at Stratio) on use spark over mesos and standalone, with a kerberized HDFS We are working to solve these scenarios, - We have an long term running spark sql context using concurrently by many users like Thrift server called CrossData, we need access to hdfs data

Re: Tree for SQL Query

scala> sql("select rand() + 1").queryExecution.analyzed(0).expressions.head.treeString res11: String = "(rand(3296762545665822882) + cast(1 as double)) AS (rand(3296762545665822882) + CAST(1 AS DOUBLE))#29 +- (rand(3296762545665822882) + cast(1 as double)) :- rand(3296762545665822882) +-

Re: Tree for SQL Query

@rxin It's not I'm looking for. Explain prints output like this. == Physical Plan == *Project [id#1576L AS id#1582L] +- *Range (0, 1000, splits=400) I'd like to have whole tree with expressions. So when I have "select x + y" there should by Add expresion etc. M. 2016-08-24 22:39 GMT+02:00