Jerry,
I was able to use window functions without the hive thrift server. HiveContext
does not imply that you need the hive thrift server running.
Here’s what I used to test this out:
var conf = new SparkConf(true).set(spark.cassandra.connection.host,
127.0.0.1)
val sc = new
I forgot to mention, my setup was:
- Spark 1.4.1 running in standalone mode
- Datastax spark cassandra connector 1.4.0-M1
- Cassandra DB
- Scala version 2.10.4
From: Benjamin Ross
Sent: Tuesday, August 11, 2015 10:16 AM
To: Jerry; Michael Armbrust
Cc: user
You will need to use a HiveContext for window functions to work.
On Mon, Aug 10, 2015 at 1:26 PM, Jerry jerry.c...@gmail.com wrote:
Hello,
Using Apache Spark 1.4.1 I'm unable to use lag or lead when making queries
to a data frame and I'm trying to figure out if I just have a bad setup or
if
By the way, if Hive is present in the Spark install, does show up in text
when you start the spark shell? Any commands I can run to check if it
exists? I didn't setup the spark machine that I use, so I don't know what's
present or absent.
Thanks,
Jerry
On Mon, Aug 10, 2015 at 2:38 PM,
