Hi,
After getting the code base to compile, I tried running some of the
scala examples.
They all fail since it can't find classes like SparkConf.
If I change the iml file to convert provided scope from PROVIDED to
COMPILE, I am able to run them. It's simple by doing the following in
the
The examples aren't runnable quite like this. It's intended that they
are submitted to a cluster with spark-submit, which would among other
things provide Spark at runtime.
I think you might get them to run this way if you set master to
local[*] and indeed made a run profile that also included
Oh ok. So from the code base, local execution is dependent on everyone's
way then, right? I am indeed changing the code to add the master to
local[*], but still getting the no classdef found errors.
If that's the case, then I think I'm ok then...
Thanks,
Ron
On 08/24/2014 04:21 PM, Sean
I have worked for a branch update the hive version to hive-0.13(by
org.apache.hive)---https://github.com/scwf/spark/tree/hive-0.13
I am wondering whether it's ok to make a PR now because hive-0.13 version is
not compatible with hive-0.12 and here i used org.apache.hive.
On 2014/7/29 8:22,
Yeah, Mesos in coarse-grained mode probably wouldn't work here. It's too bad
that this happens in fine-grained mode -- would be really good to fix. I'll see
if we can get the workaround in https://github.com/apache/spark/pull/1860 into
Spark 1.1. Incidentally have you tried that?
Matei
On
+1 to have the work around in.
I'll be investigating from the Mesos side too.
Tim
On Sun, Aug 24, 2014 at 9:52 PM, Matei Zaharia matei.zaha...@gmail.com wrote:
Yeah, Mesos in coarse-grained mode probably wouldn't work here. It's too bad
that this happens in fine-grained mode -- would be
Hi,
Just to give you some update on this low level consumer (
https://github.com/dibbhatt/kafka-spark-consumer), we at Pearson have been
doing good amount load and stress testing for last few weeks and initial
test results are very impressive. We did not see any data loss, no issue
related to
