Havent met that one.
According to SPARK-1867, the real issue is hidden.
I d process by elimination, maybe try in local[*] mode first
https://issues.apache.org/jira/plugins/servlet/mobile#issue/SPARK-1867
On Tue, 9 Feb 2016, 04:58 Benjamin Kim wrote:
> Pierre,
>
> I got it
Pierre,
I got it to work using phoenix-4.7.0-HBase-1.0-client-spark.jar. But, now, I
get this error:
org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in
stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID
3,
Hi Pierre,
I tried to run in spark-shell using spark 1.6.0 by running this:
spark-shell --master yarn-client --driver-class-path
/opt/tools/phoenix/phoenix-4.7.0-HBase-1.0-client.jar --driver-java-options
"-Dspark.executor.extraClassPath=/opt/tools/phoenix/phoenix-4.7.0-HBase-1.0-client.jar”
Hi Ben,
I'm not sure about the format of those command line options you're passing.
I've had success with spark-shell just by setting the
'spark.executor.extraClassPath' and 'spark.driver.extraClassPath' options
on the spark config, as per the docs [1].
I'm not sure if there's anything special
Hi Josh,
I tried again by putting the settings within the spark-default.conf.
spark.driver.extraClassPath=/opt/tools/phoenix/phoenix-4.7.0-HBase-1.0-client.jar
spark.executor.extraClassPath=/opt/tools/phoenix/phoenix-4.7.0-HBase-1.0-client.jar
I still get the same error using the code below.
This is the wrong client jar try with the one named
phoenix-4.7.0-HBase-1.1-client-spark.jar
On Mon, 8 Feb 2016, 22:29 Benjamin Kim wrote:
> Hi Josh,
>
> I tried again by putting the settings within the spark-default.conf.
>
>
>