Re: Spark Phoenix Plugin

2016-02-08 Thread pierre lacave
Havent met that one. According to SPARK-1867, the real issue is hidden. I d process by elimination, maybe try in local[*] mode first https://issues.apache.org/jira/plugins/servlet/mobile#issue/SPARK-1867 On Tue, 9 Feb 2016, 04:58 Benjamin Kim wrote: > Pierre, > > I got it

Re: Spark Phoenix Plugin

2016-02-08 Thread Benjamin Kim
Pierre, I got it to work using phoenix-4.7.0-HBase-1.0-client-spark.jar. But, now, I get this error: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 3,

Re: Spark Phoenix Plugin

2016-02-08 Thread Benjamin Kim
Hi Pierre, I tried to run in spark-shell using spark 1.6.0 by running this: spark-shell --master yarn-client --driver-class-path /opt/tools/phoenix/phoenix-4.7.0-HBase-1.0-client.jar --driver-java-options "-Dspark.executor.extraClassPath=/opt/tools/phoenix/phoenix-4.7.0-HBase-1.0-client.jar”

Re: Spark Phoenix Plugin

2016-02-08 Thread Josh Mahonin
Hi Ben, I'm not sure about the format of those command line options you're passing. I've had success with spark-shell just by setting the 'spark.executor.extraClassPath' and 'spark.driver.extraClassPath' options on the spark config, as per the docs [1]. I'm not sure if there's anything special

Re: Spark Phoenix Plugin

2016-02-08 Thread Benjamin Kim
Hi Josh, I tried again by putting the settings within the spark-default.conf. spark.driver.extraClassPath=/opt/tools/phoenix/phoenix-4.7.0-HBase-1.0-client.jar spark.executor.extraClassPath=/opt/tools/phoenix/phoenix-4.7.0-HBase-1.0-client.jar I still get the same error using the code below.

Re: Spark Phoenix Plugin

2016-02-08 Thread pierre lacave
This is the wrong client jar try with the one named phoenix-4.7.0-HBase-1.1-client-spark.jar On Mon, 8 Feb 2016, 22:29 Benjamin Kim wrote: > Hi Josh, > > I tried again by putting the settings within the spark-default.conf. > > >