Re: Cloudera Spark 2.2

This should do: > export SPARK_HOME=/opt/cloudera/parcels/SPARK2/lib/spark2 > export HIVE_HOME=/opt/cloudera/parcels/CDH/lib/hive > export HADOOP_HOME=/opt/cloudera/parcels/CDH/lib/hadoop > export HADOOP_CONF_DIR=/etc/hadoop/conf > export HIVE_CONF_DIR=/etc/hive/conf > > mvn clean package

Re: Cloudera Spark 2.2

Hi Ruslan, Can you send me the steps you used to build it, especially the Maven command with the arguments? I will try to build it also. I do believe that the binaries are for official releases. Cheers, Ben On Wed, Aug 2, 2017 at 3:44 PM Ruslan Dautkhanov wrote: > It

Re: Cloudera Spark 2.2

It was built. I think binaries are only available for official releases? -- Ruslan Dautkhanov On Wed, Aug 2, 2017 at 4:41 PM, Benjamin Kim wrote: > Did you build Zeppelin or download the binary? > > On Wed, Aug 2, 2017 at 3:40 PM Ruslan Dautkhanov

Re: Cloudera Spark 2.2

Did you build Zeppelin or download the binary? On Wed, Aug 2, 2017 at 3:40 PM Ruslan Dautkhanov wrote: > We're using an ~April snapshot of Zeppelin, so not sure about 0.7.1. > > Yes, we have that spark home in zeppelin-env.sh > > > > -- > Ruslan Dautkhanov > > On Wed, Aug

Re: Cloudera Spark 2.2

Does this work with Zeppelin 0.7.1? We an error when setting SPARK_HOME in zeppelin-env.sh to what you have below. On Wed, Aug 2, 2017 at 3:24 PM Ruslan Dautkhanov wrote: > You don't have to use spark2-shell and spark2-submit to use Spark 2. > That can be controled by

Re: Cloudera Spark 2.2

According to the Zeppelin documentation, Zeppelin 0.7.1 supports Spark 2.1. But, I don't know if it supports Spark 2.2 or even 2.1 from Cloudera. For some reason, Cloudera defaults to Spark 1.6 and so does the calls to spark-shell and spark-submit. To force the use of Spark 2.x, the calls need to

Re: Cloudera Spark 2.2

Might need to recompile Zeppelin with Scala 2.11? Also Spark 2.2 now requires JDK8 I believe. -- Ruslan Dautkhanov On Tue, Aug 1, 2017 at 6:26 PM, Benjamin Kim wrote: > Here is more. > > org.apache.zeppelin.interpreter.InterpreterException: WARNING: > User-defined

Re: Cloudera Spark 2.2

Here is more. org.apache.zeppelin.interpreter.InterpreterException: WARNING: User-defined SPARK_HOME (/opt/cloudera/parcels/SPARK2-2.2.0.cloudera1-1.cdh5.12.0.p0.142354/lib/spark2) overrides detected (/opt/cloudera/parcels/SPARK2/lib/spark2). WARNING: Running spark-class from user-defined

Re: Cloudera Spark 2.2

Here is the error that was sent to me. org.apache.zeppelin.interpreter.InterpreterException: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FSDataInputStream Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream Cheers, Ben On Tue,

Re: Cloudera Spark 2.2

What's the error you see in log ? Benjamin Kim 于2017年8月2日周三 上午8:18写道： > Has anyone configured Zeppelin 0.7.1 for Cloudera's release of Spark 2.2? > I can't get it to work. I downloaded the binary and set SPARK_HOME to > /opt/cloudera/parcels/SPARK2/lib/spark2. I must be

Cloudera Spark 2.2

Has anyone configured Zeppelin 0.7.1 for Cloudera's release of Spark 2.2? I can't get it to work. I downloaded the binary and set SPARK_HOME to /opt/cloudera/parcels/SPARK2/lib/spark2. I must be missing something. Cheers, Ben