Class not found exception when executing rdd transform function with lambdas: regression?

2017-02-07 Thread Benoit Hanotte
Hello all, I am experiencing a ClassNotFoundException when trying to run RDD transaformations on Zeppelin 0.7.0, spark 2.1 compiled under scala 2.10 and hadoop 2.6.0-cdh5.5.0 It only happens when using lambdas it seems and seems to match this very issue that was fixed a few months ago: https://iss

Scalding with Zeppelin 0.6.2: Job Failed, Null user

2016-12-02 Thread Benoit Hanotte
Hello all, I am using zeppelin to use spark in yarn-client mode on my company's cluster and it works great. However I am now trying to run scalding in hdfs mode on the same cluster but the jobs always fail with the following error logged: 16/12/02 10:54:27 DEBUG UserGroupInformation: hadoop logi

Re: Zeppelin in local computer using yarn on distant cluster

2016-11-02 Thread Benoit Hanotte
t;> [1] >> http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/interpreter/ >> spark.html#1-export-spark_home >> http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/spark >> _cluster_mode.html#4-configure-spark-interpreter-in-zeppelin >> >> Hope this helps. &g

Re: Zeppelin in local computer using yarn on distant cluster

2016-11-02 Thread Benoit Hanotte
UB_USER_KEY # Optional, when using Zeppelin with authentication. I also tried simply /usr/local/lib/hadoop and I also create a conf directory within /usr/local/lib/hadoop/etc/hadoop and placed yarn-site.xml within this folder Thanks On Wed, Nov 2, 2016 at 10:06 AM, Hyung Sung Shim wrote: > Coul

Re: Zeppelin in local computer using yarn on distant cluster

2016-11-02 Thread Benoit Hanotte
v.sh. > Thanks. > 2016년 11월 2일 (수) 오전 5:07, Benoit Hanotte 님이 작성: > >> Hello, >> >> I'd like to use zeppelin on my local computer and use it to run spark >> executors on a distant yarn cluster since I can't easily install zeppelin >> on the cluster gateway. &

Zeppelin in local computer using yarn on distant cluster

2016-11-01 Thread Benoit Hanotte
Hello, I'd like to use zeppelin on my local computer and use it to run spark executors on a distant yarn cluster since I can't easily install zeppelin on the cluster gateway. I installed the correct hadoop version (2.6), and compiled zeppelin (from the master branch) as following: *mvn clean pac