Re: spark 1.6 with scala 2.11 support

This was asked very recently on this same list: http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Scala-2-11-td2394.html#none On Wed, Feb 24, 2016 at 2:35 PM Potato Farmer wrote: > Hi, > > > > Are there any plans for Zeppelin to support Spark 1.6 with Scala 2.11 > Interpre

Re: csv dependencies loaded in %spark but not %sql in spark 1.6/zeppelin 0.5.6

om:* Benjamin Kim [mailto:bbuil...@gmail.com] > > *Sent:* Tuesday, February 02, 2016 3:34 PM > > *To:* users@zeppelin.incubator.apache.org > > *Cc:* d...@zeppelin.incubator.apache.org > > *Subject:* Re: csv dependencies loaded in %spark but not %sql in spark > > 1.6/zepp

Re: csv dependencies loaded in %spark but not %sql in spark 1.6/zeppelin 0.5.6

BTW, this sounds very similar to https://issues.apache.org/jira/browse/ZEPPELIN-297, which affects %pyspark and was fixed in Zeppelin 0.5.5. On Tue, Feb 2, 2016 at 12:32 PM Jonathan Kelly wrote: > Hey, I just ran into that same exact issue yesterday and wasn't sure if I > was doin

Re: csv dependencies loaded in %spark but not %sql in spark 1.6/zeppelin 0.5.6

Hey, I just ran into that same exact issue yesterday and wasn't sure if I was doing something wrong or what. Glad to know it's not just me! Unfortunately I have not yet had the time to look any deeper into it. Would you mind filing a JIRA if there isn't already one? On Tue, Feb 2, 2016 at 12:29 PM

Re: Notebook Rest API does not work with Zeppelin EMR (while other rest APIs works)

daemon.sh directly. > > BTW > Monit monitors the process and can restart if needed, but not less > important: it gives us web API that users (such as these data scientists) > can restart Zeppelin without ssh to the machine. > > On Tue, Jan 19, 2016 at 4:01 AM, Jonathan Kelly &

Re: Java NPE when Loading a Dependency from Maven from within Zeppelin on AWS EMR

rk.SparkConf,batchDuration: >> org.apache.spark.streaming.Duration)org.apache.spark.streaming.StreamingContext >> (sparkContext: >> org.apache.spark.org.apache.spark.org.apache.spark.org.apache.spark.org.apache.spark.SparkContext,batchDuration: >> org.apache.spark.strea

Re: Java NPE when Loading a Dependency from Maven from within Zeppelin on AWS EMR

ssc = new > StreamingContext(sc,Seconds(1)) > > See how the modules leading up to the class name are funny: > org.apache.spark.org.apache it look's like it's it a loop. And one can > see in the error message that what I did was indeed use a SparkContext and > then a D

Re: Java NPE when Loading a Dependency from Maven from within Zeppelin on AWS EMR

ppelin/conf/zeppelin.sh*: > http://stackoverflow.com/a/35006137/436721 > > Anyway, thanks for the reply, will let you know if the problem persists. > > FA > > On 26 January 2016 at 23:19, Jonathan Kelly > wrote: > >> Felipe, >> >> I'm really sorry you

Re: Java NPE when Loading a Dependency from Maven from within Zeppelin on AWS EMR

Felipe, I'm really sorry you had to deal with this frustration, but the good news is that we on EMR have fixed this issue and just released the fix in emr-4.3.0 today. (At least, it is available in some regions today and should be available in the other regions by some time tomorrow.) BTW, this w

Re: Notebook Rest API does not work with Zeppelin EMR (while other rest APIs works)

oes not, > well, stop... > > On Fri, Jan 15, 2016 at 7:22 PM, Jonathan Kelly > wrote: > >> Thanks! >> >> I think rather than "sudo /etc/init.d/zeppelin start" the usual way would >> be "sudo service zeppelin start". However, on EMR 4.x, we

Re: Notebook Rest API does not work with Zeppelin EMR (while other rest APIs works)

ay say, you need to add service support to Zeppelin. > I.e. to allow start of Zeppelin this way: > sudo /etc/init.d/zeppelin start > > *that will start zeppelin under Zeppelin user. >> On Jan 15, 2016 9:03 AM, "Jonathan Kelly" wrote: >> Yes, there are a lot of change

Re: Notebook Rest API does not work with Zeppelin EMR (while other rest APIs works)

ging last year snow 😉 > On Jan 15, 2016 3:07 AM, "Jonathan Kelly" wrote: > >> But now some bad news. I was playing around with the REST API a little >> more, and I noticed that I get the same AbstractMethodError on Zeppelin >> 0.5.6 for a POST to /api/job/2A94

Re: Notebook Rest API does not work with Zeppelin EMR (while other rest APIs works)

/api/notebook/* in the next release, and yet still fail for /api/job/* in that same release? On Thu, Jan 14, 2016 at 4:13 PM Jonathan Kelly wrote: > Oh, hey, good news! I just tried Zeppelin 0.5.6 on EMR, and the Notebook > API works fine. So now we just need Zeppelin 0.5.6 to be offi

Re: Notebook Rest API does not work with Zeppelin EMR (while other rest APIs works)

handle message > java.lang.NullPointerException > > Many of those. > If anyone knows what does it mean > > On Thu, Jan 14, 2016 at 12:23 AM, Jonathan Kelly > wrote: > >> Interesting... I confirmed that removing all of the extra classpath >> entries added

Re: Notebook Rest API does not work with Zeppelin EMR (while other rest APIs works)

Jonathan Kelly wrote: > Ah, never mind. I had incorrectly been excluding the jars in > /usr/lib/zeppelin/interpreter, and I just noticed that jersey-core-1.9.jar > appears in two places underneath that directory (in the hive and phoenix > interpreter libs), and those jars are included in

Re: Notebook Rest API does not work with Zeppelin EMR (while other rest APIs works)

ly want to test it you need to build zeppelin and instructe >> maven to exclude the problematic dependency fron one of these jars. >> In other words, maven should bring the jar, but without the duplicate >> dependency. >> Having said that, and as I stated above, I think

Re: Notebook Rest API does not work with Zeppelin EMR (while other rest APIs works)

en should bring the jar, but without the duplicate > dependency. > Having said that, and as I stated above, I think that the problematic > dependency comes from the additional classpath and not from Zeppelin core > jars. > On Jan 13, 2016 11:08 PM, "Jonathan Kelly" wrote

Re: Notebook Rest API does not work with Zeppelin EMR (while other rest APIs works)

Hi, Ophir, (Jonathan from EMR here) Are you using emr-4.1.0 or emr-4.2.0? I just tried this with emr-4.2.0 and found that http://:8890/api/notebook works for me, but http:// :8890/api/notebook/2A94M5J1Z fails. For some reason it doesn't quite fail with the same exception that you're seeing, but it

Re: Restarting Zeppelin server/application on AWS EMR

Asif, EMR 4.x services are run with upstart , so that if they die or are killed, they will be automatically restarted. Did the Zeppelin server process not actually die but just got stuck? Because if it did die, it should have been restarted. Or was it the Zeppelin Spark

Re: dep loader failing on aws emr

Asif, This was also brought up by a somebody else at Amazon on Friday, and I came up with the following EMR Step that can be used to work around the issue: aws emr create-cluster ... --applications Zeppelin-Sandbox --steps Name=CreateZeppelinLocalRepo,Jar=command-runner.jar,Args=[bash,-c,"sudo -u

Re: [ANNOUNCE] Apache Zeppelin 0.5.5-incubating released

And now Zeppelin 0.5.5 has been released on emr-4.2.0 today! Same Day Delivery! :) Thanks, Zeppelin community for a great release! ~ Jonathan On Thu, Nov 19, 2015 at 4:37 PM, Alexander Bezzubov wrote: > Great job, thanks to everybody envolved! > > Looking forward futher time-based releases o

Re: Zeppelin spark RDD commands fail yet work in spark-shell

That exception looks like one that I see when using too new of a version of Jackson. See https://issues.apache.org/jira/browse/SPARK-8332. The short answer is that you probably need to make sure you are using Jackson 2.4.x rather than 2.5.x. ~ Jonathan On Fri, Oct 16, 2015 at 7:37 AM, Armand Naud

Re: Zeppelin + Spark On EMR?

ocs.aws.amazon.com/ElasticMapReduce/latest/ReleaseGuide/emr-sandbox.html > > /Anders > > On Thu, Oct 1, 2015 at 1:33 AM, Jonathan Kelly > wrote: > >> Zeppelin is now supported on EMR in release emr-4.1.0 without the need >> for any bootstrap action like this. See >> https:/

Re: Zeppelin + Spark On EMR?

Zeppelin is now supported on EMR in release emr-4.1.0 without the need for any bootstrap action like this. See https://aws.amazon.com/blogs/aws/amazon-emr-release-4-1-0-spark-1-5-0-hue-3-7-1-hdfs-encryption-presto-oozie-zeppelin-improved-resizing/ for the emr-4.1.0 announcement. BTW, the version o