Where to find exception stacktrace of executor?

2015-05-20 Thread Eugene Morozov
Hi! I can’t understand where I can get logs from my workers (failed executors) when I’m running job from Zeppelin. I’m using the most recent version of Zeppelin. In spark worker stderr I see the following 15/05/20 09:23:36 INFO Executor: Fetching http://x.x.x.x:51149/jars/my-jar.jar with times

Renaming notebook

2015-05-20 Thread DuyHai Doan
Hello Maybe I have missed something but I did not see how to rename a Spark notebook. By default the name is generated using a random string. I click on the notebook name to rename it but every time my change is wiped and the original name comes back. Does anybody have the same issue ? Regards

Re: Renaming notebook

2015-05-20 Thread IT CTO
I had the same issue but usually when I use the keyboard and click enter at the end of the name then it works. when I leave the field using the mouse it revert back to the generic name. BTW, we should change the default name to something like a running sequence e.g. NewNote-1,NewNote-2 other wise w

Re: Renaming notebook

2015-05-20 Thread DuyHai Doan
Great, using keyboard "Enter" works like a charm. Thanks for the tips Goi. This think should be in the doc. How can I improve the doc ? I find Zeppelin to be a great tool and it deserves a better doc. On Wed, May 20, 2015 at 1:54 PM, IT CTO wrote: > I had the same issue but usually when I use t

Re: Where to find exception stacktrace of executor?

2015-05-20 Thread Eugene Morozov
Well, it looks like Zeppelin must be installed onto all nodes of Spark cluster. It might happen that it’s just required to create logs directory for zeppelin so that all worker nodes are able to put logs into configured file, but it also might happen that the whole Zeppelin is required. Could

Re: Renaming notebook

2015-05-20 Thread Kelly, Jonathan
I think that clicking outside of the box without having to hit enter seems intuitive enough to support it (I mean, that's what both of you had tried initially, and I probably would have done the same), so maybe the implementation should be changed rather than updating the docs? ~ Jonathan Kelly

Re: Renaming notebook

2015-05-20 Thread DuyHai Doan
Whatever the solution (doc change or impl change) I will applause both hands, it will make adoption of Zeppelin larger. I struggle half a day to find this trick On Wed, May 20, 2015 at 9:28 PM, Kelly, Jonathan wrote: > I think that clicking outside of the box without having to hit enter > seem

Re: Renaming notebook

2015-05-20 Thread Kelly, Jonathan
On a somewhat related note, I was very confused initially when I clicked the button to create a new note but was not actually navigated to that new note. It just appears as a new, randomly named note that you then have to choose from the drop down at the top. Could we please change this as wel

Multi-line codes

2015-05-20 Thread DuyHai Doan
Hello Is it possible to have multi line Scala code in the notebook ? I tried: rdd .map(...) .filter(...) .collect() .foreach(...) Every time, it does not work because the compiler complains about having new line in the middle of an instruction. Any idea about how to solve it

Re: Multi-line codes

2015-05-20 Thread Marty B
I write as: rdd . map(foo => ...) . reduce(_ + _) putting the '.' at the end of each line to signal line continuation On Wed, May 20, 2015 at 1:56 PM DuyHai Doan wrote: > Hello > > Is it possible to have multi line Scala code in the notebook ? > > I tried: > > rdd > .map(...) > .

Re: Renaming notebook

2015-05-20 Thread IT CTO
+1 from for the dialog replacing the random name. As it saves the extra step of rename operation On יום ד׳, 20 במאי 2015, 23:39 Kelly, Jonathan wrote: > On a somewhat related note, I was very confused initially when I > clicked the button to create a new note but was not actually navigated to

Re: Multi-line codes

2015-05-20 Thread DuyHai Doan
Oh nice trick! Thanks Marty ! On Wed, May 20, 2015 at 11:19 PM, Marty B wrote: > I write as: > > rdd . > map(foo => ...) . > reduce(_ + _) > > putting the '.' at the end of each line to signal line continuation > > On Wed, May 20, 2015 at 1:56 PM DuyHai Doan wrote: > >> Hello >> >> Is it p

Re: Multi-line codes

2015-05-20 Thread Tyler Mitchell
Has anyone done similar with Python? I couldn't get line continuation to work with it. On May 20, 2015, at 14:26, Marty B mailto:sp...@mjhb.com>> wrote: I write as: rdd . map(foo => ...) . reduce(_ + _) putting the '.' at the end of each line to signal line continuation On Wed, May 20,

Re: Zeppelin with external spark

2015-05-20 Thread moon soo Lee
Hi, If you still have the same problem, could you share your build command? It looks like somethong wrong with akka library version. Thanks, moon On 2015년 5월 7일 (목) at 오후 2:45 wrote: > Hi all, > > > I am trying to connect zeppelin with external spark, But in zeppelin log > am getting error l

Re: Error: Scheduler already terminated

2015-05-20 Thread moon soo Lee
Hi, Here's related issue. https://issues.apache.org/jira/browse/ZEPPELIN-85 Latest master branch has bug that prints 'Scheduler already terminated' after changing interpreter setting. If it is not your case, could you search for log starts with zeppelin-interpreter-jdbclog and see any excepti

Re: sc, sqlContext errors

2015-05-20 Thread moon soo Lee
Hi I have experience about spark-mongodb works. but it looks like, spark worker is trying to access http:// /jars/Query-1.0.jar and mysystemurl is returning 504. Could you explain little bit more about what is Query-1.0.jar and how it is added in your code? Thanks, moon On Mon, May 11, 2015 at

Re: Renaming notebook

2015-05-20 Thread moon soo Lee
Hi, If you're interested in updating doc (homepage), it is maintained as a branch 'gh-pages' in our git repository. You can update homepage by Making pull request. Currently Zeppelin's documentation is really minimal. It is very welcome anyone improve it. Best, moon On Wed, May 20, 2015 at 9:21

Re: Renaming notebook

2015-05-20 Thread moon soo Lee
Navigation to new note, i agree Zeppelin need improvements. If someone create issue for it, it'll be really helpful. Thanks, moon On Thu, May 21, 2015 at 6:26 AM IT CTO wrote: > +1 from for the dialog replacing the random name. As it saves the extra > step of rename operation > > On יום ד׳, 20

Re: Where to find exception stacktrace of executor?

2015-05-20 Thread moon soo Lee
Hi, Zeppelin suppose not to be installed in all modes of Spark cluster. Do you see any exception in Zeppelin's log file? Thanks, moon On 2015년 5월 20일 (수) at 오후 10:26 Eugene Morozov wrote: > Well, > > it looks like Zeppelin must be installed onto all nodes of Spark cluster. > > It might happen t

Re: Renaming notebook

2015-05-20 Thread Corneau Damien
The Navigation to newly created note was raised a few times already, and there was an issue on the old repository. But It seems it wasn't created on the Apache JIRA. (just checked) Last time I looked into that, I realized that it need to be handled with a basic REST API call instead of Websocket.