[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-29 Thread bzz
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1318 Looks great to me. Merging to master, if there is no further discussion --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-29 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue: https://github.com/apache/zeppelin/pull/1318 So where are we on this? Can this be merged now? :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-18 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1318 I agree we could be more specific on the title/subject for this document. But lots of company run production on Docker though, just FYI. Either Docker by itself on premise or in the

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-17 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1318 Thanks @astroshim, I have no other concerns. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-17 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1318 It would be better to change the title to reflect the docker. I think we should mention docker is only for small experimental enviroment rather than production environment. Besides that, I don't

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-17 Thread astroshim
Github user astroshim commented on the issue: https://github.com/apache/zeppelin/pull/1318 @zjffdu You're right, usually users don't make their production using docker. but We have been received many question about running Zeppelin on their production environments so I think this

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-17 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1318 The jira title seems a little confusing to me. The PR is for running spark on yarn by docker, but I don't think users will use docker for production. --- If your project is set up for it, you

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-16 Thread astroshim
Github user astroshim commented on the issue: https://github.com/apache/zeppelin/pull/1318 @zjffdu I just tested and got success with removing the yarn profile. I will close the https://github.com/apache/zeppelin/pull/1335 then. Thank you. --- If your project is set up for

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-16 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1318 @astroshim I can use spark 2.0 and hadoop 2.7 successfully. I hit this issue when building zeppelin with profile yarn enabled. So please don't enable yarn profile otherwise you will get hadoop

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-16 Thread astroshim
Github user astroshim commented on the issue: https://github.com/apache/zeppelin/pull/1318 @felixcheung Yes 2.2, Maybe it's because my maven repo has different versions of hadoop libraries like following. ``` ~/zeppelin$ ls -al ~/.m2/repository/org/apache/hadoop/hadoop-common/

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-16 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1318 Looks like some of the Hadoop jars are 2.2 instead of 2.7? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-16 Thread astroshim
Github user astroshim commented on the issue: https://github.com/apache/zeppelin/pull/1318 I got a following error when I try to run zeppelin with spark2.0 ``` ERROR [2016-08-16 16:43:33,121] ({pool-1-thread-3} Utils.java[invokeMethod]:40) -

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-12 Thread astroshim
Github user astroshim commented on the issue: https://github.com/apache/zeppelin/pull/1318 Spark2.0 & hadoop2.7 is working well. - YARN ![image](https://cloud.githubusercontent.com/assets/3348133/17622873/fc1b827c-60d7-11e6-80ec-e8e9890a5c99.png) - hdfs

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-12 Thread astroshim
Github user astroshim commented on the issue: https://github.com/apache/zeppelin/pull/1318 Then what about supporting latest verison(Spark2.0 & hadoop2.7)? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-11 Thread bzz
Github user bzz commented on the issue: https://github.com/apache/zeppelin/pull/1318 Docs looks great to me, thank you @astroshim ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-11 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1318 cool. hadoop versions in distributions: CDH: 2.6.0 HDP/Azure: 2.7.1 EMR: 2.7.2 GCP Dataproc: 2.7.2 --- If your project is set up for it, you can reply to this email and have

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-11 Thread astroshim
Github user astroshim commented on the issue: https://github.com/apache/zeppelin/pull/1318 Spark2.0 & hadoop2.3 is working well. ![image](https://cloud.githubusercontent.com/assets/3348133/17588549/d611d7ca-600a-11e6-87f6-4a692fbae273.png) --- If your project is set up for it,

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-11 Thread astroshim
Github user astroshim commented on the issue: https://github.com/apache/zeppelin/pull/1318 Do you know what version of spark is popular? I will test it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-11 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1318 It's hard to say - I think one approach would be latest (spark 2.0 & Hadoop 2.7); another approach would be the most popular ones --- If your project is set up for it, you can reply to

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-10 Thread astroshim
Github user astroshim commented on the issue: https://github.com/apache/zeppelin/pull/1318 @AhyoungRyu I'll update. Thank you for giving me the informations. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-10 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue: https://github.com/apache/zeppelin/pull/1318 @astroshim Great work indeed! As just proof of reading `spark_cluster_mode.md`, I updated a few minor things in [here](https://github.com/astroshim/zeppelin/pull/9). Could you check this one