Re: Setting Spark executor memory (has no effect?)

notebooks work fine (and, my dataset is tiny). > Any ideas what defaults in Zeppelin are different from other notebooks that I > am not aware of or affecting with these settings? > > Regards, > Florian > > On Thu, Dec 10, 2015 at 6:30 AM, Fengdong Yu <fengdo...@everstrin

Re: Setting Spark executor memory (has no effect?)

Did you restart Zeppelin after you export OPTS in zeppelin-env.sh? > On Dec 10, 2015, at 7:42 AM, Florian Leitner > wrote: > > Hi there, I need some help, please. > > I'm using Zeppelin 0.5.5 (locally), and am trying to increase my Executors' > Memory

Re: PySpark on Zeppelin

@moon, any thoughts? Thanks > On Dec 8, 2015, at 5:11 PM, Fengdong Yu <fengdo...@everstring.com> wrote: > > My notebook: > > %pyspark > from pyspark.sql.types import BooleanType > sqlContext.udf.register("is_empty",lambda x : True if not x else Fals

Re: PySpark on Zeppelin

t; > > On 2015년 12월 8일 (화) at 오후 6:04 Amjad ALSHABANI <ashshab...@gmail.com > <mailto:ashshab...@gmail.com>> wrote: > Hello, > > Are you sure that you ve installed the module pyspark. > > Please check your spark installation directory if you could see the python

Re: PySpark on Zeppelin

> sub-directory > Amjad > > On Dec 8, 2015 9:55 AM, "Fengdong Yu" <fengdo...@everstring.com > <mailto:fengdo...@everstring.com>> wrote: > Hi > > I am using Zeppelin-0.5.5 with Spark 1.5.2 > > It cannot find pyspark module. > > > E

PySpark on Zeppelin

Hi I am using Zeppelin-0.5.5 with Spark 1.5.2 It cannot find pyspark module. Error from python worker: /usr/local/bin/python: No module named pyspark PYTHONPATH was: I’ve configured pyspark in zeppelin-env.sh: export

Re: PySpark on Zeppelin

the python > sub-directory > Amjad > > On Dec 8, 2015 9:55 AM, "Fengdong Yu" <fengdo...@everstring.com > <mailto:fengdo...@everstring.com>> wrote: > Hi > > I am using Zeppelin-0.5.5 with Spark 1.5.2 > > It cannot find pyspark module. >

Re: PySpark on Zeppelin

Another, I only deployed Spark on the Zeppelin host, not deploy Spark on Yarn cluster nodes. > On Dec 8, 2015, at 7:50 PM, Fengdong Yu <fengdo...@everstring.com> wrote: > > System.getenv().get("PYTHONPATH”) > res6: String = > /usr/spark/current/python/lib

Re: PySpark on Zeppelin

those files and dirs are > exists? > > Thanks, > moon > > On Tue, Dec 8, 2015 at 6:22 PM Fengdong Yu <fengdo...@everstring.com > <mailto:fengdo...@everstring.com>> wrote: > I tried. the same error now. > > I even tried remove spark.yarn.jar in interprete

Re: PySpark on Zeppelin

e, > BooleanType()) > > %pyspark > sqlContext.sql("select is_empty(name) as name from test_table limit > 10").show() > > without error. Can you share what kind of error do you see? > > Thanks, > moon > > On Tue, Dec 8, 2015 at 10:29 PM Fengdo

Re: zeppelin-162 issue

Hi, how did you define spark.home in zeppelin-env.sh? A right way is: export SPARK_HOME= > On Nov 24, 2015, at 9:45 PM, Balachandar R.A. > wrote: > > Thanks for the response. I did try 0.5.5 but faced issues in starting > itself. The notebook I create

Re: Building Zeppelin for Spark

ave to build spark myself. > > So building zeppelin from source will pull the latest spark (1.5.2) in? > > Thanks. > > On 11/12/2015 06:45 AM, Fengdong Yu wrote: >> I am not catch up what’s you really want >> >> If you want to build Zeppelin based on Spark, the

Re: authentication

realm/ldap/JndiLdapRealm.html> > > HTH > Guillaume > > On 10 November 2015 at 10:56, Fengdong Yu <fengdo...@everstring.com > <mailto:fengdo...@everstring.com>> wrote: > I don’t find where is LDAP, can you give me a line range, thx > > > >> On No

Re: authentication

github.com/apache/incubator-zeppelin/pull/53> > > > From: Fengdong Yu > Reply-To: <users@zeppelin.incubator.apache.org > <mailto:users@zeppelin.incubator.apache.org>> > Date: Monday, November 9, 2015 at 4:18 AM > To: <users@zeppelin.incubator.apache.

Re: Zeppelin-0.5.5 and Spark-1.5.1

t; On Thu, Nov 5, 2015 at 4:09 PM Fengdong Yu <fengdo...@everstring.com > <mailto:fengdo...@everstring.com>> wrote: > Hi Team > > Can I changed spark version to 1.5.1 and re-build? does that support > spark-1.5.1 currently? > > > >

Re: Help in Zeppelin installation

t; So now I will be able to investigate that problem > > On Thu, Nov 5, 2015 at 9:47 AM, Pablo Torre <pablotorr...@gmail.com > <mailto:pablotorr...@gmail.com>> wrote: > Do you mean by using the PR that Courneau shared with us? > > 2015-11-05 5:20 GMT+01:00 F

Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher

what’s possible ideas to debug this error. Spark-1.5.1, HDP2.2, Zeppelin-0.5.5 Zeppelin-0.5 does work.

Re: Zeppelin-web build failure

I finally succeed on the Ubuntu VM. not use your PR > On Nov 5, 2015, at 9:40 AM, Corneau Damien <cornead...@gmail.com> wrote: > > I guess I will have to make an Ubuntu VM then > > On Thu, Nov 5, 2015 at 2:38 AM, Fengdong Yu <fengdo...@everstring.com > <m

Re: Zeppelin-web build failure

I ran: men -DskipTests package why it still run test cases? > On Nov 5, 2015, at 9:40 AM, Corneau Damien <cornead...@gmail.com> wrote: > > I guess I will have to make an Ubuntu VM then > > On Thu, Nov 5, 2015 at 2:38 AM, Fengdong Yu <fengdo...@everstri

Re: Zeppelin-web build failure

he/incubator-zeppelin/pull/390> > > On Wed, Nov 4, 2015 at 12:01 PM, Fengdong Yu <fengdo...@everstring.com > <mailto:fengdo...@everstring.com>> wrote: > Thanks for quick response. I tried ./grunt test: > > > Azuryy-MacBook-Pro:zeppelin-web root# ./grunt test >

Re: Help in Zeppelin installation

Did build on the MacBook? if so, please move to Ubuntu VM. I met the same issue, but I finally succeed on the Ubuntu. > On Nov 5, 2015, at 3:04 AM, Pablo Torre wrote: > > Hi Coernau, > > I tried it, using the pull request that you shared with us >

Zeppelin-0.5.5 and Spark-1.5.1

Hi Team Can I changed spark version to 1.5.1 and re-build? does that support spark-1.5.1 currently?

Zeppelin-web build failure

HI Team, I build Zeppelin-0.5.5 on Mac failed. can you tell me the reason, Thanks for your input. [INFO] [INFO] Building Zeppelin: web Application 0.5.5-incubating-SNAPSHOT [INFO]