Zeppelin is much slower than pure spark-shell

2016-11-16 Thread York Huang
Hi, I am using a spark sql JOIN. It runs well in SPARK-SHELL --master yarn-client, but is very slow and timeout in zeppelin. Where should I examine the issue? Thanks

No Space left on device

2016-11-13 Thread York Huang
I ran into the "No space left on device" error in zeppelin spark when I tried to run the following. cache table temp_tbl as select * from ( select *, rank() over (partition by id order by year desc) as rank from table1 ) v where v.rank =1 The table1 is very big. I set up spark.local.dir in sp

Re: under what userid should Zeppelin run?

2016-11-07 Thread York Huang
; York, > Yes, you can run multiple Zeppelin instances with different configurations. > bin/zeppelin-daemon.sh accepts --config parameter. You can have multiple > configuration directories and point them with --config parameter. > > Thanks, > moon > > On Sun, Nov 6, 2016 at 10:39

Re: under what userid should Zeppelin run?

2016-11-06 Thread York Huang
Also if I want to run all Zeppelin instances from one Linux machine, do I have to create the Zeppelin binaries for each user with different ports so that multiple instances can run in the same box? Sent from my iPhone > On 7 Nov 2016, at 5:17 PM, Igor Yakushin wrote: > > Upon reading the docu

Re: zeppelin architecture with multiple users

2016-09-22 Thread York Huang
rk sessions per user. What is >> unclear is how to deal with backend credentials ? How to configure multiple >> Cassandra credentials and attach each one to a user ? Same thing for Spark >> Livy, How can we configure each Livy session with users cassandra >> credenti

Re: zeppelin architecture with multiple users

2016-09-21 Thread York Huang
; > On Thu, Sep 15, 2016 at 7:15 AM, York Huang > wrote: > >> Hi, >> >> I want to set up a environment for a group of users so that they can >> access zeppelin. Each of them should have their own space, should not >> interfere each other. >> >>

Re: zeppelin architecture with multiple users

2016-09-21 Thread York Huang
2016 at 16:53, York Huang wrote: > Has anyone set up a multi-users Zeppelin? > > Can you please share the details? > > Thanks > > On 16 September 2016 at 03:51, DuyHai Doan wrote: > >> Right now, you have some options to isolate the notes. Look at the doc >>

Re: zeppelin architecture with multiple users

2016-09-21 Thread York Huang
ocs/0.7.0-SNAPSHOT/manual/interpreters.html#interpreter-binding-mode > > > > On Thu, Sep 15, 2016 at 7:15 AM, York Huang > wrote: > >> Hi, >> >> I want to set up a environment for a group of users so that they can >> access zeppelin. Each of them should have

zeppelin architecture with multiple users

2016-09-14 Thread York Huang
still shared. What I want is the data should be totally seperate between users and notebooks. How do I set it up like this? Thanks, York Huang

Install external jar for zeppelin

2016-09-07 Thread York Huang
Hi, I am using HDP 2.4 sandbox. I download spark-avro jar file and add the following to /etc/spark/2.4.0.0-169/0/spark-defaults.conf and /usr/hdp/2.4.0.0-169/etc/spark/conf/spark-defaults.conf. spark.driver.extraClassPath /opt/spark-jars/spark-avro_2.10-2.0.1.jar spark.executor.extraClassPath /op

Re: Can't download zeppelin 0.6.1 binary

2016-09-07 Thread York Huang
ing the >> website last time. >> We are working on a Hotfix right now, shouldn't take long before it's back >> up again. >> We will post in this thread once its done. >> >> >>> On Wed, Sep 7, 2016 at 8:50 AM, York Huang wrote: >>>

Re: Zeppelin architecture

2016-09-06 Thread York Huang
every users' desktop and let them to access MapR from their own desktops, how do I install zeppelin on their windows desktops? Is there any guide somewhere? Thanks, York On 7 September 2016 at 10:06, York Huang wrote: > Hi Moon, > > More questions. > > If I set up the MapR cl

Re: Zeppelin architecture

2016-09-06 Thread York Huang
Hi Moon, More questions. If I set up the MapR cluster in secure mode, how do I set up zeppelin? Thanks, York On 6 September 2016 at 17:16, York Huang wrote: > Hi Moon, > > Thanks for your response. > > I have a MapR 4.1 cluster and would like to use zeppelin on it. If I >

Can't download zeppelin 0.6.1 binary

2016-09-06 Thread York Huang
Hi, I go to the link http://zeppelin.apache.org/download.html. But I can't download zeppelin binary from there. Does anyone know why? Thanks, York

Re: Zeppelin architecture

2016-09-06 Thread York Huang
he.org/docs/latest/interpreter/ > spark.html#object-exchange > > On Sat, Sep 3, 2016 at 6:45 PM York Huang > wrote: > >> Hi, >> >> I am new to Zeppelin and have a few questions. >> 1. Should I install Zeppelin on a Hadoop edge node and every users access >

Zeppelin architecture

2016-09-03 Thread York Huang
Hi, I am new to Zeppelin and have a few questions. 1. Should I install Zeppelin on a Hadoop edge node and every users access from browser? Or should every users have to install their own Zeppelin ? 2. How do I run standard Python without using spark? 3. Can I install Zeppelin on Windows server?