Save the date: ApacheCon Miami, May 15-19, 2017

Dear Apache enthusiast, ApacheCon and Apache Big Data will be held at the Intercontinental in Miami, Florida, May 16-18, 2017. Submit your talks, and register, at http://apachecon.com/ Talks aimed at the Big Data section of the event should go to

Scalding with Zeppelin 0.6.2: Job Failed, Null user

Hello all, I am using zeppelin to use spark in yarn-client mode on my company's cluster and it works great. However I am now trying to run scalding in hdfs mode on the same cluster but the jobs always fail with the following error logged: 16/12/02 10:54:27 DEBUG UserGroupInformation: hadoop

Re: 0.7.0 zeppelin.interpreters change: can't make pyspark be default Spark interperter

Thank you Jeff. Do I have to create interpreter/spark directory in $ZEPPELIN_HOME/conf or in $ZEPPELIN_HOME directory? So zeppelin.interpreters in zeppelin-site.xml is deprecated in 0.7? Thanks! -- Ruslan Dautkhanov On Tue, Nov 29, 2016 at 6:54 PM, Jeff Zhang wrote: >

Re: multi-tennant Zeppelin notebook

It bas been asked many times. For now only livy can impersonate the spark user. For other interpreters it's not possible as I know... Le 29 nov. 2016 7:44 PM, "Ruslan Dautkhanov" a écrit : > What's a best way to have a multi-tennant Zeppelin notebook? > > It seems we

Binding variable inside javascript code

Hello everyone, I'm trying to bind a variable from javascript to the spark context when I click on an object. So that I can use the variable in another Zeppelin paragraph. I have the following code in one particular paragraph: In another file I build the "data" variable used by /plot/. The

Re: 0.7.0 zeppelin.interpreters change: can't make pyspark be default Spark interperter

No, you don't need to create that directory, it should be in $ZEPPELIN_HOME/interpreter/spark Ruslan Dautkhanov 于2016年11月30日周三 下午12:12写道： > Thank you Jeff. > > Do I have to create interpreter/spark directory in $ZEPPELIN_HOME/conf > or in $ZEPPELIN_HOME directory? > So

Re: 0.7.0 zeppelin.interpreters change: can't make pyspark be default Spark interperter

The default interpreter is now defined in interpreter-setting.json You can update the following file to make pyspark as the default interpreter and then copy it to folder interpreter/spark https://github.com/apache/zeppelin/blob/master/spark/src/main/resources/interpreter-setting.json Ruslan

RE: Unable to connect with Spark Interpreter

Your last advice helped me to progress a little bit: - I started spark interpreter manually o c:\zepp\\bin\interpreter.cmd, -d, c:\zepp\interpreter\spark\, -p, 61176, -l, c:\zepp\/local-repo/2C2ZNEH5W o I needed to add a ‚\‘ into the –d attributte and make the path shorter -->

Re: Zeppelin or Jupiter

I can comment the reasons I use Zeppelin, though I haven't used Jupyter extensively. This is for a Fortune 500 company shared by many users. -Easy to write new Interpreter for organization specific requirements (e.g. authentication, query limits etc). -Already using Java and AngularJS extensively

Re: 0.7.0 zeppelin.interpreters change: can't make pyspark be default Spark interperter

Hi Ruslan, I miss another thing, You also need to delete file conf/interpreter.json which store the original setting. Otherwise the original setting is always loaded. Ruslan Dautkhanov 于2016年12月1日周四 上午1:03写道： > Got it. Thanks Jeff. > > I've downloaded > >

Re: sparkContext to get Spark Driver's URL

You can get ui by sc.uiWebUrl And community is working on to display it in paragraph. https://github.com/apache/zeppelin/pull/1663 Ruslan Dautkhanov 于2016年12月1日周四 上午8:58写道： > Any easy way to get Spark Driver's URL (i.e. from sparkContext )? > I always have to go to CM ->

sparkContext to get Spark Driver's URL

Any easy way to get Spark Driver's URL (i.e. from sparkContext )? I always have to go to CM -> YARN applications -> choose my Spark job -> click Application Master etc. to get Spark's Driver UI. Any way we could derive driver's URL programmatically from SparkContext variable? ps. Long haul - it

Re: Zeppelin or Jupiter

Guys, How Active Directory/LDAP and Kerberos are integrated with Zeppelin? thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

Re: Zeppelin or Jupiter

> -LDAP and Notebook level permissions worked great. Would you mind sharing details on this? Mohit Jaggi Founder, Data Orchard LLC www.dataorchardllc.com > On Nov 29, 2016, at 9:52 AM, Kevin Niemann wrote: > > I can comment the reasons I use Zeppelin, though I

Where is this Zeppelin JIRA Ticket?

A few weeks ago I saw a Zeppelin ticket about multi-tenancy where users were able to use their underlying OS accounts. If I am not mistaken, users were even able to use different interpreters and notebooks. The related pull request had a small demo videos. Unfortunately, I didn't bookmark the

Re: PostgreSQL JDBC Connections

YMMV and I don’t think my approach will work for your use case. Here is a suggestion based on what I’ve done. In the first paragraph you can register tables with code as such. %spark val example = sqlContext.read.format("jdbc").options( Map("url" ->

Re: PostgreSQL JDBC Connections

We are using the JDBC interpreter. The business analysts only know SQL and run ad-hoc queries for their report exports to CSV. Cheers, Ben > On Jan 5, 2017, at 2:21 PM, t p wrote: > > Are you using JDBC or the PSQL interpreter? I had encountered something > similar

Re: PostgreSQL JDBC Connections

Are you using JDBC or the PSQL interpreter? I had encountered something similar while using the PSQL interpreter and I had to restart Zeppelin. My experience using PSQL (Postgresql, HAWK) was not as good as using spark/scala wrappers (JDBC data source) to connect via JDBC and then register

Run a zeppelin notebook at a particular time of the day

Hi, I want to run a paragraph at a particular time of the day (let's say 2pm). I modified the crontab expression to " 00 14 * * * ? " But it didn't run. But i am able to run a paragraph in particular interval of time (like each 5min,1hr,1day etc.) Plz suggest. -- View this message in context:

Re: Re: contextual relevance in the previous paragraph and the latter paragraph in Zeppelin

Hi Fang. What zeppelin version are you using? I just tested the latest version of master and It works expected. 2016-12-28 0:15 GMT-08:00 Pengcheng Fang : > Hi Mohit , > > thank you for your reply, I just ran those paragraphs one by one from top > to bottom. > > thanks > >

Re: py4j doesn't work with python interpreter

You said you ran sudo pip install pyplot I think you need to pip install py4j instead? _ From: Jianfeng (Jeff) Zhang > Sent: Monday, January 2, 2017 4:24 PM Subject: Re: py4j doesn't work with python interpreter

Re: How to make one side binding between zeppelin paragraph and published paragraph?

Hi Moon, thanks a lot. It seems to me like ZEPPELIN-1594 is what I am looking for. As the dynamic forms are not displayed for users with read-only permission and users shall not get write permission, an execute-permission would make sense. If

Re: How to make one side binding between zeppelin paragraph and published paragraph?

Hi, Recently, personalized mode [1][2] is implemented in master branch. I believe this feature addresses all the case you mentioned. Regarding change dynamic form without write permission, i think we can do either a) allow 'reader' change dynamic form and run b) introduce 'execute' permission

Re: py4j doesn't work with python interpreter

I installed py4j too. py4j is in the directory /usr/lib/python2.7/site-packages/py4j Here the log from interpreter-python log: INFO [2017-01-03 13:44:29,231] ({pool-2-thread-11} SchedulerFactory.java[jobStarted]:131) - Job remoteInterpretJob_1483447469231 started by scheduler

Re: py4j doesn't work with python interpreter

hmm, that means you have multiple python installed. And the default python don't have py4j installed. Dominique Fabre 于2017年1月3日周二 下午9:01写道： > I changed the properties zeppelin.python from python interpreter from > value python to value /usr/bin/python. > > The issue

Re: py4j doesn't work with python interpreter

I changed the properties zeppelin.python from python interpreter from value python to value /usr/bin/python. The issue is resolved now. Thanks all! 2017-01-03 13:49 GMT+01:00 Dominique Fabre : > I installed py4j too. > > py4j is in the directory

Re: Read only mode

Hi Nabajyoti, 0.6.0 supports permission feature for note. If you click the lock icon in the right top corner, you can see the menu. Regards, Jongyoul On Wed, Dec 28, 2016 at 9:23 PM, Nabajyoti Dash wrote: > Hi, > I want to make my zeppeline notebook read-only so

Re: Read only mode

Thnkx Jongyoul.Got it. -- View this message in context: http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Read-only-mode-tp4794p4820.html Sent from the Apache Zeppelin Users (incubating) mailing list mailing list archive at Nabble.com.

Access Control

Hello I would like to setup security, such that anonymous users can view all = the Notebooks in read-only mode, however to create a new notebook or = amend an existing one, the user should have logged on. I have edited = shirt.ini to disable anonymous access, this disables all access. Any

Manually importing notebooks -- inconsistent behavior

One way to import notebooks is to simply copy the notebooks into the /var/lib/zeppelin/notebook folder. As noted for example here to make it work it's furthermore necessary to edit the interpreter.json file as well. So here

Re: Re: Re: contextual relevance in the previous paragraph and the latter paragraph in Zeppelin

Hi. Actually I tested with jdbc(mysql) but it would be the same with hive right? and the latest version what i mentioned is the master in the github repo. BTW could you share your interpreter setting for hive? 2016-12-28 22:37 GMT-08:00 Pengcheng Fang : > Hi Shim, > >

Re: programmatically call parameterised notebook paragraph

Use REST Api with a simple REST client http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/rest-api/rest-notebook.html#run-a-paragraph-synchronously You can inject the Angular param values as POST data to the target paragraph On Thu, Dec 29, 2016 at 5:54 PM, Tushar Kapila wrote:

Re: programmatically call parameterised notebook paragraph

Thank you DuyHai. That would work, only I want to simulate the websockets as the end aim is to test it. This would be a good integration test suite. On Thu, Dec 29, 2016 at 10:34 PM, DuyHai Doan wrote: > Use REST Api with a simple REST client > >

Re: How to make one side binding between zeppelin paragraph and published paragraph?

Some conceptual thoughts/questions about execute-permissions. What would execute-permissions mean for a whole notebook -> would the user be able to run all paragraphs and therefore issue a complete recalulation? If that is the case what will happen to the other users currently viewing the notebook

Re: How to make one side binding between zeppelin paragraph and published paragraph?

+1 , "execute" permission is required permission, https://issues.apache.org/jira/browse/ZEPPELIN-1369 tracks the requirement On Sat, Dec 31, 2016 at 12:40 AM, moon soo Lee wrote: > Hi, > > Recently, personalized mode [1][2] is implemented in master branch. > I believe this

py4j doesn't work with python interpreter

Hi all, I installed py4j with "pipe install" command: sudo pip install pyplot. When i try to use dynamic form with python intrepeter in a paragraph: %python print (z.input("f1","defaultValue")) i have this result: You must install py4j Python module (pip install py4j) to use Zeppelin dynamic

[Codebase job workflow] I need your idea and opinion.

Hello, Zeppelin our users and our developers. I am created zeppelin workflow on codebase feature. But, actually I wish find a good method than my implement workflow method better. (before pr https://github.com/apache/zeppelin/pull/1799) for example,  I made workflow is this here. ---  

Re: How to make one side binding between zeppelin paragraph and published paragraph?

Hello, for collaboration purposes the bidirectional synch makes sense - even though I would expect a published paragraph to mainly serve presentation purposes instead of collaboration purposes. In cases where Zeppelin is used for presentation purposes the recalculation of the paragraph due to

pyspark can't run through

Hello, all I recently come cross good tool - zeppelin, it is easy to use. But I have some troubles to make pyspark work in my server. The code below used to work fine, but for no reason it pop up errors like permission deny. Code %pyspark import pandas ##

REST API for updating interpreter settings

Hi I am trying to call the REST API endpoint to update an interpreter setting viz. https://zeppelin.apache.org/docs/latest/rest-api/rest-interpreter.html#update-an-interpreter-setting, but am unable to get this working. All the other Interpreter REST endpoints seem to work fine. Any ideas as to

Re: Build error on windows

Attach npm-debug.log Alexander Bezzubov 于2016年12月18日周日 下午10:34写道： Hi Jeff, looks like something failed during `grunt build`. Could you also show the content of `C:\Users\jzhang\zeppelin\zeppelin-web\npm-debug.log`? It might have some details to give a hint on the issue. --

Build error on windows

I try to build zeppelin on windows, but hit the following error. Does anyone know how to address this ? Thanks [ERROR] npm ERR! Windows_NT 6.1.7601 [ERROR] npm ERR! argv "C:\\Users\\jzhang\\zeppelin\\zeppelin-web\\node\\node.exe" "C:\\Users\\jzhang\\zeppelin\\zeppelin

Re: Re: Build error on windows

I think the following issue can help u. - JIRA : https://issues.apache.org/jira/browse/ZEPPELIN-1239 - PR : https://github.com/apache/zeppelin/pull/1731 zjp_j...@163.com From: Jeff Zhang Date: 2016-12-19 09:27 To: users; dev Subject: Re: Build error on windows Attach npm-debug.log Alexander

Adding shell interpreter to zeppelin

I am using zeppelin 0.6.1-SNAPSHOT bundled with another in-memory computing platform called insightedge . I want to import other notebooks to my zeppelin deployment which require the shell interpreter (%sh). I tried adding the shell interpreter by executing the

Re: Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class java.lang.ClassNotFoundException

I am facing the same issue even after adding both the jars to the interpreter. please suggest anything else i could be me missing. -- View this message in context:

RE: R interpreter not available

Hello, I have already tried that – it is the same situation as described formerly – „R Interpreter Not Found“. From: Jeff Zhang [mailto:zjf...@gmail.com] Sent: Friday, December 23, 2016 1:20 AM To: users@zeppelin.apache.org Subject: Re: R interpreter not available please try %spark.r Jan

contextual relevance in the previous paragraph and the latter paragraph in Zeppelin

Hi All, I have one more question regarding the contextual relevance in the previous paragraph and the latter paragraph in Zeppelin, for example : --paragraph1-- %jdbc(hive) use database_one

Re:Re: contextual relevance in the previous paragraph and the latter paragraph in Zeppelin

Hi Mohit , thank you for your reply, I just ran those paragraphs one by one from top to bottom. thanks At 2016-12-28 13:03:24, "Mohit Jaggi" wrote: it should depend on the order in which you run the paragraphs...did you run in the same order that you listed them

Read only mode

Hi, I want to make my zeppeline notebook read-only so that the end user can't modify the queries. I am using zeppelin 0.6.0. Is this feature available in that version?If yes what to do? Thanks, Nabajyoti -- View this message in context:

R interpreter not available

Hello, I have a problem with running R interpreter - Specifically, R is not visible among available interpreters. So far, I installed R language packages to my system (Ubuntu) = I am able to run R commands in shell. When I download latest version of Zeppelin from Git, try to compile it using

ClassNotFoundException with Scalding on Zeppelin managed on YARN

I'm trying to get Scalding working on Zeppelin while using YARN. I followed the steps in the docs 

Re: ClassNotFoundException with Scalding on Zeppelin managed on YARN

Hi Paul, It looks like the cascading jars are not distributed to the YARN cluster. Can you please try adding "zeppelin/interpreter/scalding/*" to the args.string property of the scalding interpreter? Here's the args.string we use: -libjars

Re: ClassNotFoundException with Scalding on Zeppelin managed on YARN

Thank you! That definitely did the trick. I was trying to use ZEPPELIN_CLASSPATH_OVERRIDES to load the jars and couldn’t figure out why it wasn’t working. Also  mode.asInstanceOf[Hdfs].conf.get("tmpjars").split(",").foreach(println) was exactly the command that I was looking for to diagnose

Re: R interpreter not available

please try %spark.r Jan Botorek 于2016年12月23日周五 上午12:33写道： > Hello, > > I have a problem with running R interpreter - Specifically, R is not > visible among available interpreters. > > So far, I installed R language packages to my system (Ubuntu) = I am able > to run R

Re: Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class java.lang.ClassNotFoundException

Hi. It seems there is typo on default.driver. default.driver value should be org.apache.hive.jdbc.HiveDriver not *c* org.apache.hive.jdbc.HiveDriver. 2016-12-19 18:24 GMT+09:00 Nabajyoti Dash : > I am facing the same issue even after adding both the jars to the >

Re: Zeppelin 0.6.2 Error - Interpreter process failed

Hi All, Can anyone help me with the above error please. On Fri, Dec 16, 2016 at 12:06 PM, VIVEK NARAYANASETTY wrote: > Hi, > > I haven't changed any interpreter settings or any changes in the > configuration files. > > On Fri, Dec 16, 2016 at 12:02 PM, Sachin Janani

Re: JDBC(Hive) class not found

> On Dec 19, 2016, at 4:13 PM, Hyung Sung Shim wrote: > > org.apache.hive.jdbc.HiveDriver Thanks.It was a typo. But after fixing it i am getting the following error. ava.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:1:

Re: Cannot use Hive Interpreter in Zeppelin 0.6.0 - Hive class java.lang.ClassNotFoundException

Please make sure that your hive server is running on localhost:1 . 2016년 12월 19일 (월) 오후 7:56, Nabajyoti Dash 님이 작성: > Thanks.It was a typo..(my nightmare). > But after fixing this I am getting the ConnectionRefused exception.I am > using Hive on mysql and has

Re: Configuring table format/type detection

On Thu, Nov 24, 2016 at 2:01 AM, Alexander Bezzubov wrote: > Hi Everett, > > this is a very good question actually. > > Right now there is not, but it sounds as a great feature, so may be worth > filing a JIRA issue. > > There was a discussion when this feature was contributed

Re: Error in building Zeppelin

npm install --save-dev grunt-wiredep bower install jquery --save --allow-root grunt wiredep The above three commands made my things done. -- View this message in context: http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Error-in-building-Zeppelin-tp4668p4701.html Sent

Cron expluatation

I have a question about using cron. I use 0.7.0-SNAPSHOT, had set diffent unterpreteters: mysql, psql, python. In python: I create a connection to PSQL, unload data and agregate them to calculate the end report. Then z.show(report). In mysql: The path is similar. I generate SQL expression with

Re: Interpreter zombie processes

Thank you everyone for confirming this issue. Created https://issues.apache.org/jira/browse/ZEPPELIN-1832 Thanks again. -- Ruslan Dautkhanov On Fri, Dec 16, 2016 at 2:48 AM, blaubaer wrote: > We are seeing this problem as well, regularly actually. Especially in >

Flink kafka connector

I’m having a problem importing the Kafka streaming library for Flink. I added org.apache.flink:flink-connector-kafka_2.11:0.10.2 to the Dependencies on the Flink interpreter. The Flink interpreter runs code, just not if I have the following import. import

Re: Vizualize bash result

FYI https://zeppelin.apache.org/docs/latest/displaysystem/basicdisplaysystem.html#table provides some basic examples how you can draw table :) Best, Ahyoung On Sun, Jan 15, 2017 at 1:20 AM, Jongyoul Lee

Re: How to let Zeppelin have map visulization function

Pluggable module list(Helium) on website list user package (3rd party) in npm registry. Each plugin can have it's own license which may/may not compatible to Apache 2 License, while zeppelin is not including them in the release. So, accepting the plugin license is up to individual user when

Re: How to let Zeppelin have map visulization function

Dear moon, Is the https://github.com/apache/zeppelin/pull/765/files the right one? On Tue, Mar 21, 2017 at 9:04 AM, mingda li wrote: > Dear moon, > Thanks for your explain. But I don't find map visualization in the > pluggable list. > What is the map visualization

Re: Pyspark failing in 0.7.0

Hi Ahyoung , Here are logs messages. * zeppelin-zeppelin-usw2dxdpgw01.local.log* INFO [2017-03-21 18:00:06,601] ({qtp1566723494-91} NotebookServer.java[broadcastNewParagraph]:640) - Broadcasting paragraph on run call instead of note. INFO [2017-03-21 18:00:06,687] ({pool-2-thread-25}

Re: Few suggestions and issues with zeppelin 0.7.0

Thanks, Can you file a jira issue for it? On Thu, Mar 23, 2017 at 9:32 PM, Meethu Mathew wrote: > Hi, > > >- Its not possible to undo edits in a paragraph once its executed. But >it was possible in 0.6.0. Is it purposefully removed or not? > > >-

Re: How to bind angular object with backend when write Helium Application

Hi Lee, Follow your instruction, I can update frontend from beckend and get AngularObject through 'HeliumAppAngularObjectRegistry'. However, I don't know how to get 'InterpreterContext' in Helium Application, which is needed to initialize an 'AngularObjectWatcher' when adding watcher. I checked

Zeppelin hangs in air-gapped environments

Hello, while starting Zeppelin in an air-gapped environment, it hangs for a few minutes (up to 10) on: WARN [2017-03-24 13:57:49,777] ({main} Helium.java[loadConf]:101) - /zeppelin-server/conf/helium.json does not exists ERROR [2017-03-24 14:01:27,909] ({main} ZeppelinServer.java[]:131) -

Separate interpreter running scope Per user or Per Note documentation

Hi, I couldnt find the documentation for the feature Separate interpreter running scope Per user or Per Note at https://zeppelin.apache.org/docs/0.7.0/manual/interpreters.html#interpreter-binding-mode . Can somebody help me in understanding the per note scoped mode and per user scoped mode?

RE: Zeppelin should support standard protocols for authN and AuthZ

The use case is to use Zeppelin and all tools/applications that belongs to the SaaS layer authenticate and authorize users via 1 AuthN and AuthZ server which is not Apache Shiro. So all the users, groups, roles, entitlements and policies are stored on the AuthN and AuthZ server and apps just

Angular FrontEnd API - Drag and Drop

Hi, Would it be possible to use angular front-end api to for example list the notebooks and display them in a zeppelin paragraph. Also, would it be possible to use drag and drop? Thanks Sofiane

Re: ActiveDirectoryGroupRealm.java allows user outside of searchBase to login

Hi All, We are also hitting this issue with version 0.7.0. We have tried changing the search base so that a filter is used, and only certain users who are a member of a group are allowed to login, however this doesn't have an effect. We have also tried to use activeDirectoryRealm.groupRolesMap,

Re: Zeppelin out of memory issue - (GC overhead limit exceeded)

You don't have to set spark.driver.memory with -X... but simply with memory size. Look at http://spark.apache.org/docs/latest/configuration.html spark.driver.memory 1g Amount of memory to use for the driver process, i.e. where SparkContext is initialized. (e.g. 1g, 2g). Note: In client

Re: Zeppelin out of memory issue - (GC overhead limit exceeded)

This is a bug of zeppelin. spark.driver.memory won't take effect. As for now it isn't passed to spark through -conf parameter. See https://issues.apache.org/jira/browse/ZEPPELIN-1263 The workaround is to specify SPARK_DRIVER_MEMORY in interpreter setting page. Best Regard, Jeff Zhang From:

Re: Setting Zeppelin to work with multiple Hadoop clusters when running Spark.

https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html You don't have to rely on single NN. You can specify a kind of "NN HA alias" and underlying HDFS client would connect to NN which is active right now. Thanks for pointing HADOOP_CONF_DIR, seems

Re: Setting Zeppelin to work with multiple Hadoop clusters when running Spark.

I know it, thanks, but it's non reliable solution. 2017-03-26 5:23 GMT+02:00 Jianfeng (Jeff) Zhang : > > You can try to specify the namenode address for hdfs file. e.g > > spark.read.csv(“hdfs://localhost:9009/file”) > > Best Regard, > Jeff Zhang > > > From: Serega

Why does zeppelin try to do during web application startup?

Hi, I'm trying run Zeppelin 0.8.0-SNAPSHOT in Docker. Startup takes forever. It starts in seconds when launched on host, not in Docker container. I suspect Docker container has poorly configured network and some part of zeppelin tries to reach remote resource. SLF4J: See

Re: Zeppelin out of memory issue - (GC overhead limit exceeded)

I verify it in master branch, it works for me. Set it in interpreter setting page as following. [cid:8CB49F76-39F5-4A53-816B-9E47F7993050] Best Regard, Jeff Zhang From: RUSHIKESH RAUT > Reply-To:

Re: Setting Zeppelin to work with multiple Hadoop clusters when running Spark.

What do you mean non-reliable ? If you want to read/write 2 hadoop cluster in one program, I am afraid this is the only way. It is impossible to specify multiple HADOOP_CONF_DIR under one jvm classpath. Only one default configuration will be used. Best Regard, Jeff Zhang From: Serega

Re: Why does zeppelin try to do during web application startup?

As a part of application Helium is downloading and installing npm & node of a version it needs during the startup. This greatly increases startup and may be one of the reasons. 2017-03-26 14:51 GMT+03:00 Serega Sheypak : > Hi, I'm trying run Zeppelin 0.8.0-SNAPSHOT in

Re: Zeppelin out of memory issue - (GC overhead limit exceeded)

Thanks Jianfeng, But i am still not able to solve the issue. I have set it to 4g but still no luck.Can you please explain it to me how can I set SPARK_DRIVER_MEMORY property. Also as I have read that GC overhead limit exceeded error occurs when the heap memory is insufficient. So How can I

Zeppelin out of memory issue - (GC overhead limit exceeded)

Hi everyone, I am trying to load some data from hive table into my notebook and then convert this dataframe into r dataframe using spark.r interpreter. This works perfectly for small amount of data. But if the data is increased then it gives me error java.lang.OutOfMemoryError: GC overhead limit

RE: Zeppelin should support standard protocols for authN and AuthZ

You dont need to remove Shiro but it would be nice if you had a way to set Zeppelin to use external Authentication & Authorization servers. Of course that requires that Zeppelin is able to interpret and enforce the policies that are stored in the central authorization server. Pluging in Apache

Occasional blank table result on paragraph execution

I have this problem as well. It is incredibly annoying. I don’t think I’m seeing it in 0.8.0 though. http://www.placeiq.com/ http://www.placeiq.com/ http://www.placeiq.com/ Paul Brenner https://twitter.com/placeiq https://twitter.com/placeiq https://twitter.com/placeiq

Occasional blank table result on paragraph execution

Hi, On some paragraph executions I am getting a blank table result (just whitespace), like 1/5 times. Starting with Zeppelin 0.7.0. The paragraph is successful and changing the visualization mode shows that there was data returned. Changing the report type or refreshing the browser will fix the

Re: How to let Zeppelin have map visulization function

Thanks, I follow the https://github.com/apache/zeppelin/pull/765/files to install map successfully on my local machine. But it can't be shown on my cluster. Do I need to npm install leaflet or something to make it work? Thanks, Mingda On Tue, Mar 21, 2017 at 2:58 PM, Neil Derraugh <

Using Zeppelin with a remote git repository

Does anyone currently use zeppelin with a remote git repository? I know there are built in features for local repositories and I see an open ticket requesting to have a UI button for pushing ( 

Does Spark need to run for Zeppelin

Hi, I recently met a strange problem. My spark is not running. But when I restart Zeppelin and run spark program on it. It can run. And even after I start spark and run zeppelin, I can't see the application of Zeppelin running in Spark. Does anyone have idea of that? Thanks, Mingda

Re: Does Spark need to run for Zeppelin

If I tell zeppelin spark's home in conf, will it start spark by self? On Wed, Mar 22, 2017 at 1:45 PM, mingda li wrote: > Hi, > > I recently met a strange problem. My spark is not running. But when I > restart Zeppelin and run spark program on it. It can run. > And even

Re: Using Zeppelin with a remote git repository

I provided zeppelin with git notebook repos to a dozen of internal users. Here is my work around of the pushing thing 1. All zeppelin servers run in docker containers. Each user has a separate contianer 2. when the container starts, it checks out code and set global git configurations, like user

Zeppelin Spark Sql Interpreter CompileException

Hello,   I’m running Zeppelin 0.7.0 with Mesos.  I tried to run the tutorial on this page https://zeppelin.apache.org/docs/0.7.0/quickstart/tutorial.html   The regular Spark code in Scala worked fine but I got a org.codehaus.commons.compiler.CompileException when running the Spark Sql code.

Re: Does Spark need to run for Zeppelin

I mean if I start spark for our cluster (16 nodes) and run zeppelin on master node with local[*] setting of Spark Interpreter. I can't see Zeppelin Application in port 8080's running applications or complete applications. Is that because I am setting local[*}? On Wed, Mar 22, 2017 at 5:30 PM,

Re: Zeppelin Spark Sql Interpreter CompileException

I suspect it is due to spark issue. Can you run it in spark shell local mode to verify that ? Chaoran Yu 于2017年3月23日周四 上午10:19写道： > Hello, > >I’m running Zeppelin 0.7.0 with Mesos. > > I tried to run the tutorial on this page >

Re: Zeppelin Spark Sql Interpreter CompileException

Tried on my local machine just now. It’s working fine. It might be a Mesos integration problem > On Mar 22, 2017, at 10:45 PM, Jeff Zhang wrote: > > > I suspect it is due to spark issue. Can you run it in spark shell local mode > to verify that ? > > > Chaoran Yu

Re: Zeppelin hangs in air-gapped environments

Should I create an Issue on JIRA for this? 2017-03-26 9:47 GMT+02:00 Eric Charles : > Running off-line (or in closed data centers) is now super-slow start since > HeliumBundleFactory connects to npms.org web site on startup. > > If dependent website are not reachable, we should

Setting Zeppelin to work with multiple Hadoop clusters when running Spark.

Hi, I have three hadoop clusters. Each cluster has it's own NN HA configured and YARN. I want to allow user to read from ant cluster and write to any cluster. Also user should be able to choose where to run is spark job. What is the right way to configure it in Zeppelin?

Re: Zeppelin Notebook API - reporting errors

Any taker? Is this an issue or expected behaviour? Thanks. On Thu, Mar 30, 2017 at 9:52 PM, Sofiane Cherchalli wrote: > Hi, > > I am running notebooks through the Notebook API by running synchronously > every paragraph of the notebook, but it seems that if something fails

Re: Zeppelin out of memory issue - (GC overhead limit exceeded)

Yes I know it inevitable if the data is large. I want to know how do I increase the interpreter memory to handle large data? Thanks, Rushikesh Raut On Mar 26, 2017 8:56 AM, "Jianfeng (Jeff) Zhang" wrote: > > How large is your data ? This problem is inevitable if your

<    7   8   9   10   11   12   13   14   15   16   >