auto start and stop interpreter

2016-05-19 Thread 李铖
Hi,everybody. I have two question. - How to set an config value to make interpreter autostart or autostop. - How to autoexecute pre row pyspark code. Thanks

Re: cassandra interpreter

2016-05-10 Thread Kyle Burke
6 at 10:40 AM To: "users@zeppelin.incubator.apache.org<mailto:users@zeppelin.incubator.apache.org>" Subject: Re: cassandra interpreter I suggest removing cassandra-driver-core-2.1.7.1.jar.old the from the folder and retry On Mon, May 9, 2016 at 10:37 PM, Kyle Burke mailto:kyle.bu...@i

Re: cassandra interpreter

2016-05-10 Thread DuyHai Doan
I suggest removing cassandra-driver-core-2.1.7.1.jar.old the from the folder and retry On Mon, May 9, 2016 at 10:37 PM, Kyle Burke wrote: > Below is my cassandra interpreter folder. Let me know if something is > missing. I added the *cassandra-driver-core-3.0.0-rc1.jar ma

Re: cassandra interpreter

2016-05-09 Thread Kyle Burke
Below is my cassandra interpreter folder. Let me know if something is missing. I added the cassandra-driver-core-3.0.0-rc1.jar manually. kyle.burke@vsand-dsmodeling-002:~/zeppelin/zeppelin-0.5.6-incubating-bin-all$ ls interpreter/cassandra/ cassandra-driver-core-2.1.7.1.jar.old netty-buffer

Re: cassandra interpreter

2016-05-09 Thread DuyHai Doan
You can build the latest version from master but it should also work with release version 0.5.6, just verify the jar files in interpreter/cassandra folder On Mon, May 9, 2016 at 8:56 PM, Kyle Burke wrote: > DuyHai, > It looks like you’re using 0.6.0 version and I’m using 0.5.6.

Re: cassandra interpreter

2016-05-09 Thread Kyle Burke
: 404.961.3918 From: DuyHai Doan Reply-To: "users@zeppelin.incubator.apache.org<mailto:users@zeppelin.incubator.apache.org>" Date: Monday, May 9, 2016 at 2:13 PM To: "users@zeppelin.incubator.apache.org<mailto:users@zeppelin.incubator.apache.org>" Subject: Re: cassandra

Re: cassandra interpreter

2016-05-09 Thread DuyHai Doan
1. You don't have to add the driver jar to interpreter/cassandra folder, it should be there already. Here is my interpreter/cassandra folder content: cassandra-driver-core-3.0.0-rc1.jar commons-lang3-3.3.2.jar guava-16.0.1.jar lz4-1.3.0.jar metrics-core-3.1.2.jar netty-buffer-4

Re: cassandra interpreter

2016-05-09 Thread Kyle Burke
Hey DuyHai, I’m still not able to use the cassandra interpreter. I’ve perform that following setup tasks. I’m not sure if I missing something. Any suggestions on how to correct? 1. I added the 3.0.0-rc1 cassandra driver to the interpreter/cassandra folder. 2. On the interpreter page

Re: cassandra interpreter

2016-05-08 Thread DuyHai Doan
The Cassandra interpreter supports all Cassandra 3.x branch, it is using the driver version 3.0.0-rc1 I will update the interpreter soon to upgrade driver version to 3.0.0 On Sun, May 8, 2016 at 5:38 AM, Kyle Burke wrote: > Hi DuyHai, >Does the Cassandra interpreter support Cassand

Re: cassandra interpreter

2016-05-07 Thread Kyle Burke
Hi DuyHai, Does the Cassandra interpreter support Cassandra 3.5? The system table error I’m getting leads me to believe it’s not. Respectfully, Kyle Burke | Data Science Engineer IgnitionOne - Marketing Technology. Simplified. Office: 1545 Peachtree St NE, Suite 500 | Atlanta, GA | 30309

Re: cassandra interpreter

2016-05-06 Thread DuyHai Doan
Hello No you're mistaking, the Cassandra interpreter is only using the binary protocol to communicate with Cassandra (port 9042 by default). In the logs, what you see is the Thrift protocol used by Zeppelin to communicate between the Zeppelin server and the interpreter JVM process. By th

cassandra interpreter

2016-05-05 Thread Kyle Burke
All, I’m having connection issues trying to get zeppelin to connect to our Cassandra cluster. Below is the error I’m getting. I’m assuming from the error that Zeppelin uses the thrift api to connect to Cassandra. My thrift port 9160 is open (based on netstat) so I can't seem to figure out why

Re: Unable to use Hive Interpreter

2016-05-02 Thread Jongyoul Lee
If you cannot public maven repos, you'd better copy that jar into your interpreter/hive/. It would work. I'll also find a better way. Hope this help, J On Fri, Apr 29, 2016 at 2:56 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) wrote: > I copied mysql-connector into lib directory. > > Same error &g

Re: Unable to use Hive Interpreter

2016-04-28 Thread ๏̯͡๏
ill Zeppelin pull the dependency ? > > On Thu, Apr 28, 2016 at 6:02 PM Jongyoul Lee wrote: > >> Hi, >> >> You should use set the mysql dependency like >> 'mysql:mysql-connector-java:5.1.38'. Please check >> http://zeppelin.incubator.apache.org/

Re: Unable to use Hive Interpreter

2016-04-28 Thread ๏̯͡๏
org/docs/0.6.0-incubating-SNAPSHOT/interpreter/jdbc.html > > > Hope this help, > Jongyoul > > On Fri, Apr 29, 2016 at 8:49 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) > wrote: > >> I am able to run hive command from command prompt and able to connect to >> my production cluster. Now i want

Re: Unable to use Hive Interpreter

2016-04-28 Thread Jongyoul Lee
Hi, You should use set the mysql dependency like 'mysql:mysql-connector-java:5.1.38'. Please check http://zeppelin.incubator.apache.org/docs/0.6.0-incubating-SNAPSHOT/interpreter/jdbc.html Hope this help, Jongyoul On Fri, Apr 29, 2016 at 8:49 AM, ÐΞ€ρ@Ҝ (๏̯͡๏) wrote: > I am abl

Unable to use Hive Interpreter

2016-04-28 Thread ๏̯͡๏
I am able to run hive command from command prompt and able to connect to my production cluster. Now i want to try Hive interpreter Settings: I mapped the values to below settings from hive-site.xml common.max_count 1000 default.driver com.mysql.jdbc.Driver default.password *default.url

RE: Bugs in Interpreter result display for table when result's length is a little bigger

2016-04-19 Thread Dafeng Wang
Typo, sorry, fix it as below è Have the number of databases greater than 9, not name. Regards, Dafeng From: Dafeng Wang Sent: Wednesday, April 20, 2016 1:02 AM To: users@zeppelin.incubator.apache.org Subject: RE: Bugs in Interpreter result display for table when result's length is a l

RE: Bugs in Interpreter result display for table when result's length is a little bigger

2016-04-19 Thread Dafeng Wang
To: users@zeppelin.incubator.apache.org Subject: Re: Bugs in Interpreter result display for table when result's length is a little bigger Hi Dafeng, Can you provide a small query example? Normally the Table has a scrollbar. On Wed, Apr 20, 2016 at 12:17 PM, Dafeng Wang mailto

Re: Bugs in Interpreter result display for table when result's length is a little bigger

2016-04-19 Thread Corneau Damien
Hi Dafeng, Can you provide a small query example? Normally the Table has a scrollbar. On Wed, Apr 20, 2016 at 12:17 PM, Dafeng Wang wrote: > Hi All, > > > > Today I found out a bug when review Zeppelin’s code: when table’s result > is bigger, sometimes the result can’t show them all. Let’s see

Bugs in Interpreter result display for table when result's length is a little bigger

2016-04-19 Thread Dafeng Wang
Hi All, Today I found out a bug when review Zeppelin's code: when table's result is bigger, sometimes the result can't show them all. Let's see code here Paragraph.controller.js, line 1116 1. We first set graph.height as _graph.height 2. Then in SetTable we set table's height is par

Re: Elastic Search Interpreter limitation?

2016-04-19 Thread ashish rawat
ight also be related to the > interpreter. > > When using the "fields" attribute in the query to select the exact fields > to return, I get an "Error: String is null" through Zeppelin, while the > same query works through the REST interface. > > I noticed

Re: Elastic Search Interpreter limitation?

2016-04-19 Thread ashish rawat
Hi Bruno, I am encountering another issue, which might also be related to the interpreter. When using the "fields" attribute in the query to select the exact fields to return, I get an "Error: String is null" through Zeppelin, while the same query works through the REST i

Re: Elastic Search Interpreter limitation?

2016-04-19 Thread ashish rawat
tions with the Elasticsearch > interpreter. > I have developed it and I'am going to check how I can change the component > to take into account this kind of more complex request. > > Regards, > Bruno > > 2016-04-19 18:53 GMT+02:00 ashish rawat : > >> Hi, >>

Re: Elastic Search Interpreter limitation?

2016-04-19 Thread Bruno Bonnin
Hello, You are right, there are some limitations with the Elasticsearch interpreter. I have developed it and I'am going to check how I can change the component to take into account this kind of more complex request. Regards, Bruno 2016-04-19 18:53 GMT+02:00 ashish rawat : > Hi, > &g

Elastic Search Interpreter limitation?

2016-04-19 Thread ashish rawat
00, "doc_count": 8 }, { "key_as_string": "2016-04-02", "key": 145955520, "doc_count": 0 }, { "key_as_string": "2016-04-03", "key": 145964160, "doc_count": 0 }, { "key_as_string": "2016-04-04", "key": 145972800, "doc_count": 48 } ] } }, "trace": { "doc_count": 372, "messages_over_time": { "buckets": [ { "key_as_string": "2016-04-04", "key": 145972800, "doc_count": 372 } ] } } } } as expected, it has the timeseries of the 'error' and 'trace' messages. Is there any limitation in elastic search interpreter which does not allow parsing of complex responses? Regards, Ashish

Re: Line feed ( \r ) behind %pyspark command causes interpreter not found

2016-04-15 Thread moon soo Lee
l-request in Java; I'll see if I can figure it > out. > > > > *From:* Joel Van Veluwen [mailto:joel.vanvelu...@quantium.com.au] > *Sent:* lundi 11 avril 2016 09:36 > *To:* users@zeppelin.incubator.apache.org; us...@zeppelin.apache.org > *Subject:* RE: Line feed ( \r ) behind %p

Re: Interpreter Alias

2016-04-12 Thread John Omernik
ongyoul >> >> On Tue, Apr 12, 2016 at 3:26 AM, John Omernik wrote: >> >>> So I copied the %jdbc interpreter. I am looking to create a specific >>> connection to Apache Drill, and would like to use the jdbc interpreter, but >>> invoke it by calling %dri

RE: Line feed ( \r ) behind %pyspark command causes interpreter not found

2016-04-12 Thread TITTMANN, Lucas (Allianz en France)
uwen [mailto:joel.vanvelu...@quantium.com.au] Sent: lundi 11 avril 2016 09:36 To: users@zeppelin.incubator.apache.org; us...@zeppelin.apache.org Subject: RE: Line feed ( \r ) behind %pyspark command causes interpreter not found I've raised this issue here. I don't have

Re: Interpreter Alias

2016-04-11 Thread moon soo Lee
> Zeppelin doesn't support that feature for now. > > Regards, > Jongyoul > > On Tue, Apr 12, 2016 at 3:26 AM, John Omernik wrote: > >> So I copied the %jdbc interpreter. I am looking to create a specific >> connection to Apache Drill, and would like to use

Re: Interpreter Alias

2016-04-11 Thread Jongyoul Lee
Hi John, Zeppelin doesn't support that feature for now. Regards, Jongyoul On Tue, Apr 12, 2016 at 3:26 AM, John Omernik wrote: > So I copied the %jdbc interpreter. I am looking to create a specific > connection to Apache Drill, and would like to use the jdbc interpreter, but >

Interpreter Alias

2016-04-11 Thread John Omernik
So I copied the %jdbc interpreter. I am looking to create a specific connection to Apache Drill, and would like to use the jdbc interpreter, but invoke it by calling %drill rather than %jdbc, is this possible? I tried create interpreter and did a new name "drill" with interpreter type j

RE: Line feed ( \r ) behind %pyspark command causes interpreter not found

2016-04-11 Thread Joel Van Veluwen
il reply, phone (+ 61 2 9292 6400) or fax (+ 61 2 9292 6444) and delete the message from your system. From: TITTMANN, Lucas (Allianz en France) [mailto:lucas.titt...@allianz.fr] Sent: Monday, 11 April 2016 5:34 PM To: us...@zeppelin.apache.org Subject: Line feed ( \r ) behind %pyspark command ca

Line feed ( \r ) behind %pyspark command causes interpreter not found

2016-04-11 Thread TITTMANN, Lucas (Allianz en France)
or message, sometimes with "pyspark interpreter not found". Is this a known issue ? Would it be possible to accept "%pyspark\r\n" as PySpark interpreter? Setup: Zeppelin ( 025acd3641cab7c3f848a98f91f8b3f1d31cfcf7 ) using %pyspark and JetBrains PyCharm 5 Community Edition on Window

Re: Storing Interpreter Passwords

2016-04-08 Thread John Omernik
ohn Omernik > Reply-To: "users@zeppelin.incubator.apache.org" > Date: Friday, April 8, 2016 at 7:23 AM > To: "users@zeppelin.incubator.apache.org" > Subject: Re: Storing Interpreter Passwords > > As a follow up on a computer rather than iPad :) > > One thing I want to b

Re: Storing Interpreter Passwords

2016-04-08 Thread MUEDSAM, JOHAN
ot; Date: Friday, April 8, 2016 at 7:23 AM To: "users@zeppelin.incubator.apache.org<mailto:users@zeppelin.incubator.apache.org>" Subject: Re: Storing Interpreter Passwords As a follow up on a computer rather than iPad :) One thing I want to be clean on, Zeppelin would NOT store this

Re: R Interpreter

2016-04-08 Thread Jeff Steinmetz
://zeppelin.incubator.apache.org/docs/0.6.0-incubating-SNAPSHOT/install/virtual_machine.html Best Jeff On 4/8/16, 4:23 AM, "Ankur Jain" wrote: >Hello Team, > >To use R interpreter do we need to install R , evaluate and other R packages >manually? >Or adding -Pr takes care of

Re: Storing Interpreter Passwords

2016-04-08 Thread John Omernik
_CONF/${USER}_interpreter.json. If User Auth is NOT setup, then there is only one, perhaps interpreter.json which can also be used as a template for any interpreter settings that ARE shared. 3. In the Zeppelin config file, a "master key" is stored. This is optional, if users don&

Re: R Interpreter

2016-04-08 Thread Minudika Malshan
t; > [1] > http://www.r-bloggers.com/interactive-data-science-with-r-in-apache-zeppelin-notebook/ > > BR > > On Fri, Apr 8, 2016 at 4:53 PM, Ankur Jain wrote: > >> Hello Team, >> >> To use R interpreter do we need to install R , evaluate and other R >> p

R Interpreter

2016-04-08 Thread Ankur Jain
Hello Team, To use R interpreter do we need to install R , evaluate and other R packages manually? Or adding -Pr takes care of that? Regards, Ankur Information transmitted by this e-mail is proprietary to YASH Technologies and/ or its Customers and is intended for use only by the individual or

Re: Storing Interpreter Passwords

2016-04-07 Thread John Omernik
their own interpreter settings. On Thursday, April 7, 2016, moon soo Lee wrote: > Hi, > > Thanks for starting this discussion and sharing your idea. > > > I open Zeppelin, then I get a a little lock icon showing me that my >> passwords (and thus passwords in JDBC or other stora

Re: Display in JDBC Interpreter

2016-04-07 Thread moon soo Lee
e displayed it >>> the field is an int? Are they adding anything? >>> >>> >>> On Wednesday, April 6, 2016, John Omernik wrote: >>> >>>> Note this is also the case in the spark sql interpreter. >>>> >>>> Thanks! >

Re: Storing Interpreter Passwords

2016-04-07 Thread moon soo Lee
2016 at 9:21 AM John Omernik wrote: > Any thoughts on this? Since almost every interpreter could have a > password, the interpreter.json file is a huge security target. If we > stored the passwords in the interpreter.json file, then in the notebook > interface had an option to provide

Re: Storing Interpreter Passwords

2016-04-07 Thread John Omernik
Any thoughts on this? Since almost every interpreter could have a password, the interpreter.json file is a huge security target. If we stored the passwords in the interpreter.json file, then in the notebook interface had an option to provide the "unlock" password, and before running

Re: Display in JDBC Interpreter

2016-04-07 Thread John Omernik
o commas even need to be displayed it >> the field is an int? Are they adding anything? >> >> >> On Wednesday, April 6, 2016, John Omernik wrote: >> >>> Note this is also the case in the spark sql interpreter. >>> >>> Thanks! >>

Re: [R-Interpreter] - ZeppelinServer can not be instantiated due to InvocationTargetException

2016-04-07 Thread David.Macia
Fine, the server starts ok if I put the interpreter jar inside the interpreter/spark folder. 2016-04-07 13:23 GMT+02:00 David.Macia : > > Hi, > > I'm trying to test the new r-interpreters for Zeppelin, using the last > commited version of the master branch (5ad02a2) and the s

[R-Interpreter] - ZeppelinServer can not be instantiated due to InvocationTargetException

2016-04-07 Thread David.Macia
nce in the zeppelin-site.xml ( *org.apache.zeppelin.rinterpreter.RRepl,org.apache.zeppelin.rinterpreter.KnitR* ). The version of the interpreter jar is the shaded one, with the jsoup and the commons-code libs included. Any clue about what can be the problem would be very appreciated. Thanks

Cannot use cassandra interpreter with 0.56

2016-04-07 Thread George Sigletos
Could not initialize class com.datastax.driver.core.ProtocolVersion Am I doing anything wrong? Here is the error stack. Anybody with similar problems? Thank you in advance INFO [2016-04-07 13:01:31,472] ({pool-2-thread-2} CassandraInterpreter.java[open]:268) - Bootstrapping Cassandra Java Driver

Re: Display in JDBC Interpreter

2016-04-06 Thread Corneau Damien
ed to be displayed it > the field is an int? Are they adding anything? > > > On Wednesday, April 6, 2016, John Omernik wrote: > >> Note this is also the case in the spark sql interpreter. >> >> Thanks! >> >> On Wed, Apr 6, 2016 at 4:10 PM, John Omernik

Re: Display in JDBC Interpreter

2016-04-06 Thread Christopher Matta
Yea this has always bothered me. Do commas even need to be displayed it the field is an int? Are they adding anything? On Wednesday, April 6, 2016, John Omernik wrote: > Note this is also the case in the spark sql interpreter. > > Thanks! > > On Wed, Apr 6, 2016 at 4:10 P

Re: Display in JDBC Interpreter

2016-04-06 Thread John Omernik
Note this is also the case in the spark sql interpreter. Thanks! On Wed, Apr 6, 2016 at 4:10 PM, John Omernik wrote: > Are there display settings in the jdbc interpreter. Something in how data > is being returned from Apache Drill is making some assumptions about > formatting that is

Display in JDBC Interpreter

2016-04-06 Thread John Omernik
Are there display settings in the jdbc interpreter. Something in how data is being returned from Apache Drill is making some assumptions about formatting that is bothering me, for example, a zip code field is being read (I assume) as an int, and commas are being added in the display. The commas

Storing Interpreter Passwords

2016-04-06 Thread John Omernik
Is there any good guidance for storing interpreter passwords? While I know it likely has to be in the interpreter.json files as plain text, is there something more we could do? Perhaps store encrypted to a master password that the user, once they are in Zeppelin can. (I.e, I open Zeppelin, then

Re: Writing New Interpreter

2016-04-02 Thread John Omernik
Hmm interesting, after reading your email, I played around with settings, and did this mvn package -Dfile=zeppelin-interpreter-0.6.0-incubating-SNAPSHOT.jar This allowed me to rebuild (over and over again) without building all of Zeppelin. Thanks for the tip! John On Sat, Apr 2, 2016 at 6

Re: Writing New Interpreter

2016-04-02 Thread Felix Cheung
I think you would need to build all of Zeppelin not just your interpreter. For instance you should run mvn clean package from the directory that had Zeppelin-server, Zeppelin-interpreter and so on. On Sat, Apr 2, 2016 at 1:28 PM -0700, "John Omernik" wrote: Hey all, I

Writing New Interpreter

2016-04-02 Thread John Omernik
Hey all, I am a very novice java programmer, and I was hoping to try to write a basic "example" interpreter to demonstrate a concept to the community. *Ideas from Strata! That said, I copied the Markdown interpreter, into a new directory, changed all the code to reflect my "in

Re: How to configure the hive interpreter to use the embedded hive?

2016-03-30 Thread Jongyoul Lee
Hi Joshua, Zeppelin doesn't have any hive embedded. HiveInterpreter in Zeppelin is a connector for external Hive, thus you should use your own hiveserver2 address and set it into default.url in the interpreter setting. Hope this help J On Wed, Mar 30, 2016 at 12:47 AM, Joshua W Hui

Re: How to configure the hive interpreter to use the embedded hive?

2016-03-29 Thread Joshua W Hui
Hi Jongyoul, Thanks for the reply. What url should I set in Hiveserver2 to point to the hive embedded inside the zeppelin? Regards, Joshua From: Jongyoul Lee To: users@zeppelin.incubator.apache.org Date: 03/28/2016 04:35 PM Subject:Re: How to configure the hive interpreter

Re: How to configure the hive interpreter to use the embedded hive?

2016-03-28 Thread Jongyoul Lee
Hi Joshua, There are two interpreter to use Hive. If you'd like to use it from SparkSql, just copy your hive-site.xml in you conf directory. Otherwise, you can set the Hiveserver2 url in your interpreter settings. Hope this help. J On Tue, Mar 29, 2016 at 6:44 AM, Joshua W Hui wrote:

How to configure the hive interpreter to use the embedded hive?

2016-03-28 Thread Joshua W Hui
Hi, Just wonder how I can configure the hive interpreter to use the embedded hive which is part of the default zeppelin install image (0.5.5) Thanks, Joshua

Re: Python interpreter without spark?

2016-03-26 Thread Darren Govoni
interpreter without spark? Hi, There is an open issue for python interpreter. https://issues.apache.org/jira/browse/ZEPPELIN-502I think it'll really help python users. Big +1 for this issue. Thanks,moon On Sat, Mar 26, 2016 at 7:36 AM Darren Govoni wrote: Hi Is there a standalone p

Re: Python interpreter without spark?

2016-03-26 Thread moon soo Lee
Hi, There is an open issue for python interpreter. https://issues.apache.org/jira/browse/ZEPPELIN-502 I think it'll really help python users. Big +1 for this issue. Thanks, moon On Sat, Mar 26, 2016 at 7:36 AM Darren Govoni wrote: > Hi > > Is there a standalone python inter

Python interpreter without spark?

2016-03-26 Thread Darren Govoni
Hi Is there a standalone python interpreter without spark? Or maybe an Ipython interpreter? Looking to run python notes without a big backend. Thanks Sent from my Verizon Wireless 4G LTE smartphone

Re: HBase Interpreter

2016-03-19 Thread Felix Cheung
min Kim mailto:bbuil...@gmail.com>> > Sent: Tuesday, February 23, 2016 6:19 PM > Subject: Re: HBase Interpreter > To: <mailto:users@zeppelin.incubator.apache.org>> > > > Hi Felix, > > Any updates? Does the latest merged master have the hbase quorum

Re: HBase Interpreter

2016-03-15 Thread Benjamin Kim
ave some time > next week. > > > _ > From: Benjamin Kim mailto:bbuil...@gmail.com>> > Sent: Tuesday, February 23, 2016 6:19 PM > Subject: Re: HBase Interpreter > To: <mailto:users@zeppelin.incubator.apache.org>> > > > Hi Felix, >

Re: Interpreter dependency not loading?

2016-03-09 Thread Chris Miller
Yeah, that isn't very clear. I'll improve it. -- Chris Miller On Wed, Mar 9, 2016 at 5:12 PM, mina lee wrote: > Glad to hear that it works! > Actually, there is document > https://zeppelin.incubator.apache.org/docs/0.5.5-incubating/interpreter/spark.html > in > depe

Re: Interpreter dependency not loading?

2016-03-09 Thread mina lee
Glad to hear that it works! Actually, there is document https://zeppelin.incubator.apache.org/docs/0.5.5-incubating/interpreter/spark.html in dependency management section, but obviously it seems hard to find for new users. So feel free to improve it. On Wed, Mar 9, 2016 at 6:05 PM Chris Miller

Re: Interpreter dependency not loading?

2016-03-09 Thread Chris Miller
ng below line.(I assume that you set SPARK_HOME in > ZEPPELIN_HOME/conf/zeppelin-env.sh) > > spark.jars.packages org.apache.avro:avro:1.8.0,org. > joda:joda-convert:1.8.1 > > The reason you can import avro dependency is that spark assembly already > includes avro dependencies, n

Re: Interpreter dependency not loading?

2016-03-08 Thread vincent gromakowski
ZEPPELIN_HOME/conf/zeppelin-env.sh) > > spark.jars.packages org.apache.avro:avro:1.8.0,org. > joda:joda-convert:1.8.1 > > The reason you can import avro dependency is that spark assembly already > includes avro dependencies, not because you added it in Zeppelin > interpreter setting. >

Re: Interpreter dependency not loading?

2016-03-08 Thread mina lee
ZEPPELIN_HOME/conf/zeppelin-env.sh) spark.jars.packages org.apache.avro:avro:1.8.0,org.joda:joda-convert:1.8.1 The reason you can import avro dependency is that spark assembly already includes avro dependencies, not because you added it in Zeppelin interpreter setting. You can add dependencies via

Interpreter dependency not loading?

2016-03-08 Thread Chris Miller
Hi, I have a strange situation going on. I'm running Zeppelin 0.5.5 and Spark 1.6.0 (on Amazon EMR). I added this property to the interpreter settings (and restarted it): spark.jars.packages: org.apache.avro:avro:1.8.0,org.joda:joda-convert:1.8.1 The avro dependency loads fine and I'

Zeppelin Spark Interpreter ignore settings in spark-default.conf

2016-03-04 Thread Weipu Zhao
Interpreter setting in a running Zeppelin and restart the Spark Interpreter, it will also restart the Spark context with the default setting in interpreter.json rather than spark-default.conf. What should be a proper configuration setting to using zeppelin and external Spark, so that the zeppelin can

RE: Spark interpreter idle timeout

2016-03-04 Thread Silvio Fiorito
12:55 PM To: Silvio Fiorito<mailto:silvio.fior...@granturing.com>; users@zeppelin.incubator.apache.org<mailto:users@zeppelin.incubator.apache.org> Subject: Re: Spark interpreter idle timeout Thank you Silvio. I have not actually tried dynamic allocation (it's not trivial to u

Re: Spark interpreter idle timeout

2016-03-04 Thread Dylan Meissner
fers" (not resources). This is why I am considering closing/restarting the Spark interpreter rather than using dynamic allocation or fine-grained mode to keep resource usage at a minimum. For example, looking through the current API documents, it seems possible for a "watchdog"

Re: Spark interpreter idle timeout

2016-03-04 Thread Silvio Fiorito
ncubator.apache.org>" mailto:users@zeppelin.incubator.apache.org>> Subject: Spark interpreter idle timeout Greetings, We run multiple Zeppelin's per user in a Mesos cluster. The Mesos Marathon framework hosts the Zeppelin servers, and running a note causes a Spark framework to start a Sp

Spark interpreter idle timeout

2016-03-04 Thread Dylan Meissner
books are left unattended, we'd like the Spark interpreter to shut down. This will free resources that can go to other Mesos frameworks. Is there a way to set an "idle timeout" today, and if not, how do you imagine it could be accomplished in either Zeppelin, or Spark? Th

Re: sharing angular variable to scala interpreter in zepelin

2016-02-29 Thread Balachandar R.A.
Thanks.. It helped Regards Bala On 24-Feb-2016 10:19 pm, "moon soo Lee" wrote: > Hi, > > Once an AngularObject is created, updated value from front-end side > (angular interpreter) automatically propagated to the back-end side. So > SparkInterpreter can read it using

Re: Upgrade Tachyon interpreter to Alluxio interpreter

2016-02-25 Thread Mauro Cortellazzi
Ok, thank you for your answer, I'll prepare a PR soon. Thank you. Bests. Mauro On 25/02/2016 06:52, moon soo Lee wrote: Hi Mauro, Sure, upgrading would be necessary. Thanks, moon On Tue, Feb 23, 2016 at 7:07 AM Mauro Cortellazzi > wrote: Hi All,

Re: Upgrade Tachyon interpreter to Alluxio interpreter

2016-02-24 Thread moon soo Lee
Hi Mauro, Sure, upgrading would be necessary. Thanks, moon On Tue, Feb 23, 2016 at 7:07 AM Mauro Cortellazzi < mauro.cortella...@radicalbit.io> wrote: > Hi All, I have saw today that the Tachyon project is become Alluxio > project (with a new and improved version of them software). > Do you thi

Re: sharing angular variable to scala interpreter in zepelin

2016-02-24 Thread DuyHai Doan
-zeppelin/pull/744 https://github.com/apache/incubator-zeppelin/pull/745 On Wed, Feb 24, 2016 at 5:49 PM, moon soo Lee wrote: > Hi, > > Once an AngularObject is created, updated value from front-end side > (angular interpreter) automatically propagated to the back-end side. So > S

Re: sharing angular variable to scala interpreter in zepelin

2016-02-24 Thread moon soo Lee
Hi, Once an AngularObject is created, updated value from front-end side (angular interpreter) automatically propagated to the back-end side. So SparkInterpreter can read it using z.angular(). However, creation of new AngularObject is possible only from the backend side at the moment. So, you&#x

sharing angular variable to scala interpreter in zepelin

2016-02-23 Thread Balachandar R.A.
Hi In one of my usecases, i need to pass a variable defined inside angular interpreter to another paragraph which is a scala interpreter. I could do other way around using z.angularBind() but could not figure out how to pass a variable from angular to scala. Any clue will be helpful here regards

Re: HBase Interpreter

2016-02-23 Thread Felix Cheung
HBase Interpreter To: Hi Felix, Any updates? Does the latest merged master have the hbase quorum properties? Thanks, Ben On Feb 12, 2016, at 1:29 AM, Felix Cheung < felixcheun...@hotmail.co

Re: HBase Interpreter

2016-02-23 Thread Benjamin Kim
...@hotmail.com>> wrote: > It looks like hbase-site.xml is not picked up somehow. > > Rajat would you know of a way to get that set with the ruby code? > > > _ > From: Benjamin Kim mailto:bbuil...@gmail.com>> > Sent: Tuesday, Feb

Upgrade Tachyon interpreter to Alluxio interpreter

2016-02-23 Thread Mauro Cortellazzi
Hi All, I have saw today that the Tachyon project is become Alluxio project (with a new and improved version of them software). Do you think could be interesting the update of the interpreter's code? Thank you. Bests. Mauro

Re: Can't get Pyspark(1.4.1) interpreter to work on Zeppelin(0.6)

2016-02-22 Thread mina lee
Thank you for verifying. Glad to help :) On Tue, Feb 23, 2016 at 3:51 AM Ian Maloney wrote: > Hi Mina, > > I added your changes and they got the pyspark interpreter working! Thanks > so much for your help! > > Ian > > > On Sunday, February 21, 2016, mina lee wrote:

Re: Can't get Pyspark(1.4.1) interpreter to work on Zeppelin(0.6)

2016-02-22 Thread Ian Maloney
Hi Mina, I added your changes and they got the pyspark interpreter working! Thanks so much for your help! Ian On Sunday, February 21, 2016, mina lee wrote: > Hi Ian, sorry for late reply. > I was able to reproduce the same error with spark 1.4.1 & hadoop > 2.6.0. Turned out it

Re: Can't get Pyspark(1.4.1) interpreter to work on Zeppelin(0.6)

2016-02-21 Thread mina lee
sPython config in the spark UI, showed it to be > "true". > > The pyspark interpreter gives the same error as before. Are there any > other configs I should check? I'm beginning to wonder if it's related to > something in Hortonworks' distribution of spar

Re: R Interpreter

2016-02-20 Thread btiernay
What will be the fate of the datalayer PR? I think this is causing some confusion. -- View this message in context: http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/R-Interpreter-tp2187p2371.html Sent from the Apache Zeppelin Users (incubating) mailing list mailing

Re: Impala interpreter planned?

2016-02-20 Thread Jongyoul Lee
We have a plan to merge Hive Interpreter into JDBC one because these interpreters have same implementation and also same function. Thus, if it works on %hive, you can use %jdbc with same setting. On Sat, Feb 20, 2016 at 2:26 PM, moon soo Lee wrote: > Thanks for sharing that it works for imp

Re: interpreter

2016-02-20 Thread Aleksandr Modestov
need two things to setup Zeppelin with your own spark > cluster. First, export SPARK_HOME in conf/zeppelin-env.sh. Second configure > 'master' property in 'Interpreter' menu on GUI. > That's all. You can check > http://zeppelin.incubator.apache.org/docs/latest/i

Re: Impala interpreter planned?

2016-02-19 Thread moon soo Lee
Thanks for sharing that it works for impala. Best, moon On Fri, Feb 19, 2016 at 6:58 PM Abhi Basu <9000r...@gmail.com> wrote: > Folks, this setting seems to work, I can see the impala queries being > generated. It would be nice to be able to rename this interpreter to Impala > an

Re: Impala interpreter planned?

2016-02-19 Thread Abhi Basu
Folks, this setting seems to work, I can see the impala queries being generated. It would be nice to be able to rename this interpreter to Impala and keep the hive default one. [image: Inline image 1] On Fri, Feb 19, 2016 at 6:38 PM, Abhi Basu <9000r...@gmail.com> wrote: > Also wonderi

Re: Impala interpreter planned?

2016-02-19 Thread Abhi Basu
Also wondering, since hive server2 is already being used for hive interpreter, should'nt it be easier to configure impala? Thanks, Abhi On Fri, Feb 19, 2016 at 6:29 PM, Abhi Basu <9000r...@gmail.com> wrote: > Thanks for the info. What jar do I use for impala? Thrift jar? > &

Re: Impala interpreter planned?

2016-02-19 Thread Abhi Basu
github.com/apache/incubator-zeppelin/blob/master/docs/interpreter/jdbc.md > > On Fri, Feb 19, 2016 at 6:39 AM, Abhi Basu <9000r...@gmail.com> wrote: > >> Hi All: >> >> Just curious if an Impala interpreter is planned? Should be very close to >> the hive one (hiv

Re: interpreter

2016-02-19 Thread moon soo Lee
Hi, Could you try add some python code after %pyspark? e.g) %pyspark print("hello pyspark") You basically need two things to setup Zeppelin with your own spark cluster. First, export SPARK_HOME in conf/zeppelin-env.sh. Second configure 'master' property in 'Interpreter

interpreter

2016-02-19 Thread Aleksandr Modestov
Hi all, I'm a new user. I want to use %pyspark and %spark interpreter 1) I can not use pyspark interpreter (picture in the attach) "Without any configuration, Spark interpreter works out of box in local mode. " In my case it doesn't :) Only spark interpreter works. 2

Re: Impala interpreter planned?

2016-02-18 Thread Jongyoul Lee
Hi Abhi, If it uses a JDBC, you can already connect impala by JDBCinterpreter[1]. Regards, Jongyoul [1] https://github.com/apache/incubator-zeppelin/blob/master/docs/interpreter/jdbc.md On Fri, Feb 19, 2016 at 6:39 AM, Abhi Basu <9000r...@gmail.com> wrote: > Hi All: > > Jus

Impala interpreter planned?

2016-02-18 Thread Abhi Basu
Hi All: Just curious if an Impala interpreter is planned? Should be very close to the hive one (hiveserver2), just using port 21050 instead. Thanks, Abhi -- Abhi Basu

Re: Can't get Pyspark(1.4.1) interpreter to work on Zeppelin(0.6)

2016-02-17 Thread Ian Maloney
elow and started the Zeppelin daemon. Inspecting the spark.yarn.isPython config in the spark UI, showed it to be "true". The pyspark interpreter gives the same error as before. Are there any other configs I should check? I'm beginning to wonder if it's related to something in H

  1   2   3   4   >