Re: [DISCUSS] Remove PostgresqlInterpreter

2017-01-23 Thread Jongyoul Lee
Thanks for replying it. I'll make a PR for doing it. On Mon, Jan 23, 2017 at 4:09 PM, Prabhjyot Singh wrote: > +1. > > Yes, agreed I too think its overhead, and all the features can be achieved > via JDBCInterpreter. > > On 23 January 2017 at 10:45, Jongyoul Lee wrote

[DISCUSS] Remove PostgresqlInterpreter

2017-01-22 Thread Jongyoul Lee
that time. But, now, JDBCInterpreter include all functions of PostgresqlInterpreter and provide better functions. How do you guys think of it? If it's accepted, 0.8.0 won't have PostgresqlInterpreter anymore. Regards, Jongyoul Lee -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: [Discuss] Move some interpreters out of zeppelin project

2017-01-20 Thread Jongyoul Lee
onsibility to develop and make new release. > > Please help comment on these 4 questions and feel free to add any things > that I miss. > > > [1] https://lists.apache.org/thread.html/69f606409790d7ba11422e8c6df941 > a75c5dfae0aca63eccf2f840bf@%3Cusers.zeppelin.apache.org%3E > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: [DISCUSS] Release package size

2017-01-18 Thread Jongyoul Lee
ation.html> >> [2] https://lists.apache.org/thread.html/4b54c034cf8d691655156e0cb64724 >> 3180c57a6829d97aa3c085b63c@%3Cusers.zeppelin.apache.org%3E >> >> -- >> Taejun Kim >> >> Data Mining Lab. >> School of Electrical and Computer Engineering &g

Re: Vizualize bash result

2017-01-14 Thread Jongyoul Lee
ze bash result in Zeppelin? > > For example I'd like to see a chart from this command: hdfs dfs -du -s -h > '/*' > > Also I'm interested in passing bash output to variable. > > Regards, > Andrey > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Using CDH dynamic resource pools with Zeppelin

2017-01-14 Thread Jongyoul Lee
oop cluster >>>> >>>> Thanks, >>>> Yaar >>>> >>>> -- >>>> >>>> >>>> >> This message may contain confidential and/or privileged information. >> If you are not the addressee or authorized to receive this on behalf of >> the addressee you must not use, copy, disclose or take action based on this >> message or any information herein. >> If you have received this message in error, please advise the sender >> immediately by reply email and delete this message. Thank you. >> >> > > > This message may contain confidential and/or privileged information. > If you are not the addressee or authorized to receive this on behalf of > the addressee you must not use, copy, disclose or take action based on this > message or any information herein. > If you have received this message in error, please advise the sender > immediately by reply email and delete this message. Thank you. > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Passing variables from %pyspark to %sh

2017-01-12 Thread Jongyoul Lee
https://lists.apache.org/thread.html/a1b3530e5a20f983acd70f8fca029f > 90b6bfe8d0d999597342447e6f@%3Cusers.zeppelin.apache.org%3E > > > On Jan 12, 2017, at 2:16 AM, Jongyoul Lee wrote: > > There's no way to communicate between spark and sh intepreter. It need to > implement it but it

Re: Passing variables from %pyspark to %sh

2017-01-11 Thread Jongyoul Lee
some to have something like > > %sh >> /path/to/script --param8={var1} --param9={var2} > > > where var1 and var2 would be implied to be fetched as z.get('var1') > and z.get('var2') respectively. > > Other thoughts? > > > Thank you, > Ruslan Dautkhanov > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Mailing List

2017-01-11 Thread Jongyoul Lee
You can create issue into https://issues.apache.org/jira/browse/ZEPPELIN On Thu, Jan 12, 2017 at 2:54 AM, Meeraj Kunnumpurath < mee...@servicesymphony.com> wrote: > Ok, thank you. Is there a URL for the JIRA? > > Sent from my iPhone > > On Jan 11, 2017, at 8:17 PM, Jongyo

Re: Mailing List

2017-01-11 Thread Jongyoul Lee
few questions for >> which there has been no response. >> >> Regards >> >> -- >> *Meeraj Kunnumpurath* >> >> >> *Director and Executive Principal Service Symphony Ltd 00 44 7702 693597* >> >> *00 971 50 409 0169 mee...@servicesymphony.com >> * >> >> > > > -- > *Meeraj Kunnumpurath* > > > *Director and Executive PrincipalService Symphony Ltd00 44 7702 693597* > > *00 971 50 409 0169mee...@servicesymphony.com * > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Manually importing notebooks -- inconsistent behavior

2017-01-09 Thread Jongyoul Lee
context: http://apache-zeppelin-users- > incubating-mailing-list.75479.x6.nabble.com/Manually-importing-notebooks- > inconsistent-behavior-tp4830.html > Sent from the Apache Zeppelin Users (incubating) mailing list mailing list > archive at Nabble.com. > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Read only mode

2017-01-04 Thread Jongyoul Lee
ad-only-mode-tp4794.html > Sent from the Apache Zeppelin Users (incubating) mailing list mailing list > archive at Nabble.com. > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Remove support old versions of Apache Spark

2016-11-03 Thread Jongyoul Lee
Hi devs and users, Spark 1.1.x to 1.3.x is no longer supported from Zeppelin 0.7.0. Those versions are also moved to archive.apache.org. Please check the PR below and leave a comment if you have any issue for it: https://github.com/apache/zeppelin/pull/1578 Regards, Jongyoul Lee -- 이종열

Re: spark streaming with Kafka

2016-11-03 Thread Jongyoul Lee
any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > &g

Re: Zeppelin drill interpreter - connection refused

2016-11-01 Thread Jongyoul Lee
Generally, ${ZEPPELIN_HOME}/logs/... On Tue, Oct 25, 2016 at 3:18 AM, Lorenzo Peder wrote: > Hi Jongyoul, > > Where may I find the jdbc logs within the log directories? > > > > Thanks, > > Lorenzo > > > > *From:* Jongyoul Lee [mailto:jongy...@gmail.com] &g

Re: spark streaming with Kafka

2016-11-01 Thread Jongyoul Lee
; herman...@teeupdata.com> wrote: > yes, yarn-client model. > > In situation of spark streaming, does zeppelin support graphs that are > automatically update themselves, like a self-updated dashboard on top of > streaming based spark tables? > > Thanks > Herman. > >

Re: Zeppelin drill interpreter - connection refused

2016-10-22 Thread Jongyoul Lee
at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > > at java.lang.Thread.run(Thread.java:745) > > > > > > Thank you for any help, > > > > Lorenzo Peder > > > > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: spark streaming with Kafka

2016-10-21 Thread Jongyoul Lee
orted, is there a tutorial/sample notebook? > > Thanks > Herman. > > > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: ClassNotFoundException when using %jdbc(hive)

2016-10-13 Thread Jongyoul Lee
sLoader.findClass(URLClassLoader.java:381) >> java.lang.ClassLoader.loadClass(ClassLoader.java:424) >> >> >> I think the dependency configuration will pull in the hive-jdbc jar file, >> so I did not put the jar file into the ./interpreter/jdbc directory. Did I >> do anything wrong? Or the manual needs update? >> -- >> >> >> Thanks, >> David S. >> >> -- >> >> >> Thanks, >> David S. >> > -- > > > Thanks, > David S. > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: ClassNotFoundException when using %jdbc(hive)

2016-10-11 Thread Jongyoul Lee
r.loadClass(ClassLoader.java:424) > > > I think the dependency configuration will pull in the hive-jdbc jar file, > so I did not put the jar file into the ./interpreter/jdbc directory. Did I > do anything wrong? Or the manual needs update? > -- > > > Thanks, > David S. > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Change Zeppelin directory interpreters location

2016-10-09 Thread Jongyoul Lee
er.json at the new location does not change. The old file is the > modified one. > > I'm on Ubuntu 16.04 with Zeppelin 0.6.1. > > How can I figure this out? > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: [DISCUSS] Zeppelin 0.7 Roadmap

2016-10-09 Thread Jongyoul Lee
n > > [1] http://apache-zeppelin-users-incubating-mailing-li > <http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/DISCUSS-Update-Roadmap-tp2452.html> > st.75479.x6.nabble.com/DISCUSS-Update-Roadmap-tp2452.html > <http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/DISCUSS-Update-Roadmap-tp2452.html> > [2] https://cwiki.apache.org/confluence/display/ZEPPELIN/Zeppelin+Roadmap > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: How Apache Zeppelin runs a paragraph

2016-10-09 Thread Jongyoul Lee
m to visualize the differences between > shared/scoped/shared > > > > > On Sun, Oct 9, 2016 at 12:38 AM, Felix Cheung > wrote: > >> Great post! >> >> >> >> >> >> On Tue, Oct 4, 2016 at 8:56 PM -0700, "Jongyoul Lee" >>

Re: User specific interpreter

2016-10-05 Thread Jongyoul Lee
ro for > authentication and it’s simple as well. > > > > Thanks & Regards, > > *Vikash Kumar* > > > > *From:* Jongyoul Lee [mailto:jongy...@gmail.com] > *Sent:* Wednesday, October 5, 2016 12:24 PM > > *To:* users@zeppelin.apache.org > *Subject:* Re: User

Re: User specific interpreter

2016-10-04 Thread Jongyoul Lee
her user) > > > > > > And but about release date for 7 version? > > Thanks & Regards, > > *Vikash Kumar* > > > > *From:* Jongyoul Lee [mailto:jongy...@gmail.com] > *Sent:* Wednesday, October 5, 2016 11:30 AM > *To:* users@zeppelin.apache.org > *Su

Re: User specific interpreter

2016-10-04 Thread Jongyoul Lee
t; create phoenix jdbc interpreter only for admin user. I am using branch > 0.6.2. > > And question regarding > > 1. release date for branch 7 so that we can demo for Helium > > 2.Multiuser implementation roadmap? > > > > > > > > Thanks

Re: How Apache Zeppelin runs a paragraph

2016-10-04 Thread Jongyoul Lee
xecute a SparkSubmit. > > This detail is important for contributors because when they need to DEBUG > an interpreter code, they have to modify the interpreter.sh file to add an > "-Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=xxx" > > Most of peopl

How Apache Zeppelin runs a paragraph

2016-10-04 Thread Jongyoul Lee
이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: ActiveDirectoryGroupRealm.java allows user outside of searchBase to login

2016-09-22 Thread Jongyoul Lee
ActiveDirectoryGroupRealm.java#L162> , if the user is not inside > searchBase, a empty roleNames will be return and without any exception, > thus the user will be login I guess? > > I'm not sure if this is expected behaviour or not. I also tried the v0.6.1 > and seems also have same behaviour. In general I just want to restrict user > only in certain groups of ActiveDirectory to be able to login. Is that > possible without rewriting our own Realm? > > Thanks, > Weipu > > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Zeppelin Kerberos error

2016-08-31 Thread Jongyoul Lee
low command, I see > 116 databases listed, as per my expectations and I'm able to run my > notebooks built on those databases. > > [image: Inline image 1] > > Thanks, > Pradeep > > > On Wed, Aug 31, 2016 at 2:52 AM, Jongyoul Lee wrote: > >> Hello, >>

Re: Zeppelin Kerberos error

2016-08-31 Thread Jongyoul Lee
> "name": "pyspark", >>>>>>>>>>> "class": "org.apache.zeppelin.spark.PyS >>>>>>>>>>> parkInterpreter", >>>>>>>>>>> "defaultInterpreter": false >>>>>>>>>>> } >>>>>>>>>>> ], >>>>>>>>>>> "dependencies": [], >>>>>>>>>>> "option": { >>>>>>>>>>> "remote": true, >>>>>>>>>>> "port": -1, >>>>>>>>>>> "perNoteSession": false, >>>>>>>>>>> "perNoteProcess": false, >>>>>>>>>>> "isExistingProcess": false, >>>>>>>>>>> "setPermission": false, >>>>>>>>>>> "users": [] >>>>>>>>>>> } >>>>>>>>>>> } >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Tue, Aug 30, 2016 at 6:52 PM, Jeff Zhang >>>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> It looks like your kerberos configuration issue. Do you mind to >>>>>>>>>>>> share your configuration ? Or you can first try to run spark-shell >>>>>>>>>>>> using >>>>>>>>>>>> spark.yarn.keytab & spark.yarn.principle to verify them. >>>>>>>>>>>> >>>>>>>>>>>> On Wed, Aug 31, 2016 at 6:12 AM, Pradeep Reddy < >>>>>>>>>>>> pradeepreddy.a...@gmail.com> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi- I recently built zeppelin from source and configured >>>>>>>>>>>>> kerberos authentication. For Kerberos I added "spark.yarn.keytab" >>>>>>>>>>>>> & >>>>>>>>>>>>> "spark.yarn.principal" and also set master to "yarn-client". But >>>>>>>>>>>>> I keep >>>>>>>>>>>>> getting this error whenever I use spark interpreter in the >>>>>>>>>>>>> notebook >>>>>>>>>>>>> >>>>>>>>>>>>> 3536728 started by scheduler org.apache.zeppelin.spark.Spar >>>>>>>>>>>>> kInterpreter335845091 >>>>>>>>>>>>> ERROR [2016-08-30 17:45:37,237] ({pool-2-thread-2} >>>>>>>>>>>>> Job.java[run]:189) - Job failed >>>>>>>>>>>>> java.lang.IllegalArgumentException: Invalid rule: L >>>>>>>>>>>>> RULE:[2:$1@$0](.*@\Q.COM\E$)s/@\Q\E$//L >>>>>>>>>>>>> RULE:[1:$1@$0](.*@\Q\E$)s/@\Q\E$//L >>>>>>>>>>>>> RULE:[2:$1@$0](.*@\Q\E$)s/@\Q\E$//L >>>>>>>>>>>>> DEFAULT >>>>>>>>>>>>> at org.apache.hadoop.security.aut >>>>>>>>>>>>> hentication.util.KerberosName.parseRules(KerberosName.java:3 >>>>>>>>>>>>> 21) >>>>>>>>>>>>> at org.apache.hadoop.security.aut >>>>>>>>>>>>> hentication.util.KerberosName.setRules(KerberosName.java:386) >>>>>>>>>>>>> at org.apache.hadoop.security.Had >>>>>>>>>>>>> oopKerberosName.setConfiguration(HadoopKerberosName.java:75) >>>>>>>>>>>>> at org.apache.hadoop.security.Use >>>>>>>>>>>>> rGroupInformation.initialize(UserGroupInformation.java:227) >>>>>>>>>>>>> at org.apache.hadoop.security.Use >>>>>>>>>>>>> rGroupInformation.ensureInitialized(UserGroupInformation.jav >>>>>>>>>>>>> a:214) >>>>>>>>>>>>> at org.apache.hadoop.security.Use >>>>>>>>>>>>> rGroupInformation.isAuthenticationMethodEnabled(UserGroupInf >>>>>>>>>>>>> ormation.java:275) >>>>>>>>>>>>> at org.apache.hadoop.security.Use >>>>>>>>>>>>> rGroupInformation.isSecurityEnabled(UserGroupInformation.jav >>>>>>>>>>>>> a:269) >>>>>>>>>>>>> at org.apache.hadoop.security.Use >>>>>>>>>>>>> rGroupInformation.loginUserFromKeytab(UserGroupInformation.j >>>>>>>>>>>>> ava:820) >>>>>>>>>>>>> at org.apache.zeppelin.spark.Spar >>>>>>>>>>>>> kInterpreter.open(SparkInterpreter.java:539) >>>>>>>>>>>>> at org.apache.zeppelin.interprete >>>>>>>>>>>>> r.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69) >>>>>>>>>>>>> at org.apache.zeppelin.interprete >>>>>>>>>>>>> r.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93) >>>>>>>>>>>>> at org.apache.zeppelin.interprete >>>>>>>>>>>>> r.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteI >>>>>>>>>>>>> nterpreterServer.java:383) >>>>>>>>>>>>> at org.apache.zeppelin.scheduler.Job.run(Job.java:176) >>>>>>>>>>>>> at org.apache.zeppelin.scheduler. >>>>>>>>>>>>> FIFOScheduler$1.run(FIFOScheduler.java:139) >>>>>>>>>>>>> at java.util.concurrent.Executors >>>>>>>>>>>>> $RunnableAdapter.call(Executors.java:511) >>>>>>>>>>>>> at java.util.concurrent.FutureTas >>>>>>>>>>>>> k.run(FutureTask.java:266) >>>>>>>>>>>>> at java.util.concurrent.Scheduled >>>>>>>>>>>>> ThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledT >>>>>>>>>>>>> hreadPoolExecutor.java:180) >>>>>>>>>>>>> at java.util.concurrent.Scheduled >>>>>>>>>>>>> ThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPo >>>>>>>>>>>>> olExecutor.java:293) >>>>>>>>>>>>> at java.util.concurrent.ThreadPoo >>>>>>>>>>>>> lExecutor.runWorker(ThreadPoolExecutor.java:1142) >>>>>>>>>>>>> at java.util.concurrent.ThreadPoo >>>>>>>>>>>>> lExecutor$Worker.run(ThreadPoolExecutor.java:617) >>>>>>>>>>>>> at java.lang.Thread.run(Thread.java:745) >>>>>>>>>>>>> INFO [2016-08-30 17:45:37,247] ({pool-2-thread-2} >>>>>>>>>>>>> SchedulerFactory.java[jobFinished]:137) - Job >>>>>>>>>>>>> remoteInterpretJob_1472593536728 finished by scheduler >>>>>>>>>>>>> org.apache.zeppelin.spark.SparkInterpreter335845091 >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks, >>>>>>>>>>>>> Pradeep >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> Best Regards >>>>>>>>>>>> >>>>>>>>>>>> Jeff Zhang >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Best Regards >>>>>>>>> >>>>>>>>> Jeff Zhang >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Best Regards >>>>>> >>>>>> Jeff Zhang >>>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> Best Regards >>>> >>>> Jeff Zhang >>>> >>> >>> >> >> >> -- >> Best Regards >> >> Jeff Zhang >> > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Is there any way to change the default interpreter in a interpreter group ?

2016-08-24 Thread Jongyoul Lee
s in the > interpreter jar which prevent me to edit it directly. If I put another > interpreter-setting.json in {ZEPPLIN_HOME}/interpreter/{interpreter-group}, > I'm afraid they will conflict as both of them are in the classpath. > > On Thu, Aug 25, 2016 at 9:06 AM, Jongyoul Lee wr

Re: Is there any way to change the default interpreter in a interpreter group ?

2016-08-24 Thread Jongyoul Lee
can change the default > interpreter ? > > -- > Best Regards > > Jeff Zhang > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: JDBC interpreter question

2016-08-22 Thread Jongyoul Lee
Hi, No, not yet. On Tuesday, 23 August 2016, MrAsanjar . wrote: > Hi all, > Does Zeppelin 0.6.0 JDBC interpreter supporters multiple queries in a > single paragraph (snippet)? > i.e. > > %jdbc(hive) > drop table table1 > drop table table2 > > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Any reason why PostgreSQL is not merged into jdbc interpreter

2016-08-18 Thread Jongyoul Lee
PostgreSql will be merged into next major release. On Thu, Aug 18, 2016 at 5:03 PM, Jeff Zhang wrote: > Is there anything specific for postgreSQL so that zeppelin didn't merge it > into the general jdbc interpreter ? > > -- > Best Regards > > Jeff Zhang > --

Re: JDBC Interpreter

2016-08-18 Thread Jongyoul Lee
> show databases > > But the following *does not*: > - show databases; > It can not compile the request due to the ; > > - use mydb > returns a table having one row (Update count) of value -1 > > Is it a misunderstanding on my side - or I cannot chain commands l

Re: Use embedded Spark for some notebook but use system provided Spark for others

2016-08-08 Thread Jongyoul Lee
in so that it uses embedded Spark for >> some notebooks but uses system provided Spark for others. >> >> However it seems that the SPARK_HOME is a global parameter in >> zeppelin-env.sh. >> >> Is it possible to overwrite this setting at notebook level? >> >> >> >> Thanks! >> >> >> >> Patrick >> >> >> > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Zeppelin Installation Help

2016-08-04 Thread Jongyoul Lee
.InvalidProtocolBufferException: > Protocol message contained an invalid tag (zero). > at com.google.protobuf_spark.InvalidProtocolBufferException > .invalidTag(InvalidProtocolBufferException.java:68) > at com.google.protobuf_spark.CodedInputStream.readTag( > CodedInputStream.java:108) > at akka.remote.WireFormats$AkkaProtocolMessage$Builder. > mergeFrom(WireFormats.java:5410) > at akka.remote.WireFormats$AkkaProtocolMessage$Builder. > mergeFrom(WireFormats.java:5275) > at com.google.protobuf_spark.AbstractMessage$Builder. > mergeFrom(AbstractMessage.java:300) > at com.google.protobuf_spark.AbstractMessage$Builder. > mergeFrom(AbstractMessage.java:238) > at com.google.protobuf_spark.AbstractMessageLite$Builder. > mergeFrom(AbstractMessageLite.java:162) > at com.google.protobuf_spark.AbstractMessage$Builder. > mergeFrom(AbstractMessage.java:716) > at com.google.protobuf_spark.AbstractMessage$Builder. > mergeFrom(AbstractMessage.java:238) > at com.google.protobuf_spark.AbstractMessageLite$Builder. > mergeFrom(AbstractMessageLite.java:153) > at com.google.protobuf_spark.AbstractMessage$Builder. > mergeFrom(AbstractMessage.java:709) > at akka.remote.WireFormats$AkkaProtocolMessage.parseFrom( > WireFormats.java:5209) > at akka.remote.transport.AkkaPduProtobufCodec$. > decodePdu(AkkaPduCodec.scala:168) > ... 17 more > > Regards, > > Brian > > > > > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Anyone can run zeppelin on spark 2.0 in yarn-client mode ?

2016-08-03 Thread Jongyoul Lee
istency will happen. I will > solve this issue in https://issues.apache.org/jira/browse/ZEPPELIN-1263 > > On Wed, Aug 3, 2016 at 9:38 PM, Jongyoul Lee wrote: > >> In that case, zeppelin side's one will overrider spark-defaults.conf >> >> On Tue, Aug 2, 2016

Re: Anyone can run zeppelin on spark 2.0 in yarn-client mode ?

2016-08-03 Thread Jongyoul Lee
voke(NativeMethodAccessorImpl.java:62) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:497) >> at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38) >> at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33) >> >> >> -- >> Best Regards >> >> Jeff Zhang >> > > > > -- > Best Regards > > Jeff Zhang > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Pass Credentials through JDBC

2016-07-28 Thread Jongyoul Lee
it work now? > > Thanks, > Ben > > On Jul 28, 2016, at 8:06 AM, Jongyoul Lee wrote: > > Hi, > > In my plan, this is a next step after > https://issues.apache.org/jira/browse/ZEPPELIN-1210. But for now, there's > no way to pass your credentials with hid

Re: Setting default interpreter at notebook level

2016-07-28 Thread Jongyoul Lee
le or keep on using %r tags > on each cell. > > Thanks! > > -AB > > On Mon, Jul 25, 2016 at 3:30 PM, Jongyoul Lee wrote: > >> Hello Abul, >> >> Changing orders within a group dynamically is not supported yet. You can >> change it by making interpreter-

Re: Pass Credentials through JDBC

2016-07-28 Thread Jongyoul Lee
anks, > Ben -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Issue with Spark + Zeppelin on Mesos - Failed to create local dir

2016-07-28 Thread Jongyoul Lee
t;) > > Any pointers on what might be off here? I've tried changing the temp dir > around and opening permissions. Everything I see indicates it should be > able to write there. Any help would be appreciated. > > Thanks, > Mike > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Drill JDBC Interpreter: Connection Refused

2016-07-28 Thread Jongyoul Lee
PoolExecutor.java:180) > > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > > at

Re: Setting default interpreter at notebook level

2016-07-25 Thread Jongyoul Lee
hnaprasadas >> M: +91 8907209454 | O: +91 471.3082753 | F: +91 471.2700202 >> www.flytxt.com | Visit our blog <http://blog.flytxt.com/> | Follow us >> <http://www.twitter.com/flytxt> | Connect on LinkedIn >> <http://www.linkedin.com/company/22166?goback=%2Efcs_GLHD_flytxt_false_*2_*2_*2_*2_*2_*2_*2_*2_*2_*2_*2_*2&trk=ncsrch_hits> >> > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Spark/Zeppelin/Cassandra talk

2016-07-21 Thread Jongyoul Lee
the London area, I'll be giving a talk about >>>>> using Spark/Cassandra and Zeppelin to store, aggregate and visualize >>>>> particle accelerator metrics: >>>>> >>>>> http://www.meetup.com/fr-FR/Spark-London/events/232355493/ >>>>> >>>>> Also if you know any event related to Zeppelin, please ping me so I >>>>> can add it to the community page here: >>>>> https://cwiki.apache.org/confluence/display/ZEPPELIN/Community >>>>> >>>>> Regards >>>>> >>>>> Duy Hai DOAN >>>>> >>>> >>> -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Phoenix Interpreter in 0.6 release

2016-07-12 Thread Jongyoul Lee
can I get the latest phoenix interpreter code somehow? > > > > [1] https://phoenix.apache.org/multi-tenancy.html > > > > *From:* Jongyoul Lee [mailto:jongy...@gmail.com] > *Sent:* Wednesday, July 13, 2016 10:36 AM > > *To:* users@zeppelin.apache.org > *Subject:* Re: Phoe

Re: Drill JDBC Interpreter: Connection Refused

2016-07-12 Thread Jongyoul Lee
%jdbc(drill) > %drill > %drill(jdbc) > > Currently I made the drill interpretor as the default one and ran the sql > without using a %drill, > select count(*) from `dfs`.`POC/Sample1.csv` > Please find attached error log. > > > On Wed, Jul 13, 2016 at 5:26 AM, Jo

Re: Phoenix Interpreter in 0.6 release

2016-07-12 Thread Jongyoul Lee
help you tell me your use cases in details. Regards, JL On Wed, Jul 13, 2016 at 1:13 PM, Vikash Kumar wrote: > Hi, > > Phoenix support multi tenancy which we cannot achieve in jdbc interpreter. > > > > Thanks and regards > > Vikash Kumar > >

Re: Drill JDBC Interpreter: Connection Refused

2016-07-12 Thread Jongyoul Lee
java.net.ConnectException: Connection refused > at org.apache.thrift.transport.TSocket.open(TSocket.java:187) > at > org.apache.zeppelin.interpreter.remote.ClientFactory.create(ClientFactory.java:51) > ... 20 more > Caused by: java.net.ConnectException: Connection refused > > reference used https://community.mapr.com/docs/DOC-1493 > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Phoenix Interpreter in 0.6 release

2016-07-12 Thread Jongyoul Lee
ch is I am not able to get now. > And what about multitenant environment? > > Thanks & Regards, > > Vikash Kumar > > > > *From:* Jongyoul Lee [mailto:jongy...@gmail.com] > *Sent:* Tuesday, July 12, 2016 2:55 PM > *To:* users@zeppelin.apache.org > *Subject:

Re: Phoenix Interpreter in 0.6 release

2016-07-12 Thread Jongyoul Lee
not included in earlier > version? > > > > *Thanks & Regards* > > *Vikash Kumar* > > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: [ANNOUNCE] Apache Zeppelin 0.6.0 released

2016-07-09 Thread Jongyoul Lee
need more information, please let me know. > > Thanks, > Ben > > > > On Jul 7, 2016, at 7:54 PM, moon soo Lee wrote: > > Randy, > > Helium is not included in 0.6.0 release. Could you check which version are > you using? > I created a fix for 500 errors from Helium URL in master branch. > https://github.com/apache/zeppelin/pull/1150 > > Ben, > I can not reproduce the error, could you share how to reproduce error, or > share your environment? > > Thanks, > moon > > On Thu, Jul 7, 2016 at 4:02 PM Randy Gelhausen wrote: > >> I don't- I hoped providing that information may help finding & fixing the >> problem. >> >> On Thu, Jul 7, 2016 at 5:53 PM, Benjamin Kim wrote: >> >>> Hi Randy, >>> >>> Do you know of any way to fix it or know of a workaround? >>> >>> Thanks, >>> Ben >>> >>> On Jul 7, 2016, at 2:08 PM, Randy Gelhausen wrote: >>> >>> HTTP 500 errors from a Helium URL >>> >>> >>> >> > > > > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: SQLException

2016-07-04 Thread Jongyoul Lee
java:1142) > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > java.lang.Thread.run(Thread.java:745) > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Multiple spark interpreters in the same Zeppelin instance

2016-07-01 Thread Jongyoul Lee
and using notebook once user > able to select interpreter using alias? > > Best, > moon > > On Thu, Jun 30, 2016 at 10:27 PM Jongyoul Lee wrote: > >> Hi, >> >> This is a little bit later response, but, I think it's useful to share >> the current stat

Re: Multiple spark interpreters in the same Zeppelin instance

2016-06-30 Thread Jongyoul Lee
ill allow you to run multiple spark interpreters in a same note simutaneously. This will be handled ZEPPELIN-1012[2]. Please watch it. Regards, Jongyoul Lee [1]: http://zeppelin.apache.org/docs/0.6.0-SNAPSHOT/interpreter/jdbc.html [2]: https://issues.apache.org/jira/browse/ZEPPELIN-1012 On Tue, May 3, 2

Re: spark interpreter

2016-06-30 Thread Jongyoul Lee
t;>>> 'scoped' mode, a spark interpreter setting spawn multiple interpreter >>>> processes per notebook which binded to this interpreter setting. >>>> >>>> Using Livy interpreter, >>>> >>>> Zeppelin propagate current user information to Livy interpreter. And >>>> Livy interpreter creates different session per user via Livy Server. >>>> >>>> >>>> Hope this helps. >>>> >>>> Thanks, >>>> moon >>>> >>>> >>>> On Tue, Jun 21, 2016 at 6:41 PM Chen Song >>> > wrote: >>>> >>>>> Zeppelin provides 3 binding modes for each interpreter. With `scoped` >>>>> or `shared` Spark interpreter, every user share the same SparkContext. >>>>> Sorry for the dumb question, how does it differ from Spark via Ivy Server? >>>>> >>>>> >>>>> -- >>>>> Chen Song >>>>> >>>>> >> -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: geode/gemfire interpreter

2016-06-29 Thread Jongyoul Lee
nterpreter, did I missed anything? > > Thanks > > Regards > Beh > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Help! Installing Zeppelin with SQL and R

2016-06-29 Thread Jongyoul Lee
ver what I've tried): > *http://stackoverflow.com/questions/38035381/installing-r-on-apache-zeppelin* > <http://stackoverflow.com/questions/38035381/installing-r-on-apache-zeppelin> > > I've tried all kinds of guides online, re-installed zeppelin a million > times, moved around files in the Zeppelin file-systems, etc, but it still > isn't working. I'm pretty lost on this right now, so the best way for me to > get help would be through Skype. > > Thank you, > Rebecca > > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Help! Installing Zeppelin with SQL and R

2016-06-28 Thread Jongyoul Lee
s/38035381/installing-r-on-apache-zeppelin > > I've tried all kinds of guides online, re-installed zeppelin a million > times, moved around files in the Zeppelin file-systems, etc, but it still > isn't working. I'm pretty lost on this right now, so the best way for me to > get help would be through Skype. > > Thank you, > Rebecca > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Ask opinion regarding 0.6.0 release package

2016-06-17 Thread Jongyoul Lee
Hi, You can use Phoenix via JdbcInterpreter with same function. JdbcInterpreter supports all kind of JDBC-like connection. I'll update JDBC document with example. Hope this help, Jongyoul Lee On Fri, Jun 17, 2016 at 11:47 PM, Vikash Kumar wrote: > Hi, > > Our company is als

Re: Ask opinion regarding 0.6.0 release package

2016-06-17 Thread Jongyoul Lee
ch is in progress under [2]. >> >> Thanks, >> Mina >> >> [1] >> http://zeppelin.apache.org/docs/0.6.0-SNAPSHOT/manual/dynamicinterpreterload.html >> [2] https://github.com/apache/zeppelin/pull/908 >> >> -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: hive remote megastore

2016-06-13 Thread Jongyoul Lee
it Jaggi wrote: > Is there a binary release for latest code? I am unable to compile from > source on the system I am using. I can only download binaries from a legit > website. > > On Jun 13, 2016, at 2:32 PM, Jongyoul Lee wrote: > > Sorry for late reply, > > Co

Re: JDBC interpreter is not concurrent

2016-06-13 Thread Jongyoul Lee
I made a PR for dealing with it.. Check https://issues.apache.org/jira/browse/ZEPPELIN-995 @Prasad Concerning maxConcurrency, I'm trying to change Zeppelin's structure in order to support it. Wait a moment please. JL On Sun, Jun 12, 2016 at 2:29 AM, Jongyoul Lee wrote: > Hello, &

Re: hive remote megastore

2016-06-13 Thread Jongyoul Lee
Sorry for late reply, Could you please current master and use JDBC interpreter? it world work and you can see the example how to use Hive: https://github.com/apache/zeppelin/blob/master/docs/interpreter/jdbc.md Hope this help, Jongyoul Lee On Mon, Jun 13, 2016 at 4:47 PM, Mohit Jaggi wrote

Re: JDBC interpreter is not concurrent

2016-06-11 Thread Jongyoul Lee
w in Zeppelin 0.6 Hive Interpreter is merged into JDBC (which >>> is very good) but I can not execute concurrent Hive queries (which is not >>> so good). >>> How can I run concurrent queries to Hive using JDBC interpreter now in >>> Zeppelin 0.6? >>> >>> Regards, >>> Boris >>> >> >> > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: hive remote megastore

2016-06-09 Thread Jongyoul Lee
(do I have >> to?). But the following command fails >> >> *%hive show tables* >> *No suitable driver found for* >> >> I tried to add the hive.metastore.uris param via the interpreters config >> UI but can’t get the above to work. It works from hive’s CLI and from >> Spark. Any help is much appreciated! >> >> Mohit. >> > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: hive remote megastore

2016-06-09 Thread Jongyoul Lee
; *No suitable driver found for* >> >> I tried to add the hive.metastore.uris param via the interpreters config >> UI but can’t get the above to work. It works from hive’s CLI and from >> Spark. Any help is much appreciated! >> >> Mohit. >> > > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Connecting to a Linux Spark from Zeppelin on Windows

2016-06-08 Thread Jongyoul Lee
o a Spark standalone server in the >>> same machine. >>> Now, I am able to connect to my Windows Spark server using Zeppelin. >>> I have another Spark server running on a Linux machine, and I was trying >>> to connect to it from my Windows Zeppelin but I've had no luck. I'm kinda >>> lost of how to set the env variables defined in zeppelin-env.cmd. >>> So the real question is... Is it possible to do such connection? If so, >>> do you think you could give me some hints about how to do it? >>> >>> Thanks in advance >>> >> > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Re: Interpreter groups list empty

2016-06-07 Thread Jongyoul Lee
encies > 4. Try to choose interpreter group from the list. It's empty > 5. Try to save > > Result: pop-up message "Please fill in interpreter name and choose a group" > Attached please find a screenshot > > What can be a possible reason of this issue? Probably it&#

Re: Adding Custom Data Providers in Zeppelin Classpath

2016-06-01 Thread Jongyoul Lee
> on how we can make it. > > Thanks > K > -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

Update how to contribute Zeppelin

2016-05-30 Thread Jongyoul Lee
https://issues.apache.org/jira/browse/ZEPPELIN-924?jql=project%20%3D%20ZEPPELIN%20and%20status%20%3D%20Open%20and%20labels%20in%20(beginner%2C%20newbie) Regards, JL -- 이종열, Jongyoul Lee, 李宗烈 http://madeng.net

<    1   2   3