Re: NewSparkInterpreter fails on yarn-cluster

2018-06-07 Thread Thomas Bünger
I specifically mean visualisation via ZeppelinContext inside a Spark interpreter. (e.g. "z.show(...)") The visualisation of SparkSQL results inside a SparkSQLInterpreter work fine, also in yarn-cluster mode. Am Do., 7. Juni 2018 um 14:30 Uhr schrieb Thomas Bünger < thom.bu...@googlemail.com>: >

Re: NewSparkInterpreter fails on yarn-cluster

2018-06-07 Thread Thomas Bünger
Hey Jeff, I tried your changes and now it works nicely. Thank you very much! But I still can't use any of the forms and visualizations in yarn-cluster? I was hoping that this got resolved with the new SparkInterpreter so that I can switch from yarn-client to yarn-cluster mode in 0.8, but I'm

Re: Credentials for JDBC

2018-06-07 Thread Benjamin Kim
Hi 종열, Can you show me how? Thanks, Ben > On Jun 6, 2018, at 10:32 PM, Jongyoul Lee wrote: > > We have a trick to get credential information from a credential page. I'll > take into it. > > On Thu, Jun 7, 2018 at 7:53 AM, Benjamin Kim > wrote: > I created a JDBC

Re: Zeppelin 0.8

2018-06-07 Thread Benjamin Kim
Can anyone tell me what the status is for 0.8 release? > On May 2, 2018, at 4:43 PM, Jeff Zhang wrote: > > > Yes, 0.8 will support spark 2.3 > > Benjamin Kim mailto:bbuil...@gmail.com>>于2018年5月3日周四 > 上午1:59写道: > Will Zeppelin 0.8 have Spark 2.3 support? > >> On Apr 30, 2018, at 1:27 AM,

Re: Zeppelin 0.8

2018-06-07 Thread Jianfeng (Jeff) Zhang
I am doing the release, the latest RC4 is canceled, I will start RC5 in the next few days. Best Regard, Jeff Zhang From: Benjamin Kim mailto:bbuil...@gmail.com>> Reply-To: "users@zeppelin.apache.org" mailto:users@zeppelin.apache.org>> Date: Thursday, June

Re: NewSparkInterpreter fails on yarn-cluster

2018-06-07 Thread Jeff Zhang
Hi Thomas, I try to the latest branch-0.8, it works for me. Could you try again to verify it ? Thomas Bünger 于2018年6月7日周四 下午8:34写道: > I specifically mean visualisation via ZeppelinContext inside a Spark > interpreter. (e.g. "z.show(...)") > The visualisation of SparkSQL results inside a

how to load pandas into pyspark (centos 6 with python 2.6)

2018-06-07 Thread Manuel Sopena Ballesteros
Dear Zeppelin community, I am trying to load pandas into my zeppelin %spark2.pyspark interpreter. The system I am using is centos 6 with python 2.6 so I can't install pandas system wide through pip as suggested in the documentation. What can I do if I want to add modules into the

Re: how to load pandas into pyspark (centos 6 with python 2.6)

2018-06-07 Thread Jeff Zhang
First I would suggest you to use python 2.7 or python 3.x, because spark2.x has drop the support of python 2.6. Second you need to configure PYSPARK_PYTHON in spark interpreter setting to point to the python that you installed. (I don't know what do you mena that you can't install pandas system

RE: how to load pandas into pyspark (centos 6 with python 2.6)

2018-06-07 Thread Manuel Sopena Ballesteros
Hi Jeff, Thank you very much for your quick response. My zeppelin is deployed using HDP (hortonworks platform) so I already have spark/yarn integration and I am using zeppelin.pyspark.python to tell pyspark to run python 3.6: zeppelin.pyspark.python --> /tmp/Python-3.6.5/python I do have root

Re: how to load pandas into pyspark (centos 6 with python 2.6)

2018-06-07 Thread Jeff Zhang
pip should be available under your python3.6.5, you can use that to install pandas Manuel Sopena Ballesteros 于2018年6月8日周五 上午11:40写道: > Hi Jeff, > > > > Thank you very much for your quick response. My zeppelin is deployed using > HDP (hortonworks platform) so I already have spark/yarn

RE: how to load pandas into pyspark (centos 6 with python 2.6)

2018-06-07 Thread Manuel Sopena Ballesteros
Sorry for the stupid question How can I use pip? Zeppelin will run pip through the shell interpreter but my system global python is 2.6… [cid:image002.jpg@01D3FF37.8827CBF0] thanks Manuel From: Jeff Zhang [mailto:zjf...@gmail.com] Sent: Friday, June 8, 2018 1:45 PM To: