Re: how to load pandas into pyspark (centos 6 with python 2.6)

2018-06-11 Thread Jeff Zhang
; > Could not fetch URL https://pypi.python.org/simple/pandas/: There was a > problem confirming the ssl certificate: HTTPSConnectionPool(host=' > pypi.python.org', port=443): Max retries exceeded with url: > /simple/pandas/ (Caused by SSLError("Can't connect to HT

RE: how to load pandas into pyspark (centos 6 with python 2.6)

2018-06-11 Thread Manuel Sopena Ballesteros
There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='pypi.python.org', port=443): Max retries exceeded with url: /simple/pandas/ (Caused by SSLError("Can't connect to HTTPS URL because the SSL module is not available.",)) - skipping Manuel From:

RE: how to load pandas into pyspark (centos 6 with python 2.6)

2018-06-07 Thread Manuel Sopena Ballesteros
@zeppelin.apache.org Subject: Re: how to load pandas into pyspark (centos 6 with python 2.6) pip should be available under your python3.6.5, you can use that to install pandas Manuel Sopena Ballesteros mailto:manuel...@garvan.org.au>>于2018年6月8日周五 上午11:40写道: Hi Jeff, Thank you very much for your

Re: how to load pandas into pyspark (centos 6 with python 2.6)

2018-06-07 Thread Jeff Zhang
s not available > > > > Thank you > > > > Manuel > > > > *From:* Jeff Zhang [mailto:zjf...@gmail.com] > *Sent:* Friday, June 8, 2018 11:47 AM > *To:* users@zeppelin.apache.org > *Subject:* Re: how to load pandas into pyspark (centos 6 with python 2.6) >

RE: how to load pandas into pyspark (centos 6 with python 2.6)

2018-06-07 Thread Manuel Sopena Ballesteros
oot access to the machine but OS is centos 6 (python system environment is 2.6) hence pip is not available Thank you Manuel From: Jeff Zhang [mailto:zjf...@gmail.com] Sent: Friday, June 8, 2018 11:47 AM To: users@zeppelin.apache.org Subject: Re: how to load pandas into pyspark (centos 6 with pyt

Re: how to load pandas into pyspark (centos 6 with python 2.6)

2018-06-07 Thread Jeff Zhang
First I would suggest you to use python 2.7 or python 3.x, because spark2.x has drop the support of python 2.6. Second you need to configure PYSPARK_PYTHON in spark interpreter setting to point to the python that you installed. (I don't know what do you mena that you can't install pandas system wid

how to load pandas into pyspark (centos 6 with python 2.6)

2018-06-07 Thread Manuel Sopena Ballesteros
Dear Zeppelin community, I am trying to load pandas into my zeppelin %spark2.pyspark interpreter. The system I am using is centos 6 with python 2.6 so I can't install pandas system wide through pip as suggested in the documentation. What can I do if I want to add modules into the %spark2.pyspar