Re: Installing PyArrow on Amazon Linux

2017-07-02 Thread Suvayu Ali
Hello Uwe, On Sun, Jul 02, 2017 at 02:15:38PM +0200, Uwe L. Korn wrote: > > 1. Your pip is too old, you need at least 8.1.2 That was it :). Thanks a lot! Cheers, -- Suvayu Open source is the future. It sets us free.

Re: Installing PyArrow on Amazon Linux

2017-07-02 Thread Uwe L. Korn
Hello, there are two possibilities that directly come to my mind: 1. Your pip is too old, you need at least 8.1.2 2. You're on a 32bit system Given that https://aws.amazon.com/amazon-linux-ami/2017.03-packages/ states python-pip-6.1.1, mostly likely option 1 is your problem and can be solved by

Installing PyArrow on Amazon Linux

2017-07-02 Thread Suvayu Ali
Hi Arrow devs, I'm not sure if this is the correct place to ask, if not, please point me in the right direction. I wanted to use the HDFS client with PySpark (for now). My Spark cluster is on Amazon EMR, so the nodes use Amazon Linux (2017.03). On my dev machine (Fedora 25) with Python 3.5.1, a