Hi Xander, Was there autocorrect on this e-mail? the second example shows "gondiva" not "gandiva"
-Micah On Tue, Apr 13, 2021 at 12:59 PM Xander Dunn <[email protected]> wrote: > On my local macOS 11.2.3: > ``` > $ python --version > Python 3.7.10 > $ pip --version > pip 21.0.1 from > /usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pip (python > 3.7) > $ pip list | grep pyarrow > pyarrow 3.0.0 > $ which python > /usr/local/anaconda3/envs/my_model/bin/python > $ python > >>> import pyarrow as pa > >>> print(pa.__file__) > / > usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py > >>> import pyarrow.plasma > >>> import pyarrow.gandiva as ga > >>> print(ga.__file__) > / > usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/gandiva.cpython-37m-darwin.so > ``` > > On my Ubuntu 14.04 instance: > ``` > $ python --version > Python 3.7.10 > $ pip --version > pip 21.0.1 from > /home/xander/anaconda3/envs/my_model/lib/python3.7/site-packages/pip > (python 3.7) > $ pip list | grep pyarrow > pyarrow 3.0.0 > $ which python > /home/xander/anaconda3/envs/my_model/bin/python > $ python > >>> import pyarrow as pa > >>> print(pa.__file__) > / > home/xander/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/__init__.py > >>> import pyarrow.plasma > >>> import pyarrow.gondiva > Traceback (most recent call last): > File "<stdin>", line 1, in <module> > ModuleNotFoundError: No module named 'pyarrow.gondiva' > ``` > You can see that pyarrow.gondiva is found on mac but not on Ubuntu. Same > Python version. Same pyarrow version. I installed both of them with `conda > install -c conda-forge pyarrow==3.0.0`. > > On Mac, I see the expected Cython file and library: > ``` > $ l > /usr/local/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/ | > grep gandiva > -rwxrwxr-x 2 xander staff 221K Apr 1 12:44 > gandiva.cpython-37m-darwin.so > -rw-rw-r-- 2 xander staff 17K Jan 18 14:00 gandiva.pyx > ``` > > On Ubuntu, I see only the Cython file: > ``` > $ l ~/anaconda3/envs/my_model/lib/python3.7/site-packages/pyarrow/ | grep > gandiva > -rw-rw-r-- 1 xander xander 17K Apr 13 12:28 gandiva.pyx > ``` > > Is this expected? Should I be able to import pyarrow.gandiva on Ubuntu? > Everything is run on Ubuntu so if I make use of pyarrow.gandiva I'll need > to figure out how to call it. > > It's mentioned here that it was removed from Python wheels but should > still be available in the conda install: > https://issues.apache.org/jira/browse/ARROW-10154. I'm not finding it in > my Ubuntu conda install. > > Thanks, > Xander > >
