I don't think you need anything more on the PyArrow side, but you need
to (re)compile Arrow C++ with ARROW_COMPUTE enabled, is that the case?
Le 07/07/2022 à 22:16, Li Jin a écrit :
Hello,
I am trying to build Arrow/Pyarrow with our internal build system (cmake
based) and encounter and error when running pyarrow test:
ImportError while importing test module
'/home/ljin/vats/add-arrowpython-master/ext/public/python/pyarrow/master/dist/lib/python3.9/pyarrow/tests/test_table.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
dist/lib/python3.9/pyarrow/tests/test_table.py:27: in <module>
import pyarrow.compute as pc
dist/lib/python3.9/pyarrow/compute.py:18: in <module>
from pyarrow._compute import ( # noqa
E ImportError:
/home/ljin/vats/add-arrowpython-master/ext/public/python/pyarrow/master/dist/lib/python3.9/pyarrow/_
compute.cpython-39-x86_64-linux-gnu.so: undefined symbol:
_ZN5arrow2py22RegisterScalarFunctionEP7_objectSt8functionIFS2_S2_RKNS0_16ScalarUdfContextES2_EERKNS0_16ScalarUdfOptionsE
This looks to me like a pretty new feature with Acero and I am guessing I
am missing some flag when building pyarrow - currently I am using
"--with-dataset --with-flight --with-parquet" - Are there extra flags I
need to pass in to build that?
Thanks,
Li
