I'm looking at options to replace the custom Arrow logic in cuDF with
Arrow library calls. What's the recommended way to declare a dependency
on pyarrow/arrowcpp with CUDA support?
I see in the docs it says to build from source, but that's only an
option for an (advanced) end-user. And building/vendoring
libarrow_cuda.so isn't a great option for a non-Arrow library, because
someone who does source build Arrow-with-cuda will conflict with the
version we ship.
Right now we're considering statically linking libarrow_cuda into
libcudf.so and vendoring Arrow's cuda cython alongside ours, but this
increases compile times/library size.
Is there a package management solution (like pip/conda install
pyarrow[cuda]) that I'm missing? If not, should there be?
Best,
Paul
- Building on Arrow CUDA Paul Taylor
-